In AN 10.176 idle chatter is defined as
He speaks in season, speaks what is factual, what is in accordance with the goal, the Dhamma, & the Vinaya. He speaks words worth treasuring, seasonable, reasonable, circumscribed, connected with the goal.
Bearing this in mind - is right speech purely connected with the Dharma? Should one speak of the Dharma and nothing else? From my own perspective some idle chit chat which has the effect of putting someone at ease in a social situation is a kindness. Similarly chatting to the daughter about nothing in particular is building the bonds of caring and again feels like the right thing to do. However would both those actions be classified as idle chatter and would not be right speech?
On a personal note I probably do talk too much so a bit less idle chatter would do me some good i think.