Where are you in the game?If its still the starting, then it may be because the only expression you know is handshake. Unlock more and you might be able to interact with...
If, however, you're late in the game or completed, then it has something to do with what kind of children they are... Like Kuld said, child labourers aren't allowed to interact with strangers.