A simple "Just so we're clear..." might clear up any confusion or misunderstanding. People get or give off the wrong impression in a lot of situations/circumstances. If there are no words, how can you know what they're thinking?
Still, there are some cases where things are better left unsaid.