The Earth revolves around the sun, not you. Many times people will assume that things pertain or are about them, even when that is not the case. People have lives which contain many others, the possibility that someone is actually talking about you is slim.
Not everything is about you. Instead of worrying about what others might have to say about you, start using that energy to better yourself. Once you believe in yourself it is not going to matter if people are or are not talking about you.