Case in point: I don't believe in flying-purple elephants. Because I don't believe in them I find no compulsion to argue about their existence, much less give it any thought. But this doesnt work for the atheist, otherwise, why not just spend as much time attempting to refute the existence of the flying-purple elephant? Why not something arbitrary to argue about? Why?-- Its because there is something in them that is mindful of their Creator and the mere fact that they give Him such 'undue' attention should speak very loudly to you that they do in fact care and that they are in fact effected by the notion of God.
That would be true except that there are no religions based on Flying Purple Elephants, nor are their any people that tell you that if you don't believe in their version of FPE (for example FPEs with jet packs or FPEs with wings) you will burn in a very hot hell.
The belief in a God has had a much greater impact on history and is so much a part of out current life/politics that it can't be simply ignored, even by non-believers.