The Principle of Parsimony is okay when its used correctly. In the sense that Atheists will typically use it, its basically to try to make a sweeping generalization so they don't have to investigate evidence on their own. Its called being lazy, and thats a logical fallacy.
But, keeping it simple on the other hand is fine, in such a manner that we can use it to demonstrate the only one God is necessary to exist.