The questions that you are asking about why a perfect and omnipotent God would bother to create the universe is not new. This has been a strain in philosophy since the ancient Greeks.
A History of Western Philosophy by Bertrand Russell (published in 1946) gives some space to the evolution of this perfect God in pagan and Christian intellectual history. I believe Karen Armstrong's
A History of God also speaks of various Jewish, Muslim, and Christian philosophers trying to come to grips with this question.
As you read the Hebrew scriptures, it becomes very clear that the early Hebrew conception of God is very anthropomorphic -- it is a God, and one, it seems, among other Gods (it appears that the ancient Hebrew were actually henonistic -- look that word up), he had very human emotions, could make mistakes, be uncertain, and do all the other things that anthropomorphized Gods do.
Then, the Hebrew deity becomes the the omnipotent, omniscient God that is portrayed today. I doubt that this was indigenous with the Hebrews themselves -- my guess that this was due to Greek influence (many of the ancient Greek philosophers speak of an omnipotent and perfect Creator/God), although maybe this sort of evolution is common among theistic cultures.
So now the Christians are in the unhappy position of trying to reconcile this Hellenic perfect God with the clumsy, rash, and very human deity depicted in the Old Testament.