Far enough back in its Judaic roots, it would be
henotheistic: many gods exist, but our allegiance is to only one. I don't know whether modern Judaism or even Judaism just before the Diaspora (c. 70 CE) is/was still henotheistic, but it certain comes out in the Old Testament.
I would agree that in most theologies that host of supernatural entities would indeed be considered as gods.