Sure. But they are idealizations. Nobody supposes that point particles actually exist. And therefore the problem of infinite gravitational force doesn't actually exist, so is a non-problem.
This is the part that always brings out my RCA dog look. I read an explanation of the nature of matter that describes how point like particles cause mass to exist but then turn around and read that ‘nobody supposes that point particles actually exist.’ Or that the shape of the universe may be a shape that cannot actually exist inside the universe. Or that there is no difference between space and the 'things' that appear to exist inside it. Or that the universe may have an infinite or finite past but has always existed. Or the conflict between GR and Quantum theory.
It leads me to the conclusion that there is such a thing as conflicting truths. Now it is possible, even likely, that I do not understand what the real conflicts are but it is reassureing to hear the erudite confirm that there actually are conflicts.