What do you mean by "man"? Different people use the word "human" to mean different things, depending on the context. Sometimes "human" means any individual belonging to the same family, so the Australopithecines would be considered "human". Sometimes "human" refers to the genus Homo, which would include H. habilis but not the Australopithecines. Sometimes "human" means just H. sapiens.
And what, in your mind, is the difference between "man" and "caveman"? Just what is "caveman"?