I am not sure but I think you are wrong. If there was a minority government and the totality of the non-goverment parties voted against a confidence motion (like the budget, or an unspecific motion of confidence or I-don't-know-what-else) then the governor general will collapse the current government. She/he may as the other parties if they can form a coalition to govern but more likely an election will be called.
If government members broke ranks and brought down the government I am sure they would be expelled but it could happen. But that would trigger and election too I think.