Which I think is caused by the fact that our avatar's are all named after our member ID number.
What I mean is that no matter what you change your avatar to, it will always be named (memberID).jpg (in my case 7700.jpg).
The browser detects that the name is still the same, looks in its cache and simply puts the old avatar there.
At least, that's how I think it works. Could be wrong though.