You are right in saying that the acceleration has been taking place for billions of years, but your rate of increase is probably off. The interesting thing is that the more distant a galaxy, not only the faster it appears to be receding, but also it appears to be increasing in that speed faster than closer galaxies. In other words, the speed at which a galaxy recedes from us appears to be proportional to the amount of space between us and the galaxy.
Please tell me if I have this right. Would this mean that Hubble's constant is not constant? That is, is Hubble's Constant higher for more distant galaxies than it is for closer galaxies (assuming they are not gravitationally bound)?