Ripley, Take a look at the 78xx data sheet. Those caps you added are pretty much mandatory to avoid oscillations. Just go to Digikey's site and punch in 7805, click any of the data sheets it offers, and scroll down to the apps section. Same thing with 79xx negative regulators. I had to add the same caps to one just yesterday.