I think a very important drawback between D40/D60 vs D80/D90 is .......D80/D90 have commander mode to use for Nikon's flash system, D40/60 does not, and also 11 pt AF system.
If you don't mind the bigger size, I also suggest stretch your dollar a bit over the D60 and go for D80, which is still...