Yeah.. I can empathize with u jsbn. I've thot abt it many times but I guess i'm still in my comfort zone to leave photography for now. But I know a small few who have given up serious photography (using SLRs and switched to compacts or even can't be bothered now).
My reason is, firstl that it's costly. I might not have been so into photog had I not been working. Those buying and selling. I easily lose hundreds in a year or 2. Thousands $ within 3-5 years. It's hard not to be tempted and want something if you set for yourself high standards. It's worse now that digital has come in. Like it or not, it's hard not to upgrade. Eg: If u used to own the Canon D30 or 1D, you know what I mean. With 3MP how long more could u wait b4 telling yourself to upgrade? If you had bought it brand new when the D30 first came out, it was $4k+. Functions and focusing ain't fantastic compared to the present DSLRs. Say you upgrade to a 10D 3 years later. You'd easily lose at least $3.5k just from depreciation of the D30. Now that's only a short 3 years. Then you need to spend some 3k more for a brand new 10D. Then what's next. The 30D is quite a lot better than the 10D already. Ok, so u can still wait. Fine, I'm sure the next 40D is definitely worth the upgrade. U lose some thosands within 3+ years... So it adds on... That's only the body! U also buy and sell lenses. Acessories, etc.
But that's not the main part. There's the time and effort u need to learn how to post-process. This is the killer part for most amateurs.
And also, not forgetting the time and effort to always want the best. U're constantly on your feet thinking about exposure, composition, etc etc. Even when travelling. Sometimes, some of us get the head-shaking from our friends or spouses for not spending enough time with them but instead wandering away taking hours to shoot just 1 shot. Which, unfortunately is no guarantee that it will look anything as nice as those in books, postcards and brochures. Much as the pros would teach u about photography, they'd never admit they spend days or weeks b4 getting good shot. U only see their best, but not the hundreds of rejects. U show your work to your friends, they said Hmm, nice... But in your heart, u know it's not the best possible. Only perhaps the best you could do at that particular point in time you were shooting. Then you wonder, Heck, why spend so much time in one location when someone else with a compact could have done not too far off from you? Indeed, when I travelled recently, I noticed those with compacts seem happier. Whereas for those with their biggy SLRs, they missed out on the true joy of travelling and relaxing.
I really dunno... I guess being a perfectionist makes me stay on in photography. But I do admit that if it were not for photography, I would have much more time for many other activities. And sometimes, I really need to draw a line between letting go and always being paranoid about getting THE best shot.
Is that how you feel jsbn?