I haven't been to Yosemite. I will make a mental note! Camelback is tough, but there were a quite a few 55 plus and one guy who could have been close to 80. If you have any kind of condition or ailment you probably shouldn't try it.
If you're in good shape you should be fine. You just need to steady yourself by touching and occasionally grabing rocks. If you've climbed at all and are in shape, it should be cake. Tiring but not exhausting. The east side is a lot easier than the west (unless I have my directions mixed up).