Of your options, I'd go with removing the fixed anchor if it is such an attractive hazard. I've done that climb a few times and descended a few ways, including the very short walk to the City Lights bolted anchor. I guess I just don't see the need to having a permanent anchor there, bolted or otherwise.
I guess I avoid the area when it's busy so I have no idea how often it really gets used. I've never seen anyone rappelling from it. I used it once (as one component of an anchor) when doing Easy Overhang with my girlfriend so we could remain in eye contact for her first multipitch climb.