I have an APC 1500 Backup I bought around 2006 (the battery is tagged 12/06). It's worked fine. Being the prudent sort I thought to buy a replacement from APC in 2010 or so. The original has only just ...
Old battery's probably swelled up and that's why it's getting stuck. Don't be shy about removing the entire top cover and front of the frame, if needed.