I've popped many live primers out over the years, usually due to loose primer pockets in .223 cases. I've never had one go off, since they usually come out easy, but I've pushed a few out of normal cases as well. I use a die and pin punch from a Lee "basher" kit, a rubber hammer and *always* wear eye and ear pro when doing so! Tap gently many times and the primer almost always comes out intact without any damage, to be used again (but always in practice ammo. I've never had one not go off but don't want the first time to be when I'm relying on the ammo!)
BTW, if you're cheap like me, loose primer pockets can be fixed by setting the case on a 1/4" ball bearing & using a neck diameter punch, set the case squarely on the ball bearing and whacking the punch a few times, until the primer fit is normal. I've fixed many primer pockets this way in many different calibers with great success. Any case that is repaired like this goes into the practice round bucket, although I've never had trouble with them after their repair.
Cheers,
crkckr