I've shot & loaded for 7wsm, 6.5wssm imp, 243AI, 6XC, 6br, and bunch of 223s.
243win I've shot(my father's) and killed a few deer with growing up. But I didn't reload for it.
Group sizing with different bullets & loads means little to nothing about bullet stability. If there was any group at all, and bullets were not whacking paper sideways at 10ft, then the bullets were stable.
Your 55 Hornady was stable, but shooting poorly. That's all.
It doesn't mean light bullets were not stable, or wouldn't be.