Some years ago, I decided to shoot several 5-shot groups with a couple of match rifles. Sitting at a bench holding the rifle to my shoulder and it resting on bags, six 5-shot groups were put down range on the 100-yard target with each rifle. Each one on top of a backer paper to have a composite of all six groups in one place.
Groups ranged from 3/4" to near 2 inches. The first 5-shot group was not always the smallest. All their groups centers were not at the same place relative to the aiming point. The 30-shot composite on the backer for each rifle was larger in extreme spread than the biggest single 5-shot group.
That convinced me to quit shooting single 5-shot groups to evaluate a load's accuracy. It also convinced me to judge accuracy one can shoot their stuff by the largest group fired; the more shots there are in it, the more credibility it has.
Therefore, huntoregon, I think what you shot was very normal when shooting 5-shot groups to evaluate the load. Part of it's you and part of it's the rifle and ammo. The system includes you the rifle and the ammo. They all have variables and when they add up in one direction bullets strike a long ways away from the point of aim. Amazing as it may sound, when all those variables tend to cancel each other out, the bullet strikes exactly at the point of aim. Which happens the most often in your opinion?
If you're OK with a single 5-shot group to evaluate any thing shooting bullets, so be it; have a nice day.