Okay first off I'll admit I'm a little lost and confused but I'm going to try and help. What I would recommend doing is making sure the rifle is solid. I do this before ever doing any load development. Make sure the barrel is free floated, make sure your action screws are torqued properly, make sure nothing is bound up. Next check your scope base to make sure it's properly torqued, make sure the rings are also properly torqued. If all of that checks out, then clean your barrel and make sure it's not full of carbon or copper. Next I would try some factory loads to get a baseline for accuracy if you're new to reloading.
After you do all of that, and everything checks out, move on to load development. I would start over. I like to shoot a 10 shot pressure test that covers 4.5gr of powder. If book max is 56.1gr then load up to 57.0gr and start at 52.5gr in 0.5gr increments. Seat all bullets .020 off the lands and use the same brass, primers, powder, and bullets for all. Starting at 52.5gr shoot all 10 shots at the same point of aim at 100 yards. Stop when you hit pressure! Map your points of impact and find 3+ shots that form a group. The group doesn't have to be small, just 3 consecutive loads that hit closer than the rest. When you find that, select the middle charge weight then do a seating depth test. Load 3 rounds at each seating depth using the same powder charge for all. I like to start at .020 off and work back to .060 off in .005 steps. Shoot groups with each seating depth until you find the best group. Then go back and fine tune your powder charge using the best seating depth. Load 0.4gr below and 0.4gr above the load you selected and load in 0.2gr increments. Go shoot all of those at separate targets and look for 2-3 charge weights that hit with the same point of impact. Select the middle charge of those 2-3 then go retest and fine tune your seating depth.