If you are using natural point of aim, where you place the but of the rifle has a lot to do with the direction the recoil will move. For example if you place the rifle on your shoulder muscle your whole body will have to go clockwise from straight behind the rifle (for a right handed shooter) to get a natural point of aim. If you move the rifle butt right in tight under your right cheek and bring your head straight down over the rifle you will get a natural point of aim more straight dehind the rifle. For my body that actually puts the rifle stock more on my chest than in the shoulder pocket you hear everyone talking about. It is hard to explain without diagrams, but try moving the rifle butt left and right on your shoulder while you are straight behind the rifle, and watch what it does to the recoil. It is important to have a good preshot routine so you set up consistently every time. Everyone is built different so you have to experiment a bit till you find what I like to call the sweet spot, but once you get that rifle recoiling straight back the groups will actually tighten up, plus it makes it easier to spot your own shots. This is why I like to do my practice with a rifle that has some recoil to it (a 308 Winchester is great).