Slopeshunter,
I ran a number of loads through several different makes of '06 several years ago. Best combo I had was using the 150gr Nosler in either the solid base or the ballistic tip, sitting over 57.5grs of IMR-4350 seated to a OAL of 3.250". This load shot so well that it is my standard load now. It has put numerious groups under 1" at 100yds through several makes of rifles, from Remington to Mossberge.
You can drop the charge down to 54.5 and work up some from there using the 165's. Either should work for what your looking to do and it isn't pushing the envelope. I will drop velocity over groups any day, and with the above mentioned load I hit everything I put the + on out to 400yds, and it always dropped.
I tried the RL-22 and it worked for a few loads but on others it got a little wiggy. The loads were developed in 70'ish degree weather, and when it got in the mid to upper 90's I startd to flatten primers, when it dropped into the mid to lower 30's, I got a distinct drop in pressure and velocity.
The IMR-4350 might have had a swing to it, but I never noticed it out to 300yds.