You are already shooting under .5" at 100 yds. How much are you willing to spend for another .25"?
Personally, I would shoot the rifle and have fun. If you can get your group size down .25 moa, that is a 2.5" improvement at 1000 yds. Any money you want to spend will be better spent shooting and learning to read/adjust for the wind. A minor error in your wind estimation will make a lot more difference than 2.5" at 1000 yds.
You have to remember that you are part of your precision rig and while we never like to admit it, we are usually the least precise part of the rig. Wind calls are seldom, if ever, perfect. Spend your money on ammo components and have some fun. Learn to read the wind and how it affects your chosen round. Then when you shoot that barrel out, upgrade to a match grade barrel and any other upgraded components you may want. The only thing I would consider upgrading before that would be a nice trigger if I did not like the current trigger.
FWIW,