Most anybody can shoot 2 MOA. Or, even produce an occasional 100yd bughole.
With a little diligence, a decent rifle, and good ammo, you should be able to consistently shoot MOA at longer ranges.
With a little more effort, sub-MOA.
But, due to the law of diminishing returns, it gets increasingly difficult from there on out to tighten up groups and to do so consistently and especially with long shot strings.
Folks often report sub-quarter-MOA performance who most likely aren't consistently doing so at long range in variable conditions.
But, even with a perfect rifle/load, it doesn't take much wind shift to open up groups beyond MOA at long range.
That said, a great shooter may well outperform a mediocre shooter at long range even with a lesser rifle/ammo.
So by all means, I recommend sorting/culling in order to eliminate extremes and to boost confidence. But, don't wear yourself out and forget to practice at long range and in the wind.
Load 20 after OCD prepping, sorting, and culling. And, shoot them at 500yds or more along side 20 without the excessive culling and determine for yourself if it's worth the extra effort.
-- richard