When resizing fired brass, removal of the ball and/or decapping pin (I use a dedicated decap die instead, RCBS/Lee, Redding) sells one), the round, because it has been fired and the pill has already expanded the neck a bit don't need the expander ball to resize to correct neck dimension.
All the expander ball does is expand the neck even more, while the die resizes the neck to the bushing diameter or in the case of a fixed chamber die, to the set neck dimension (and the brass will already be larger in diameter than the die neck dimension already.
Consequently, the ball ;works' the brass and the neck of the die works it again.
Removing the ball only works the brass one time....in the die neck and working brass causes it to workharden so why overwork it and promote workhardened necks and subsequent annealing? No reason.
The only time I see an expander ball being used is on OF brass from a source other than your rifle, example: 223 OFMB where you want to resize to a consant neck dimension. I use an expander ball (the first time) for that.
less working equals less annealing. Thats the reason why I remove them.
An underlying reason (that the average reloader don't take into account is that in most dies, it's difficult to center the decap stem / expander ball concentric to it's relationship to the die bore iteself (flip your dies over and rotate them and observe the decap stem / expander ball runout, most likely, it will be very apparent.
That runout equates to the expander ball entering the brass at an angle and literally cocking the neck a bit as it passes through, imparting the runout to the neck, which, the neck size part of the die has to correct (hopefully), adding to the workhardening.
It is possible to float the expander ball / decapping stem like John Whidden does with his dies but he's the only one I've ever seen that does.
The ball is optional in most cases and it's redundant.
Having stated that, I do keep my brass segregated by firearm so the brass is only fired in one particular gun.
Excuse the spelling errors, my spell check is on the fritz today.....