For years and years of reloading, carrying ammo in the field I've found about .002 and up easily stands up to field use. For that matter when I start a new load effort I always start at .002. Now the caveat here is the brass needs to not become work hardened. You must be annealing properly and keeping you case necks fresh. I did some ad hoc testing a few times with different brass where I loaded up and shoot the same loads until I started noticing seating issues, .ie start noticing seating depth/feel difference or resizing issues which is indicative of work hardening. It seemed to always be around the 3-4 shots. So, to never waste my time on cases that might be work hardened but avoid annealing after every use I never shoot a case more than twice with out annealing.
I guess the easiest thing would be just to anneal every time
but I am a little lazy.