I'm going to suggest the VERY inexpensive start. Get an old used
The ABCs of Reloading book (from $6) or a slightly more modern
version ($38) and a
Lee loader classic ($38) for a caliber you want to try. No press needed however you can only load brass shot from the same rifle going this super cheap route. If you want to go just a tiny bit more expensive but still super cheap get a
Lee Press ($36) and a set of used dies or
Lee Pacesetter dies ($35). This way you can use brass from any rifle because you can full length size it. (read the manuals BEFORE starting or getting help) It is worth while to find someone who reloads already, we typically already have everything to walk you thru the steps.
Add to this a decent set of calipers ($30-60) some sizing wax, and a funnel ($5) Some powder / bullets / primers and your off to reloading. You can add to this a scale to be more precise but the Lee dies come with a scoop that measures by volume not weight. Weight is more precise but not needed just to get your feet wet. The super inexpensive Lee press can later be used for just decapping primers once you get a nicer press ($80 - skys the limit) to keep the expensive press cleaner.
Obviously you can start off with as nice of equipment as you'd like but for years F-class shooters used the lee loader classic "Hammer and go" right at the competitions to reload. Another note is that the $36 cheap Lee press really is best suited for pistol or short action rifle calibers. It will do long action but it doesn't have the force of the bigger presses for resizing. Eventually you will end up with primer pocket cleaners, chamfer tools, tumbler / case cleaners, case length trimmers, etc for regular reloading. Then the next step up is fancy neck bushing dies, neck trimmers, annealer...the list goes on depending on how small of groups you get obsessed with.
Best advice I was given when I started: "Don't allow any distractions when dispensing powder!, check the charge multiple times, make sure it is right, then check it again."
Good luck.