Like others have said, under 10x you will not see much difference.
Over 10x magnification, and you will. How much difference you see will depend on the conditions and your eyes.
Personally I would go for the 50mm objective - it will not affect mounting height with a skinny barrel like that, you can use the same rings.
For typical north american big game hunting (+/-30min sunset/sunrise), it's not going to make much difference, but if you ever have to identify a strange object in the dark, you will be glad to have the bigger objective.
I notice the extra girth taking a big scope in and out of gun cases, and especially scabbards.
56mm and up really starts to get unweildly.