My experience with the Swift, a supposedly notorious barrel burner, falls inline with your supposition. IMR 4064 is the gold standard with 50-52 grain bullets but it will ruin a throat in short order if shot fast and hard without consideration for barrel temp. I have not shot AA 2700 in a Swift but it is reported to significantly lengthen barrel life, and it obviously is a much slower powder.
That said, Jim Carmichael wrote in THE BOOK OF THE RIFLE that he had a Swift with over 5K rounds through it that was still "nicely" accurate and I think he was fond of IMR powders. Jim was fond of velocity penning the line. If you've got a race horse you ought to let it run!
The heavier longer bullet theory has merit as well. I built a fast twist Swift and with the 9T shooting 68 gr. bullets and though they are incredible,compared to 50s in the wind, they do not supposedly enjoy a long barrel life.
I do believe the nut behind the gun has a huge impact on barrel life, keep it cool, keep it clean and modern barrel steel is pretty resilient.