Nobody cares about drop. There should be little to no uncertainty about the drop on a long range shot if you care about precision. It's all about wind, there is always uncertainty there. The heavier bullet will have similar wind performance, and will eventually at long enough range best the wind drift of the lighter bullet, and have more energy while doing so.
If you are taking point blank shots or shooting within the crossover range where the time if flight isn't long enough to show the difference then yes it doesn't really matter.
But today we are blessed with long range bullets with superb ballistic characteristics (form factor) and the higher bc will win out given enough range. As noted, the only disadvantage us that it will drop more, but no credible long range hunter or target shooter is guessing on drop anyway so that becomes a moot point.
I think the op is saying that in his rifle he cannot get the 180s to a speed high enough to overcome the velocity advantage the 168s start with. While that may be true for him, many are shooting the 180s at a speed high enough that they show an advantage sooner, though they still start out slower than the 168. The 168 is a superb bullet, and the difference in BC isn't that great anyway.