Mathematically with a wind other than 6 or 12 O'clock a bullet will have a measure of up or down varience as well as a sideways varience. Of course there is always the vertical component of crosswinds but for simplicity sake lets forget about the minor technical issues.
You ask a good question. To the letter of physics, I cannot offer you an honest answer. Mathematically I can help you.
That said, if you had a proven load not acting normal vertical, I would ask if you accounted for ALL of the enviornmental factors such as temp, humidity, pressure. Raw pressure that is and NOT altitude. Also, was the powder hotter or colder than normal? Were you able to accuratey judge the windage at locations other than the firing line and the target?
What was the distance fired? How 'proven' is the load? How well have you documented the velocity of the load (ie: how many sessions have you chronied the load in different temps)??
There is a reason your load did not perform as expected. There is a reason AND an answer. You just have to perform the proccess of elimination tactic to find the answer. Be honest!