my guess is an answer your probably not going to want to here but it happens to me all the time. My first group sucks so i then tend to pay a bit more attention to my trigger work and consentrate a bit more and low and behold the group tightens. Theres some days i go to the range and everything clicks and others that i should have just stayed home.
I hear you there, the problem is, i had shot about 10 groups prior to that one with my 308