I'd remove the can and fire a bunch of groups to see what the rifle is doing without it. After that, I'd be suspicious of the mounting mechanism. Direct thread can be better than quick-connect options. The guys I hunt with use direct-thread and they screw them on TIGHT because they've had occasional issues. They do lots of culling and are often shooting 20-30 animals a day. The Ultra 9 is a big, heavy can and if you get a bit of thread movement from first-shot recoil it could affect your POI a little.
I use an Ultra 5 on a .300 WM and I've not seen any issues as severe as you describe. I do get an interesting, reproducible shift in my POI between shots 1&2. 2&3 are usually close together, but it's all inside 1/2 MOA (sometimes 1/4 MOA) so it doesn't bother me. This year I did have to take a follow-up shoot on a mulie buck. It happens. Thank goodness shot #2 cleaned it up.
And now I see the OP is from 2020.