Hm.

I get it that heavier bullets can get the initial recoil impulse to swing the rifle and 'uncross' the groups.

What if the only bullets that group well in a particular rifle are light, and increasing the bullet weight sends the group size wide open?
Can a slower or faster burning powder help get the groups to stay inline?

--Tinker