Your double has good accuracy. I agree that you should zero with the right barrel and be confident that your first shot hit where you aim. You might get it to group closer by handloading, trying lighter bullets or heavier charge (if possible). I got my Chapuis double in 9,3x74R to group better when I tried 250 grains bullets instead of 286 grains (Swift A-frame).

Tore