Reboring to .404 would even increase the kick, besides requiring opening up of the boltface and some magazine work. I would first shoot some groups from the bench, using different bullets/loads. Even an eroded barrel may group acceptably. If it still shoots inside 3" at 100 yaeds I would leave it alone!