I had a broken nose due to recoil and a bruised jawbone.Possible the recoil yes!!!.I shoot a 460wby mag wich is one of the big kickers.Mine was an ex .458BRNO so you'll know that it is not one of the heaviest rifles on the market.I used to shoot it a lot and was comfortable with the rifle and I never developed a flinch.I just took it as it came.Then I had a recoil compensator fitted in the stock and some lead shafts to give it a extra bit of weight and a muzzlebreak.Now my little brother in law who is 13 years old siton the bench rest and take 3-4 consecutive shots.It is now in the same recoil class as a .375 H&H.
Make the gun as comfortable as possible and you'll feel better about it and shoot better.
Oh sorry another thing that a lot of people forget is the cheeck piece on your stock.If it fit you perfectly the rifle can't hurt you.Go to a professional stock maker and get some advice.IT WORK!!!!!!