Good job on the muzzle - wonderful job, actually.
As far as the wedge goes, with the barrel in the stock, there should be little to no fore and aft movement when tugging and pushing on the barrel.
The wedge should be a fairly loose fit in the barrels trunnion anyway. I do not think that is a serious problem, but would likely make a new wedge regardless and save the original in a box.