You could use wood, as on a swivel-breech muzzleloader. Darkly stained fiddleback maple - or something darker like ebony would be nice. I doubt it would change anything, depending on how it was attached.

If you did a search for swivel breeches, you might get some ideas. Not a difficult job with some wood working tools.