I ended up taking the "wings" off the front site and unscrewed the fiber optic. Thought it would still be in my way so used a dremel to cut it off and then ground it down some more. Once I had it low enough for my liking I hit it with some matte black paint and called it good. Now to get my shells and get it patterned and sighted in.
Before removing the wings, fiber optic, and cutting it off.
Finished product
Before removing the wings, fiber optic, and cutting it off.
Finished product