Would not help nor hurt. He's not going to be passing on "6 point" genetics, so no harm leaving him in the population. But if you want to kill him, have at it.
Thanks guys, I really have no desire to kill him other than to better the herd. So he will get a pass from me, now if he shows up with my son he gonna get shot at. Be a nice first buck.