Actually, you would be surprised to find out this is not as uncommon as you suspect.
I know some experienced loggers pretty well, and they say once the local deer get acclimated to the sounds and big equipment moving, even a rutting buck will mostly ignore it as well (so long as the other deer aren't concerned).
Many loggers are honorable, and won't poach your bucks, but some are every bit the opposite, and often have more shooting opportunities than those hunting the property. Beware the ones with a rifle in their skidder/loader cabs, as well as those coming in before daylight & leaving after dark, as that's the pattern I've found often distinguishing the poachers from the ones who wouldn't.
Last year, I killed a very old doe that the loggers put me on. They could have poached her most any day from either their loader or skidders, and she had zero concern for their nearby presence.