This problem is often a problem with your anchor. You have not been shooting regularly, so your anchor is moving into and away from your face. A slight change will make a significant difference in the arrow impact.
Try to find 3 or 4 ways to verify your anchor. If you shoot a kisser make sure it is hitting the same place, have your string just touch the tip of your nose (don't pull to the side of your nose, but just touch the tip), align the hole in the peep with the ring on your sight, or some reference on the sight(if your sight is rectangular), and make sure the string bisects the arrow at full draw (i.e., The string will be out of focus but make sure it is running straight down your arrow shaft all the way to the point of the arrow). These tips can help you to reach that perfect anchor each time.
And make sure you draw the bow to you and DO NOT EVER draw yourself to the bow. What I mean is stand facing your target, relax, As you draw the bow back do not move your head back or forward, do not lean into or away from the target, do not raise the bow over your head to draw or point it towards the west if you are facing North (right hand) to draw back. Draw straight back and do not move or contort your body to draw. These types of contortions will draw you out of alignment and cause you to have to hunt for body center. If you can't draw your bow straight back without the contortions you are pulling too much weight. Drop it 5-10lbs. You will be surprised how quickly the weight can come to you if you are drawing properly.
If you use some other reference, that is fine, just find a reference and make sure you use it the same EVERY time.