I remove my quiver once I pull my crossbow up my treestand.
I also keep my crossbow facing forward and in my lap. I just recently purchased this Bow Pack with quiver, to use this year. I ordered it last week and it arrived the next day. You can remove the quiver and hang it separate from the pack if wanted.
Its a real nice bow pack and quiver.
Like you, I thought the crossbow backpack thing would be the real deal. But, when I missed an opportunity with a nice buck (that I haven't seen since except for my cameras), I stopped putting the bow on the backpack. He thought I was another buck with the limbs of the bow behind my head. He was pissed...Just food for thought...There is no way you can remove that bow when he is staring at you from a few yards away. It may never happen to you.
My quiver usually stays on, as it hangs over the shooting rail.