Why do you rotate when you hold a spinning wheel?

When you hold a spinning wheel, the wheel and you, chair included, form a system that obeys the principle of "conservation of angular momentum". This means that any changes in angular momentum within the system must accompanied by an equal and opposite change, so the net force is zero.