That's the secret with so many cooking. People mess with stuff too much. Letting the chicken sit lets the skin actually crisp up instead of steaming from constant flipping. Same thing happens with pan searing a steak or even roasting vegetables. Constant movement just kills the crust.
Exactly what @elliotr98 said. Learned that the hard way with burgers, kept poking them and ended up with a gray hockey puck. Just leave it alone and let the magic happen.