I am guilty of saying I let the man count. If I count, I cannot follow the ever changing count of my partner. Example, in the waltz chasse, sometimes he counts correctly one two and three but usually just walks through with the same beat on all steps, not holding the two. So I try to "glue" to him and follow whatever timing he decides to execute at the moment. He is not at all consistent. In the quickstep we have taken lessons time and again with the teacher giving him the correct timing on certain steps but he varies from what the teacher says.
So we women sometimes say "I will follow the man's count" because with an inconsistent partner I must somehow appear to be "with him". I am amazed at how much easier it is to follow men who consistently are on beat.