There is a good chance that your lady partners are backleading - which is always tiresome, but indirectly, the original fault lies with the men that have collectively failed to lead such ladies properly in the first place.
A question for you to ponder. Without seeing you dance, no one here can begin to answer it. When you place your foot, on the beat, has your body moved first, as it should have? A common fault is for the foot to be placed, and for the body weight to follow (a bit like being dragged over the standing foot). When moving (forwards, in particular) the body should move first: the foot is swung as the point of imbalance is reached, making the movement inevitable. A follower will feel the movement, from the upper body, though the hold, before the foot moves an inch. If that lead never comes, she has to choose whether to stand still (and get her feet trodden on), or to anticipate the movement, as best she can.
Of course, I appreciate that this fault may not be apparent in your own dancing, but it is very common that men, knowing that they SHOULD be leading, have no idea at all HOW to do it.