Men refuse to return mahila dole, say give back votes first