Muslim leader refuses handshake with female minister