Hardik Patel quitting the party