The Green Party have called for a cross-party pact between parties of the left to challenge the Conservatives at the next election.