You can use this simple service I made to access GitHub through IPv6, and you don't need to have IPv4 on every server or set up your own proxy server.
You have the choice of using the proxy explicitly by its own address, or adding it to your hosts file to connect transparently through it. Since you're connecting to the real GitHub by a different address, there are no certificate errors.