Since normal ssh commands work but git commands don't, I think it's a problem with git-for-windows, somehow. My current workaround is to add IdentityFile tag to ~\.ssh\config pointing to the right key ...