I installed git and did create the repo manually.
Turns out, the project access token has to be maintainer (else it cannot set a default branch/upstream on the gitlab site). Made some more changes to the git config, to assure a valid upstream/remote.
After everything worked manually, I was changing back to the internal PSU git client and it does work now.