How to format Git settings in appsettings.json

ARKO · June 13, 2020, 7:03pm

Hi,

I did try some options for Git connection, but can’t get a connection and I don’t really understand which username and password must be used.

I don’t know if it makes a difference, but i’m using a private repo.

I checked the documentation and also checked the forum, but I can’t find a example.

  "Data": {
    "RepositoryPath": "%ProgramData%\\UniversalAutomation\\Repository",
    "ConnectionString": "%ProgramData%\\UniversalAutomation\\database.db",
    "GitRemote": "",
    "GitUserName": "",
    "GitPassword": ""
  },

adam · June 15, 2020, 1:41pm

Hi @ARKO,

We need to update the documentation for this. If you are using GitHub, you can create a Personal Access Token instead of using the user name and password. Then your username can be anything and you can use your PAT as the password.

I’ve had success with just using my username and password but I think we’re going to change the recommendation here to use the PAT instead.

Make sure that you include the .git extension when putting in your remote URL.

ARKO · June 17, 2020, 6:41pm

Hi,

Thanks for the answers, I will try it later because i’m finishing a other project first. Can you tell me what you’re using as the GitRemote format? Like:

HTTPS: https://github.com/QMSPS/Q-PowerAPI.git

git@github.com:QMSPS/Q-PowerAPI.git

Or something else? If you let me know (ore someone else) I will check it.

Kind regards,
ARKO

adam · June 18, 2020, 1:04pm

We’ve been using format number 1.

jackvaughanjr · July 15, 2020, 1:10am

@adam I’m also having an issue with Git sync. I’m receiving the following error in the logs:
2020-07-14T20:08:10.6727961-05:00 [ERR] Failed to sync: "There is no tracking information for the current branch." " at LibGit2Sharp.Commands.Pull(Repository repository, Signature merger, PullOptions options) at UniversalAutomation.Git.GitService.Pull() in C:\src\universal\src\UniversalAutomation.Git\GitService.cs:line 225 at UniversalAutomation.GitSyncService.TrySync() in C:\src\universal\src\UniversalAutomation\Services\GitSyncService.cs:line 83 at UniversalAutomation.GitSyncService.Sync() in C:\src\universal\src\UniversalAutomation\Services\GitSyncService.cs:line 54" (2d6ed692)

adam · July 15, 2020, 1:33am

Can you check the status of the local git repo using standard git commands? I’m not sure how it got into the state you are in but you might be able to get it straightened out manually and then PSU should be able to sync.

PSU effectively does a git pull followed by a git push during the git sync. We only support a single master branch at the moment and don’t specify that branch specifically.

jackvaughanjr · July 15, 2020, 3:50am

@adam thanks for your help. I was able to get the previous commits pushed, but now it fails to push automatically. If I enter the directory, I see that a push is waiting and can push manually, but I’m seeing this in the logs:
2020-07-14T22:49:00.9377294-05:00 [ERR] Failed to sync: "programdata configuration file owner is not valid" " at LibGit2Sharp.Core.Ensure.HandleError(Int32 result) at LibGit2Sharp.Core.Proxy.ConvertPath(Func``2 pathRetriever) at LibGit2Sharp.Core.Proxy.git_config_find_programdata() at LibGit2Sharp.Configuration..ctor(Repository repository, String repositoryConfigurationFileLocation, String globalConfigurationFileLocation, String xdgConfigurationFileLocation, String systemConfigurationFileLocation) at LibGit2Sharp.Repository.<>c__DisplayClass25_1.<.ctor>b__3() at System.Lazy``1.ViaFactory(LazyThreadSafetyMode mode) at System.Lazy``1.ExecutionAndPublication(LazyHelper executionAndPublication, Boolean useDefaultConstructor) at System.Lazy``1.CreateValue() at LibGit2Sharp.Repository.get_Config() at LibGit2Sharp.Branch.RemoteNameFromLocalBranch() at LibGit2Sharp.Branch.get_RemoteName() at LibGit2Sharp.Commands.Pull(Repository repository, Signature merger, PullOptions options) at UniversalAutomation.Git.GitService.Pull() in C:\src\universal\src\UniversalAutomation.Git\GitService.cs:line 225 at UniversalAutomation.GitSyncService.TrySync() in C:\src\universal\src\UniversalAutomation\Services\GitSyncService.cs:line 83 at UniversalAutomation.GitSyncService.Sync() in C:\src\universal\src\UniversalAutomation\Services\GitSyncService.cs:line 54" (2d6ed692)

adam · July 15, 2020, 12:50pm

How are you running Universal? Service or something? It seems like file permissions may be incorrect now that you used the git commands manually…

jackvaughanjr · July 15, 2020, 1:01pm

As a service, yeah. Installed via the msi.

mabster · February 17, 2022, 3:55am

Resurrecting an old thread because we’ve just hit this same error message:

Git Synchronization Failed
There is no tracking information for the current branch

Our GitHub repo was a new, blank repo, and I was sure to add a setting Data__GitBranch = “main” to our environment variables.

When I drop to the repository folder in the Azure Kudu console and type “git status” I see this:

D:\home\data\PowerShellUniversal\Repository>git status
On branch master

No commits yet

Untracked files:
(use “git add …” to include in what will be committed)
.universal/
… (list of .ps1 files)

(Notice it says “On branch master”? Our GitHub repo doesn’t have a master branch.)

Does PSU not honour the Data__GitBranch environment variable? Do I need to add it to the appsettings.json file? Or is there something else I need to do to get it to clone and sync with “main”?

Cheers,
Matt

mabster · February 17, 2022, 4:13am

I tried setting GitBranch=“main” in the appsettings.json, deleting the “.git” folder from the repository and restarting the app service. No joy - same recurring error.

The “Git” page in PSU has always looked “correct” insofar as it says “main”:

Something under the hood is still looking for a “master” branch despite the setting, I think.

adam · February 17, 2022, 3:40pm

I have a GitHub repo for testing git sync that uses main rather than master.

  "Data": {
    "RepositoryPath": "%ProgramData%\\UniversalAutomation\\Repository",
    "ConnectionString": "filename=%ProgramData%\\UniversalAutomation\\database.db;upgrade=true",
    "GitRemote": "https://github.com/ironmansoftware/shiny-octo-waffle.git",
    "GitUserName": "adamdriscoll",
    "GitPassword": "redacted",
    "GitBranch": "main",
    "GitSyncBehavior": "OneWay",
    "ConfigurationScript": ""
  },

You are completely deleting the repository folder within the app service and then it recreates it and it’s in the master branch?

mabster · February 17, 2022, 8:07pm

Yeah exactly. I don’t have GitSyncBehaviour set, but other than that my settings are similar to yours.

I stop the service, delete the .git folder and restart the service, and the .git folder is re-created, but the HEAD file looks like this:

ref: refs/heads/master

… even though the “Git” page says it’s syncing main.

mabster · February 17, 2022, 10:42pm

Just updated to 2.8.2 and repeated the process of shutting down the service, deleting the .git folder and restarting, but the newly-created HEAD file still says master.

adam · February 17, 2022, 11:34pm

Ok. Any way you can send me the full log file?

I just doubled checked that I’m not going crazy. I stood up a new bare repository in GitHub.

My repository folder was like this.

Started up universal after setting the GitHub settings.

And now my repository has the files and the main branch.

And my repository has a .git folder with the proper branch in head.

Just want to be clear on the steps I took to ensure that I’m doing the same thing as you. If you did something different, let me know and I can try that.

mabster · February 17, 2022, 11:37pm

Absolutely! Here’s the top part of the log. From then on it’s just the same GIT exception repeated every minute:

2022-02-17 22:37:55.241 +00:00 [INF] Azure Web Sites environment detected. Using 'D:\home\ASP.NET\DataProtection-Keys' as key repository; keys will not be encrypted at rest.
2022-02-17 22:38:06.897 +00:00 [ERR] Error registering vault PSUSecretStore
2022-02-17 22:38:06.899 +00:00 [ERR] Exception:
System.TypeInitializationException: The type initializer for 'Microsoft.PowerShell.SecretStore.SecureStoreFile' threw an exception.
 ---> System.UnauthorizedAccessException: Attempted to perform an unauthorized operation.
   at System.Security.AccessControl.Win32.SetSecurityInfo(ResourceType type, String name, SafeHandle handle, SecurityInfos securityInformation, SecurityIdentifier owner, SecurityIdentifier group, GenericAcl sacl, GenericAcl dacl)
   at System.Security.AccessControl.NativeObjectSecurity.Persist(String name, SafeHandle handle, AccessControlSections includeSections, Object exceptionContext)
   at System.Security.AccessControl.NativeObjectSecurity.Persist(String name, AccessControlSections includeSections, Object exceptionContext)
   at System.Security.AccessControl.NativeObjectSecurity.Persist(String name, AccessControlSections includeSections)
   at System.Security.AccessControl.FileSystemSecurity.Persist(String fullPath)
   at System.IO.FileSystemAclExtensions.SetAccessControl(DirectoryInfo directoryInfo, DirectorySecurity directorySecurity)
   at Microsoft.PowerShell.SecretStore.SecureStoreFile.SetDirectoryACLs(String directoryPath)
   at Microsoft.PowerShell.SecretStore.SecureStoreFile..cctor()
   --- End of inner exception stack trace ---
   at Microsoft.PowerShell.SecretStore.SecureStoreFile.get_ConfigRequiresPassword()
   at Microsoft.PowerShell.SecretStore.LocalSecretStore.get_PasswordRequired()
   at Microsoft.PowerShell.SecretStore.SetSecretStoreConfiguration.EndProcessing()
   at System.Management.Automation.Cmdlet.DoEndProcessing()
   at System.Management.Automation.CommandProcessorBase.Complete()
2022-02-17 22:39:51.559 +00:00 [INF] Azure Web Sites environment detected. Using 'D:\home\ASP.NET\DataProtection-Keys' as key repository; keys will not be encrypted at rest.
2022-02-17 22:41:44.126 +00:00 [ERR] Failed to sync: Unknown branch: main    at UniversalAutomation.Git.GitService.Push() in D:\a\universal\universal\src\Universal.Server\Services\GitService.cs:line 231
   at UniversalAutomation.GitSyncService.TrySync() in D:\a\universal\universal\src\Universal.Server\Services\GitSyncService.cs:line 158
   at UniversalAutomation.GitSyncService.Sync() in D:\a\universal\universal\src\Universal.Server\Services\GitSyncService.cs:line 71
2022-02-17 22:41:50.996 +00:00 [WRN] The cookie '.AspNetCore.OpenIdConnect.Nonce.CfDJ8Opgu2V4dK1BpyLvxt3uehZMB7lEq4rUA6pGkWUJHHw2uOA71zsZ2E6ndHvCgbjY2CdwSAEWJQK8ccnU57O8N7ZBcF4FikJDBJVFKTkb5KoO5Z_KMbs5hyDbDXWJh9uEuun6DeNTf_kqTNy4tIfKi45xEkGmTYjv1oBDwJ9sewcL1D0YEaoSZk2i408uovUp_JTc33adWGdEJa0uuBEyGAGsrxUnPLEKbtUTcQjVIY_XwR5KjTXKeBda8kRaqHtJjXjm5iNC_sYJZNpM3JOG9sc' has set 'SameSite=None' and must also set 'Secure'.
2022-02-17 22:41:51.024 +00:00 [WRN] The cookie '.AspNetCore.Correlation.LxoKDUAMjryryqtheNMEf9BO_B4wjlloJx77fa9lb2s' has set 'SameSite=None' and must also set 'Secure'.
2022-02-17 22:42:00.191 +00:00 [WRN] The cookie '.AspNetCore.OpenIdConnect.Nonce.CfDJ8Opgu2V4dK1BpyLvxt3uehbxvSrx_P6RO19pDp6H4T4lIkw1cUCtXPBfG_eLScptGuRZciY3z_F3iR_Td4mh3pbm6BAa0dvlDx9I2ln4WIAxLBN2vh7KUCKSNhVEISUG_jlIdDrWrFZBrFFh1w_qtgfH6jjdHJUnKvR9-Hfnh1Clh75U54sYXHPm6zHNqLfP8OvNKeJVQOplb5-afHFnHS92i7SjOD6lww1KxtjGmePPmk3m6k5AyTSjGznIZxgXG7fAKEZFqEa_kwZKsFoacyg' has set 'SameSite=None' and must also set 'Secure'.
2022-02-17 22:42:00.201 +00:00 [WRN] The cookie '.AspNetCore.Correlation.7RtV7fyroHCInyJnTAYsubMYGuYboaQhCCznxLWibME' has set 'SameSite=None' and must also set 'Secure'.
2022-02-17 22:42:00.955 +00:00 [ERR] Failed to sync: There is no tracking information for the current branch.    at LibGit2Sharp.Commands.Pull(Repository repository, Signature merger, PullOptions options)
   at UniversalAutomation.Git.GitService.Pull() in D:\a\universal\universal\src\Universal.Server\Services\GitService.cs:line 265
   at UniversalAutomation.GitSyncService.TrySync() in D:\a\universal\universal\src\Universal.Server\Services\GitSyncService.cs:line 132
   at UniversalAutomation.GitSyncService.Sync() in D:\a\universal\universal\src\Universal.Server\Services\GitSyncService.cs:line 71
2022-02-17 22:42:18.538 +00:00 [WRN] The cookie '.AspNetCore.OpenIdConnect.Nonce.CfDJ8Opgu2V4dK1BpyLvxt3uehbjI9QxO2MOrSHy2YZlpf4HVR5oMnqacmdoMLyDCIREWlhZDChcny2e4fRt_8r9H89KxISoDvYT3xnkebYWDpXfBYuYTrc2UCwE1LiANtg129D8c6yYjmjlivAIe_fxB-dyZaKtHbdcl14KFqMacSUoXG9xFWvNWVm8oo7oxEz4G3rK6MZZPrloa3xMv_9FWAN6MLDVrapTdVZR_Y3VF4ZmPaR8reI6JfQL-HcZZmI6eIKY3LIvckTw_c0K3K-y9bU' has set 'SameSite=None' and must also set 'Secure'.
2022-02-17 22:42:18.548 +00:00 [WRN] The cookie '.AspNetCore.Correlation.eZyWX0Ngt_37G_tSPZ6Zkx_88c_4i2WY9c7TVtVFuBc' has set 'SameSite=None' and must also set 'Secure'.
2022-02-17 22:43:00.839 +00:00 [ERR] Failed to sync: There is no tracking information for the current branch.    at LibGit2Sharp.Commands.Pull(Repository repository, Signature merger, PullOptions options)
   at UniversalAutomation.Git.GitService.Pull() in D:\a\universal\universal\src\Universal.Server\Services\GitService.cs:line 265
   at UniversalAutomation.GitSyncService.TrySync() in D:\a\universal\universal\src\Universal.Server\Services\GitSyncService.cs:line 132
   at UniversalAutomation.GitSyncService.Sync() in D:\a\universal\universal\src\Universal.Server\Services\GitSyncService.cs:line 71

mabster · February 17, 2022, 11:47pm

It looks to me like you’re doing everything the same as me. Obviously I’m in an Azure app service, and I’ve set my Git configuration as environment variables:

I know they’re working because my Git page shows the right values (as in my screenshot above).

But yeah … for some reason when it initializes the repository and creates the .Git folder, it does so using the master branch. I’m baffled.

adam · February 17, 2022, 11:58pm

That is baffling. I’ll continue to play around with this to see if I can reproduce it and see if I can get any additional logging\diagnostics into the product that might help us determine what’s happening here.

mabster · February 23, 2022, 9:42pm

@adam should I be installing a nightly build to try to capture some extra diagnostic info for you on this one? I really want to use PSU for production but I can’t until we’ve gotten it properly version controlled, so I’m very keen to do whatever I can to help you solve this.

adam · February 23, 2022, 11:28pm

Tonight’s nightly build will include a lot more logging for all the git services. You will need to enable the debug level and you should see a bunch of information written during the initialization and execution of this particular feature.

We also identified an issue where git sync jobs could cause an exhaustion of job runners because of a deadlock that is also resolved in this build. I’m not sure if that has anything to do with the problem you are seeing.

Topic		Replies	Views
Problems with changing Git repo PowerShell Universal	4	298	July 14, 2022
GitHub Integration Ignored PowerShell Universal	5	178	June 19, 2023
GitHub Sync With Proxy PowerShell Universal	1	196	September 27, 2022
Git Sync Manual mode in Appsetting-json? PowerShell Universal	0	175	November 1, 2022
GIT Sync setup not working PowerShell Universal	0	184	May 23, 2023

How to format Git settings in appsettings.json

Related topics