How to get VCPKG working as system user (Jenkins buildserver)

[MatthijsPrent]

Hi!

We are trying to get VCPKG working on a project that also runs on the Jenkinst Buildserver. At the moment the .sln works good using Visual studio 2022 with VCPKG on the individual PC's. However on the buildserver it fails. One main difference is that the Jenkins slave is started by the system user and not by an individual user. At the moment the following command is used:

"C:\vcpkg\vcpkg-master\vcpkg.exe" install --x-wait-for-lock --triplet "x86-windows" --vcpkg-root "C:\vcpkg\vcpkg-master\\" "--x-manifest-root=W:\projectname\branches_feature_projectbranche\Driver\Driver\projectspecific\\" "--x-install-root=W:\projectname\branches_feature_projectbranche\Driver\Driver\projectspecific\vcpkg_installed\x86-windows\\"

When I run this command from a normal terminal, it succeeds. However when I run it as the user authority\system, it will fail with (at the moment) the following error:

Compiler found: C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools_Stable/VC/Tools/MSVC/14.42.34433/bin/Hostx64/x64/cl.exe
  Detecting compiler hash for triplet x86-windows...
  Compiler found: C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools_Stable/VC/Tools/MSVC/14.42.34433/bin/Hostx64/x86/cl.exe
  The following packages will be built and installed:
    * abseil:[email protected] -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\9af16c8547b0a3d6c5886384b9b18934353c9d6d
    * abseil:[email protected] -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\9af16c8547b0a3d6c5886384b9b18934353c9d6d
    * c-ares:[email protected] -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\9d722fc1278ff74fed3795592feffd8c08a46ffe
    * c-ares:[email protected] -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\9d722fc1278ff74fed3795592feffd8c08a46ffe
    * grpc[codegen,core]:[email protected]#3 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\a78d7b20a22ebe842a2e78624254d1462ca49415
      grpc:[email protected]#3 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\a78d7b20a22ebe842a2e78624254d1462ca49415
    * openssl:[email protected]#1 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\7407c8c4bb89f961d5e57afb101329454b4771ab
    * openssl:[email protected]#1 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\7407c8c4bb89f961d5e57afb101329454b4771ab
    * protobuf:[email protected]#3 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\528c56d9b29635d840b284f3e2109a370556bd89
    * protobuf:[email protected]#3 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\528c56d9b29635d840b284f3e2109a370556bd89
    * re2:x86-windows@2024-04-01#2 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\c0f4eacf4c6b1c048bb3fc11fd0abf9e4981aa64
    * re2:x64-windows@2024-04-01#2 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\c0f4eacf4c6b1c048bb3fc11fd0abf9e4981aa64
    * upb[codegen,core]:x64-windows@2022-06-21#1 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\1d7a6a503d8e111f919697470e47030cba1172b3
    * upb:x86-windows@2022-06-21#1 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\1d7a6a503d8e111f919697470e47030cba1172b3
    * vcpkg-cmake:x64-windows@2024-04-18 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\a10a94e8d0071ed4804d40d0f0f0c5e4e7180afd
    * vcpkg-cmake-config:x64-windows@2024-05-23 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\97a63e4bc1a17422ffe4eff71da53b4b561a7841
    * vcpkg-cmake-get-vars:x64-windows@2023-12-31 -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\725c841810ceb8de33da68ea879eb8f0b4d6c94c
    * zlib:[email protected] -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\3f05e04b9aededb96786a911a16193cdb711f0c9
    * zlib:[email protected] -- C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\3f05e04b9aededb96786a911a16193cdb711f0c9
  Additional packages (*) will be modified to complete this operation.
  Restored 0 package(s) from C:\Windows\system32\config\systemprofile\AppData\Local\vcpkg\archives in 1.27 ms. Use --debug to see more details.
  Installing 1/19 vcpkg-cmake:x64-windows@2024-04-18...
  Building vcpkg-cmake:x64-windows@2024-04-18...
  C:\Windows\System32\config\systemprofile\AppData\Local\vcpkg\registries\git-trees\a10a94e8d0071ed4804d40d0f0f0c5e4e7180afd: info: installing overlay port from here
  CMake Error at scripts/ports.cmake:143 (message):
    Cannot find port: vcpkg-cmake
  
      Directory does not exist: C:/Windows/System32/config/systemprofile/AppData/Local/vcpkg/registries/git-trees/a10a94e8d0071ed4804d40d0f0f0c5e4e7180afd

EXEC : error : building vcpkg-cmake:x64-windows failed with: BUILD_FAILED [W:\projectname\branches_feature_projectbranche\Driver\Driver\project\project.vcxproj]
  See https://learn.microsoft.com/vcpkg/troubleshoot/build-failures?WT.mc_id=vcpkg_inproduct_cli for more information.
  Elapsed time to handle vcpkg-cmake:x64-windows: 269 ms
  Please ensure you're using the latest port files with `git pull` and `vcpkg update`.
  Then check for known issues at:
    https://github.com/microsoft/vcpkg/issues?q=is%3Aissue+is%3Aopen+in%3Atitle+vcpkg-cmake
  You can submit a new issue at:
    https://github.com/microsoft/vcpkg/issues/new?title=[vcpkg-cmake]+Build+error+on+x64-windows&body=Copy+issue+body+from+W%3A%2FDPin%2Fbranches_feature_DPIN-981%2FDriver%2FDriver%2FseDPin%2Fvcpkg_installed%2Fx86-windows%2Fvcpkg%2Fissue_body.md

I checked, it and the directory DOES exist. I am not sure what the right way is to fix this problem. I installed VCPGK by downloading the master from github, extracting this to C:\vcpkg and then running vcpkg integrate install.

[Neumann-A]

You need to set env variable X_VCPKG_REGISTRIES_CACHE to a directory you have normal access to.

[MatthijsPrent]

I tried to add this environmental variable as a system variable in Windows:

And after that I tried to build the project with msbuild as a normal user. I would expect this would put any files into the set folder, but the folder remained empty, which gives me the suggestion that the env variable is ignored?

After this I tried to open a Visual studio 2022 developer prompt and do first:
vcpkg integrate remove
vcpkg integrate install
in the hope that this would change the used folder but this did not have any effect.

What should I do to make sure the env variable is correctly used?

Edit:
I found the following Issue, which seems to have a very similar issue #38329
I also set:
VCPKG_DOWNLOADS, X_VCPKG_ASSET_SOURCES , VCPKG_DEFAULT_BINARY_CACHE but this resulted in a crash. again removing the X_VCPKG_ASSET_SOURCES resolved this error. I will now continue testing with this configuration and report back.

[Neumann-A]

What should I do to make sure the env variable is correctly used?

use --debug to see what vcpkg does in the background

[MatthijsPrent]

See the result when I set all four environmental variables:

Where the variable is set to the following value:

[Neumann-A]

see https://learn.microsoft.com/en-us/vcpkg/consume/asset-caching?pivots=shell-powershell how to setup an asset cache correctly