Skip to content

[Infra] Add tokens alternation - #95

Closed
JanKrivanek wants to merge 1 commit into
dotnet:mainfrom
JanKrivanek:dev/jankrivanek/alternate-tokens
Closed

[Infra] Add tokens alternation#95
JanKrivanek wants to merge 1 commit into
dotnet:mainfrom
JanKrivanek:dev/jankrivanek/alternate-tokens

Conversation

@JanKrivanek

Copy link
Copy Markdown
Member

Motivation

Prevents overrunning quota of a single token
Temporary measure prior org level accounting support added to copilot

Copilot AI review requested due to automatic review settings February 23, 2026 17:45
@JanKrivanek JanKrivanek changed the title Add tokens alternation [Infra] Add tokens alternation Feb 23, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This pull request implements token alternation for Copilot API calls to prevent quota overruns on a single token. The implementation adds a random token selection mechanism that distributes load across up to 8 different COPILOT_GITHUB_TOKEN secrets before running the skill-validator in the evaluation workflow.

Changes:

  • Added a new workflow step to randomly select from configured Copilot tokens
  • Updated the skill-validator step to use the dynamically selected token instead of hardcoded COPILOT_GITHUB_TOKEN_2
Comments suppressed due to low confidence (2)

.github/workflows/evaluation.yml:213

  • The error message refers to multiple "COPILOT_GITHUB_TOKEN secrets" but the logic only checks if at least one token is configured. If the intention is to communicate that at least one token must be configured, consider updating the message to "No COPILOT_GITHUB_TOKEN secret is configured" (singular) for clarity.
            echo "::error::No COPILOT_GITHUB_TOKEN secrets are configured"

.github/workflows/evaluation.yml:219

  • The log output reveals how many tokens are configured (e.g., "1 of 8 available tokens"). If token count is considered sensitive information, consider removing this from the output or making it less specific (e.g., just "Token selected successfully").
          echo "Selected ${NAMES[$IDX]} (1 of ${#TOKENS[@]} available tokens)"

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread .github/workflows/evaluation.yml
@JanKrivanek

Copy link
Copy Markdown
Member Author

Superseded by #96

moesac0970 pushed a commit to moesac0970/skills that referenced this pull request Jul 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants