[v18] feat: Bot instances at scale UI (RFD0222) by nicholasmarais1158 · Pull Request #60761 · gravitational/teleport

nicholasmarais1158 · 2025-10-29T17:13:16Z

Summary

Backport bot instance UI changes to v18.

Related to:

MWI: Instances at Scale > [Phase 1] New instance UI, and version filters #57994
MWI: Instances at Scale > [Phase 2] Upgrade dashboard and service-level health #55926

Changelog: Added advanced search and sorting to the bot instances list in the web UI
Changelog: Added filter and sort flags to tctl bots instances ls
Changelog: Added service health to the output tctl bots instances ls and tctl bot instance show commands
Changelog: Added a dashboard to visualize bot instances by their version compatibility
Changelog: Added bot instance service health to web UI

Changes

Manual testing

Start with a clean cluster
Bot instances page (Web UI) shows an empty state

Ran tctl bots add "sum-defleo" to create a bot (the name is significant later)
Bot details shows an empty state

Insert test data into backend directly: bot_instances.sql

$ sqlite3 data/backend/sqlite.db

sqlite> .read bot_instances.sql

Bot instances page shows instances list and dashboard metrics
Restart cluster to pick up test data from backend. Refresh web UI after a minute to let metrics report generate.

Clicking a version compatibility category populates the advanced filter and filters the instances list

Enter spec.bot_name == "sum-defleo" as an advanced search and sort by version ascending

Enter 'gitlab' as a basic search

Selecting an instance item shows overview details

Service tab shows services alphabetically

YAML tab shows full resource YAML

Run tctl bots instances ls --query 'spec.bot_name == "sum-defleo"' --sort-index version_latest --sort-order descending to list instances with a query filter and sort

Run tctl bots instances show sum-defleo/b27dc019-b6ee-4d77-9814-41ba652a5c04 to show an instance with health status

github-actions · 2025-10-29T19:03:25Z

Amplify deployment status

Branch	Commit	Job ID	Status	Preview	Updated (UTC)
nicholasmarais1158/backport-bot-instances-at-scale/v18	`92c02b7`	3	✅SUCCEED	nicholasmarais1158-backport-bot-instances-at-scale-v18	2025-11-04 10:54:16

* docs(rfd): Bot Instance at Scale (RFD0222) * Add Notion link * First draft for review * fix: Spell check * Fix protobuf code block * Make the document structure slightly clearer * Add a section on data aggregation * Add missing end of code block * Add a bit more context on bots and instances * Add plan for `tctl` * Add an explanation for each UX example * Rename semver functions * Remove activity visualisation and required complexity * cspell * Pre-populate isn't the correct term * Minor tweak * Test plan additions * Remove reference to activity visualization * Clarify use of pagination in `tctl bots instances ls` and remove filter summary * Refine predicate language functions * Restructure protos * Refine plans for resource storage and quantities * Add webapi support for config, health and notices * Expand backwards compatibility * cspell * State `tbot` config size limit * Reduce config max size to 32Kb * Add failsafe env var * Reduce max notices to 10 * Explain updating related record expiry in-line with the instance * Revert extracting service health records * Move notices to earlier in the delivery plan * Remove notices & config and expand the why and what * Expand aggregate data and metrics, and rearrange sections * Fix `version.between` snippet * Updated approach to calculating bot instance counts * Document `newer_than` predicate language function --------- Co-authored-by: Dan Upton <daniel.upton@goteleport.com>

* Add version and hostname indexes to cache * Add `ListBotInstancesV2` rpc and use request options * Add v2 bot instance list endpoint * Use v2 endpoint in web UI * Pass signal through to support aborting requests * Fix comment typo * Rename util func * Deprecate `ListBotInstances` rpc * Encode hostname in cache key * Address pre-release sorting in version numbers * Rename bot instance cache utils * Fix lint deprecation warnings * Extract filter fields to message * Replace `fmt.Sprintf("%06d", ...)` * Update invalid sort field error * Fallback to v1 endpoint if possible * Use `strcase` for case-insensitive compare * Backend results are filtered by bot name so no need to re-filter in `MatchBotInstance` * Revert "Replace `fmt.Sprintf("%06d", ...)`" This reverts commit 2fbd797.

* Add version and hostname indexes to cache * Add `ListBotInstancesV2` rpc and use request options * Add v2 bot instance list endpoint * Use v2 endpoint in web UI * Pass signal through to support aborting requests * Fix comment typo * Rename util func * Add expression parser * Contribute `to_string` function to default parser * Add API support for `query` filter * Fix `SearchPanel` submit with advanced toggle * Add advanced search to web UI * Deprecate `ListBotInstances` rpc * Encode hostname in cache key * Address pre-release sorting in version numbers * Rename bot instance cache utils * Fix lint deprecation warnings * Extract filter fields to message * Replace `fmt.Sprintf("%06d", ...)` * Update invalid sort field error * Fallback to v1 endpoint if possible * Use `strcase` for case-insensitive compare * Backend results are filtered by bot name so no need to re-filter in `MatchBotInstance` * Use `t.Context()` * Remove expression methods * Remove unnecessary fallback comments * Return early if only bot name filter is required (backend only) * Fix lint * replace `to_string` with `equals` (version type only) * Fix comment * Remove unnecessary `to_string` tests * Switch to a true equals function # Conflicts: # lib/cache/bot_instance.go # web/packages/teleport/src/BotInstances/List/BotInstancesList.tsx # Conflicts: # web/packages/teleport/src/BotInstances/List/BotInstancesList.tsx

* Make `disableSearch` props optional for SearchPanel component * Add a shared mock for TextEditor * Make instance items selectable and include bot name * Remove old bot instance details page * Add new bot instances UI * Add stories * Add and amend tests * Switch to arrow function * Remove `null` from item selected callback * Fix info guide wording # Conflicts: # web/packages/teleport/src/BotInstances/Details/BotInstanceDetails.test.tsx # web/packages/teleport/src/BotInstances/Details/BotInstanceDetails.tsx # web/packages/teleport/src/BotInstances/List/BotInstancesList.tsx

* Alternate sort menu icons * Titles and close button * Yaml background colour * Spacing * Keyboard selectable list items * Fix selected list item padding * Default scroll bars for list * Clarify delete bot messaging * Simplify `onClick` * Use `FlexProps` type * Revert "Alternate sort menu icons" This reverts commit 4212dcd.

* Fix missing `--format` flag * Use v2 rpc * Add `--search` flag * Add `--query` flag * Add `--sort-index` and `--sort-order` flags * Remove `generation` and add `version` fields to output * Allow enabling the auth cache for the test process * Add list bot instances tests * Sync join method access logic between tctl and web * Access `authentication.JoinMethod` safely * Unhide `--format` flag * Simplify version header label * Fallback to v1 ListBotInstances * Refactor to remove use of `authclient.ClientI` * A way better fallback implementation 🙌 * typo 🙄 * Refactor to single interface # Conflicts: # tool/tctl/common/bots_command.go

…eference (#60508) * docs: Add filter, sort and format fields to `tctl bots instances ls` reference * Using consistent capitalization Co-authored-by: Paul Gottschling <paul.gottschling@goteleport.com> --------- Co-authored-by: Paul Gottschling <paul.gottschling@goteleport.com>

* Add `service_health` to bot instance protos * Add aggregated service health to `show` * Add services section to `show` * Add health status column to `ls` * Extra tabs are not welcome * Handle zero services when aggregating health status # Conflicts: # tool/tctl/common/bots_command.go

* Add `autoupdate_bot_instance_report` to the editor role preset * Add `/webapi/.../machine-id/bot-instance/metrics` endpoint * Add missing error check in test * Better error message when metrics aren't ready * Allow users with `bot_instance:list` to read the `autoupdate_bot_instance_report` * Move update timestamp onto upgrade statuses object * Fix predicate language function names * Remove erroneous comment * Fix tests * Add `refresh_after_seconds` to metrics response * Return an empty `upgrade_statuses` if there is no report * Replace `exact_version` helper with simple `==` operator * Use `trace.Aggregate` to return both auth errors

* Add plumbing for new metrics endpoint * Align version compatibility logic * Fix mocked responses in stories * Add new dashboard component * Wire-in dashboard component * Fix lint * Explain dynamic `refetchInterval` * docs: `onFilterSelected` * Use typography components from design package * Fix `onFilterSelected` naming inconsistencies * A better nbsp * Remove "control plane" terminology * Refactor `GetBotInstanceMetricsResponse` type * Handle out-of-date proxy * Make instance list messaging filter aware * Update chart title to "version compatibility" * Keep "Last updated x minutes ago" label current * Oops, forgot to update the test * Remove unused `TitleText` * Change dashboard title to "insights" * Version compatibility design changes * Fix tests after copy change, oops

* Add tabs to instance details * Add `kind` to bot instance heartbeat proto * Extend `GetBotInstanceResponse` type * Add `InfoTab` component for Overview tab * Add `HealthTab` component for Services tab * Wire-up tabs content * Use `join_attrs.meta` for join token fields * Fix links style * Fix handling of unspecified health status * Fix tab spacing * Remove tab tooltips * Replace service item background * Add zero services story * Support tctl instance kind * Fix styled links * Fix test * Fix bot instances story

public-teleport-github-review-bot · 2025-10-30T09:41:03Z

@nicholasmarais1158 - this PR will require admin approval to merge due to its size. Consider breaking it up into a series smaller changes.

nicholasmarais1158 · 2025-10-31T17:41:17Z

~~Holding for one fix and one feature addition.~~ Both are now included.

…158/backport-bot-instances-at-scale/v18

* Make instance items selectable from bot details * Add test * Fix mocked calls in stories

nicholasmarais1158 self-assigned this Oct 29, 2025

nicholasmarais1158 added the machine-id label Oct 29, 2025

nicholasmarais1158 temporarily deployed to docs-amplify October 29, 2025 17:13 — with GitHub Actions Inactive

nicholasmarais1158 and others added 12 commits October 30, 2025 08:31

fix: Rename bot instance version expression functions (#59819)

c402dbc

nicholasmarais1158 force-pushed the nicholasmarais1158/backport-bot-instances-at-scale/v18 branch from e714cdb to e5b4619 Compare October 30, 2025 08:32

nicholasmarais1158 temporarily deployed to docs-amplify October 30, 2025 08:32 — with GitHub Actions Inactive

nicholasmarais1158 marked this pull request as ready for review October 30, 2025 09:40

strideynet changed the title ~~feat: Bot instances at scale UI (RFD0222)~~ [v18] feat: Bot instances at scale UI (RFD0222) Oct 30, 2025

github-actions bot added backport documentation rfd Request for Discussion size/xl tctl tctl - Teleport admin tool ui labels Oct 30, 2025

This was referenced Oct 30, 2025

[v18] feat: List bot instances version and hostname sort #60522

Closed

[v18] feat: Bot instances advanced filter #60558

Closed

[v18] feat(webui): New bot instances experience #60562

Closed

nicholasmarais1158 requested review from avatus, boxofrad, espadolini, ravicious, rosstimothy, strideynet and zmb3 October 30, 2025 10:18

espadolini approved these changes Oct 30, 2025

View reviewed changes

avatus approved these changes Oct 30, 2025

View reviewed changes

strideynet approved these changes Oct 31, 2025

View reviewed changes

zmb3 approved these changes Oct 31, 2025

View reviewed changes

public-teleport-github-review-bot bot removed request for boxofrad, ravicious and rosstimothy October 31, 2025 16:18

nicholasmarais1158 added the hold-for-18.4 label Nov 4, 2025

nicholasmarais1158 added 3 commits November 4, 2025 10:51

Merge remote-tracking branch 'origin/branch/v18' into nicholasmarais1…

03fea0c

…158/backport-bot-instances-at-scale/v18

feat: Allow instances to be selectable from bot details (#60717)

1884bd3

* Make instance items selectable from bot details * Add test * Fix mocked calls in stories

fix: Bot instance health status dot inconsistency (#60786)

92c02b7

nicholasmarais1158 temporarily deployed to docs-amplify November 4, 2025 10:52 — with GitHub Actions Inactive

nicholasmarais1158 added this pull request to the merge queue Nov 13, 2025

Merged via the queue into branch/v18 with commit 7c9bfd9 Nov 13, 2025
45 checks passed

nicholasmarais1158 deleted the nicholasmarais1158/backport-bot-instances-at-scale/v18 branch November 13, 2025 15:49

aadc-dev mentioned this pull request Nov 13, 2025

Release 18.4.0 #61355

Merged

BrewTestBot mentioned this pull request Nov 14, 2025

teleport 18.4.0 Homebrew/homebrew-core#254389

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[v18] feat: Bot instances at scale UI (RFD0222)#60761

[v18] feat: Bot instances at scale UI (RFD0222)#60761
nicholasmarais1158 merged 15 commits intobranch/v18from
nicholasmarais1158/backport-bot-instances-at-scale/v18

nicholasmarais1158 commented Oct 29, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Oct 29, 2025 •

edited

Loading

Uh oh!

public-teleport-github-review-bot bot commented Oct 30, 2025

Uh oh!

nicholasmarais1158 commented Oct 31, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

nicholasmarais1158 commented Oct 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Changes

Manual testing

Uh oh!

github-actions bot commented Oct 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

public-teleport-github-review-bot bot commented Oct 30, 2025

Uh oh!

nicholasmarais1158 commented Oct 31, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

nicholasmarais1158 commented Oct 29, 2025 •

edited

Loading

github-actions bot commented Oct 29, 2025 •

edited

Loading

nicholasmarais1158 commented Oct 31, 2025 •

edited

Loading