Releases: bencherdev/bencher
Releases · bencherdev/bencher
v0.4.7
- Redirect to public Perf Page for Bencher Console links if user is not logged in
- Fix jittering in Perf Plot tabs when loading and changing pages
- Fix PR comment tags when changing branch start points
- Move benchmark results under a
details
tag for HTML comment output - Add an Alert summary table for HTML comment output
- Add a warning if no Thresholds are found for HTML comment output
- Deprecated:
--ci-no-metrics
flag no longer effects HTML comment output
v0.4.7-rc1
- Redirect to public Perf Page for Bencher Console links if user is not logged in
- Fix jittering in Perf Plot tabs when loading and changing pages
v0.4.6
- Add perf plot images as OpenGraph images
- Add GET
/v0/users
endpoint for server admins - Improve perf plot query performance by 120x or more by adding indexes and a materialized view
v0.4.5
- Move Bencher Cloud out of BETA
- Add tab loading progress bar to perf pages
- Add
--branch-start-point
and--branch-start-point-hash
options tobencher run
to track rebasing and other branch changes - Deprecated: The
bencher run
options and flags--if-branch
,--else-if-branch
,--else-branch
, and--endif-branch
have been deprecated in favor of using--branch
and--branch-start-point
- BREAKING CHANGE
--if-branch
will now hard fail instead of skipping the run if not specified or if an empty string is provided, and it will always be created even without--else-branch
set - BREAKING CHANGE
--else-if-branch
will only use the first branch specified as the start point and it must exist, if it is a non-empty string - Update branch date time plot to use local time and version plot to be discrete along the x-axis
v0.4.4
- Fix resource contention during large Perf queries
- Remove
public
query param from/v0/projects
endpoint - BREAKING CHANGE Move all CLI commands using
--org
,--project
, and--user
over to positional arguments, exceptbencher run
andbencher threshold create
- Add a
bencher report create
CLI subcommand bencher run
now tries to auto-fill the git commit hash for the report- BREAKING CHANGE Rename
statistic
tomodel
and remove API endpoint - Add "Click to view Threshold" for all boundary limits and add a public view Threshold page
- Add PATCH endpoint for user account settings
- BREAKING CHANGE Remove
/v0/server/ping
endpoint - Deprecate
/v0/server/endpoint
in favor of/v0/server/config/console
and BREAKING CHANGE removebencher server endpoint
CLI command
v0.4.3
- BREAKING CHANGE Limit branch names to 256 characters and all slug lengths to 64 characters. Any existing values greater than these new limits are set to their respective UUID.
- Add shortcut URLs for user pages:
/console/users/tokens
->/console/users/USER-SLUG/tokens
/console/users/tokens/add
->/console/users/USER-SLUG/tokens/add
/console/users/settings
->/console/users/USER-SLUG/settings
- Improve
bencher run
error messages to include the command being run (idea credit to dholroyd: #335) - Prevent pwn requests when using
bencher run
- Add an API version check to all Bencher CLI commands that use the backend
v0.4.2
- Fix Perf Plot view reduce bug
- Add a
View
button to Perf Plot for Reports, Branches, Testbeds, and Benchmarks - Add
search
query param toGET
list endpoints for all named resources - Add search for a named resources in Console UI and Perf Plot dimensions
- Add date based search for Reports in Console UI and Perf Plot
- Add search for public projects
- Move Bencher API server to "distroless" Docker image,
bencher-api
that is 10x smaller - Move Bencher Console UI to "distroless" Docker image,
bencher-console
that is 1/3 smaller - Fix Console server side rendering bug when using local URLs inside of Docker
- First time contributor JonasWanke added the Iai-Callgrind benchmark harness adapter
v0.4.1
- Add a "Show all"/"Hide all" toggle for perf plot results (idea credit to jerome-benoit)
- Add an
--exec
flag tobencher run
to run commands as executables (no shell) and by default when there is more than one argument - Add new Thresholds: Static, Percentage, Log Normal, Interquartile Range, and Delta Interquartile Range
- Include Iteration number for Report results
- Redirect to newly created resources in Console UI
v0.4.0
- BREAKING CHANGES Remove backwards compatibility for renames:
Metric
(lower_bound
=>lower_value
andupper_bound
=>upper_value
)Measure
(metric_kind
=>measure
inReport
andThreshold
;metric_kinds
=>measures
inPerf
)Boundary
(average
=>baseline
)
- Add
bencher up
,bencher down
, andbencher logs
commands to CLI to easily run Bencher Self-Hosted - Branches and Testbeds are now created if they do not exit for
bencher run
if the value passed is a slug or name (UUIDs are still required to already exist)
v0.3.26
- Add OAuth2 based login for GitHub
- Allow users to accept invitations while logged in
- Run smoke tests on Linux, MacOS, and Windows
- Release Linux, MacOS, and Windows CLI builds for both x86_64 and ARM64
- Add convenience script to install
bencher
CLI on Linux, MacOS, and Windows