-
Notifications
You must be signed in to change notification settings - Fork 13
chore(internal): add support for bench testing #243
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,214 @@ | ||
| --- | ||
| name: authoring-benchmarks | ||
| description: Design, implement, run, debug, and interpret browser performance benchmarks for Elements components and utilities. Use whenever the user asks to benchmark or performance-test runtime code, create or update a .test.bench.ts file, compare benchmark results, investigate a browser performance regression, understand Vitest bench metrics such as throughput, mean, p99, RME, or samples, or add a test:bench task. Do not use this workflow for whole-CI profiling; use the audit-ci skill instead. | ||
| --- | ||
|
|
||
| # Authoring Benchmarks | ||
|
|
||
| Create browser benchmarks that answer a specific performance question. Browser behavior is the product behavior, so Chromium is the default runtime for component and utility benchmarks. | ||
|
|
||
| ## Required Context | ||
|
|
||
| Before changing benchmarks: | ||
|
|
||
| 1. Read [the testing overview](/projects/site/src/docs/internal/guidelines/testing.md). | ||
| 2. Read the Bench section of [the Vite internals documentation](/projects/internals/vite/README.md). | ||
| 3. Read the target project's `DEVELOPMENT.md`. | ||
| 4. Inspect the implementation, its unit tests, and the closest existing benchmark. | ||
|
|
||
| Use the `guidance-build` skill as well when adding or changing Wireit tasks. Use the `audit-ci` skill instead when measuring `pnpm run ci`, build orchestration, or the CI completion path. | ||
|
|
||
| ## Choose the Correct Performance Test | ||
|
|
||
| | Question | Tool | | ||
| | ----------------------------------------------------------------------------------------------------- | --------------------------------------------- | | ||
| | How fast is a repeatable function, DOM traversal, state synchronization, filter, or component update? | Browser benchmark (`*.test.bench.ts`) | | ||
| | How does a page load, score in Lighthouse, or consume network resources? | Lighthouse test (`*.test.lighthouse.ts`) | | ||
| | Did a visual rendering result change? | Visual test (`*.test.visual.ts`) | | ||
| | Which build or test task controls CI wall-clock time? | `audit-ci` workflow | | ||
| | Is behavior correct? | Unit, accessibility, SSR, or integration test | | ||
|
|
||
| Do not use an SSR benchmark as a substitute for browser lifecycle performance. SSR serialization and browser DOM work are different workloads. | ||
|
|
||
| ## Benchmark Convention | ||
|
|
||
| - Name every benchmark file `*.test.bench.ts`. | ||
| - Run every benchmark through Chromium using `libraryBenchConfig`. | ||
| - Keep the benchmark beside the implementation it measures. | ||
| - Use one `vitest.bench.ts` configuration per project. | ||
| - Do not add `.test.bench.browser.ts`, a second browser configuration, or a Node-default benchmark convention. | ||
| - Use `describe(Component.metadata.tag, ...)` for component benchmarks and a descriptive subsystem name for utilities. | ||
| - Use action-and-scale labels such as `filters 1,000 options to one match`. | ||
|
|
||
| The shared configuration is `@internals/vite/configs/bench.js`. The Core reference configuration is [projects/core/vitest.bench.ts](/projects/core/vitest.bench.ts). | ||
|
|
||
| ## Design the Workload First | ||
|
|
||
| State the performance question before writing benchmark syntax. A useful benchmark has: | ||
|
|
||
| 1. **A product-relevant operation:** Filtering options, traversing a grid, synchronizing tree state, generating a path, or updating rendered icons. | ||
| 2. **A representative scale:** Prefer enough data to expose algorithmic and allocation costs. A leaf rendering benchmark without scalable work does not justify its maintenance cost. | ||
| 3. **A stable input:** Use fixed deterministic data. Avoid randomness, clocks, network requests, and machine-specific files. | ||
| 4. **Consistent iterations:** Every sample must perform the same class of work. Alternate values to force updates without allowing state to grow indefinitely. | ||
| 5. **An observable completion point:** Return computed values. For Lit updates, await `elementIsStable()` and any follow-up asynchronous update triggered by the component. | ||
| 6. **A narrow boundary:** Exclude fixture creation, selectors, and data generation unless those operations are explicitly under test. | ||
|
|
||
| Use at least two sizes when the scaling behavior is the question. If comparing a single operation with a batch, normalize the batch mean per item before drawing conclusions. | ||
|
|
||
| ## Browser Fixture Pattern | ||
|
|
||
| Vitest suite hooks are not the benchmark lifecycle. Use `BenchOptions.setup` and `teardown` so fixtures exist during warmup and sampled runs. | ||
|
|
||
| ```typescript | ||
| import { html } from 'lit'; | ||
| import type { BenchOptions } from 'vitest'; | ||
| import { bench, describe } from 'vitest'; | ||
| import { createFixture, elementIsStable, removeFixture } from '@internals/testing'; | ||
| import { Combobox } from '@nvidia-elements/core/combobox'; | ||
| import '@nvidia-elements/core/combobox/define.js'; | ||
|
|
||
| const optionTemplates = Array.from( | ||
| { length: 1_000 }, | ||
| (_, index) => html`<option value=${`${index % 2 ? 'odd' : 'even'}-${index}`}>Option ${index}</option>` | ||
| ); | ||
|
|
||
| describe(Combobox.metadata.tag, () => { | ||
| let element: Combobox; | ||
| let fixture: HTMLElement; | ||
| let input: HTMLInputElement; | ||
| let searchIndex = 0; | ||
|
|
||
| const options: BenchOptions = { | ||
| throws: true, | ||
| async setup() { | ||
| fixture = await createFixture(html` | ||
| <nve-combobox> | ||
| <label>Benchmark</label> | ||
| <input type="search" /> | ||
| <datalist>${optionTemplates}</datalist> | ||
| </nve-combobox> | ||
| `); | ||
| element = fixture.querySelector<Combobox>(Combobox.metadata.tag)!; | ||
| input = fixture.querySelector<HTMLInputElement>('input')!; | ||
| await elementIsStable(element); | ||
| }, | ||
| teardown() { | ||
| removeFixture(fixture); | ||
| } | ||
| }; | ||
|
|
||
| bench( | ||
| 'filters 1,000 options', | ||
| async () => { | ||
| input.value = searchIndex++ % 2 ? 'even' : 'odd'; | ||
| input.dispatchEvent(new InputEvent('input', { bubbles: true })); | ||
| await elementIsStable(element); | ||
| }, | ||
| options | ||
| ); | ||
| }); | ||
| ``` | ||
|
|
||
| Rules for every case: | ||
|
|
||
| - Set `throws: true`. Without it, a failing benchmark can report empty or `NaN` results instead of failing. | ||
| - Put fixture and data preparation in `setup` when they are outside the measured workload; setup time is not sampled. | ||
| - Perform synchronous cleanup in `teardown` with `removeFixture()`. | ||
| - Use real registered custom elements and the real DOM. Mock only unavailable browser capabilities. | ||
| - Force actual work. Reassigning the current value can turn the benchmark into a no-op. | ||
| - Await completion. Measuring only the property assignment misses rendering and asynchronous synchronization. | ||
| - Keep cold-load and steady-state questions separate. Warmup and browser caching make benchmarks suitable for steady-state work; use Lighthouse for first-load behavior. | ||
|
|
||
| For a pure utility, keep deterministic input outside the callback and return the result: | ||
|
|
||
| ```typescript | ||
| bench('transforms 10,000 values', () => transformValues(values), { throws: true }); | ||
| ``` | ||
|
|
||
| ## Avoid Invalid Measurements | ||
|
|
||
| Do not: | ||
|
|
||
| - Measure only Lit fixture overhead when the claimed target is component logic. | ||
| - Use `beforeAll`, `afterAll`, `beforeEach`, or `afterEach` to manage benchmark fixtures. | ||
| - Include assertions, console output, snapshots, or debug logging in the timed callback. | ||
| - Accumulate selected nodes, listeners, DOM children, or other state across samples. | ||
| - Compare `hz` directly between workloads that process different item counts. | ||
| - Treat one noisy local run as proof of a regression or optimization. | ||
| - Hide outliers by deleting samples or adding arbitrary delays. | ||
|
|
||
| If an operation is faster than the browser timer resolution, benchmark a fixed batch and normalize the result. A reported `min` of `0` is a timer-resolution warning, not zero-cost code. | ||
|
|
||
| ## Run Benchmarks | ||
|
|
||
| Run repository commands through mise. From the target project: | ||
|
|
||
| ```shell | ||
| mise exec -- pnpm run test:bench | ||
| ``` | ||
|
|
||
| For one benchmark file, first ensure the project build is current, then run: | ||
|
|
||
| ```shell | ||
| NODE_ENV=production mise exec -- pnpm exec vitest bench --run --config=vitest.bench.ts src/<feature>/<feature>.test.bench.ts | ||
| ``` | ||
|
|
||
| Do not run other browser-heavy tasks concurrently when collecting comparison data. For regression analysis, use the same machine, Chromium version, power state, command, inputs, and build mode. Collect at least three runs per revision and compare medians. | ||
|
|
||
| ## Interpret Results | ||
|
|
||
| | Metric | Meaning | | ||
| | ---------------------------- | ---------------------------------------------------------------- | | ||
| | `hz` | Completed benchmark operations per second; higher is faster | | ||
| | `mean` | Average milliseconds per operation; lower is faster | | ||
| | `p75`, `p99`, `p995`, `p999` | Tail latency percentiles | | ||
| | `min`, `max` | Observed latency range | | ||
| | `rme` | Relative margin of error; lower indicates a more stable estimate | | ||
| | `samples` | Number of timed observations | | ||
|
|
||
| Use `mean` or its inverse `hz` for central throughput, percentiles for tail behavior, and RME to judge confidence. Investigate high RME by checking machine contention, outliers, state accumulation, timer resolution, and inconsistent work. Rerun before changing implementation. | ||
|
|
||
| For a batch of `N` items: | ||
|
|
||
| ```text | ||
| per-item mean = batch mean / N | ||
| per-item throughput = N × batch hz | ||
| ``` | ||
|
|
||
| Report the command, browser/runtime context, workload size, median across runs, tail latency, RME, and any normalization. Describe observed changes as correlation unless one-variable experiments establish causality. | ||
|
|
||
| ## Add Benchmark Support to a Project | ||
|
|
||
| When a project has no benchmark task, follow the current Core setup rather than inventing another harness: | ||
|
|
||
| 1. Add `vitest.bench.ts` using `libraryBenchConfig` and a source alias. | ||
| 2. Add a Wireit-backed `test:bench` script with benchmark files and configuration as inputs and no outputs. | ||
| 3. Depend on the builds required by the benchmark imports. | ||
| 4. Exclude `*.test.bench.ts` from production build inputs and library TypeScript output. | ||
| 5. Confirm unit-test discovery and coverage exclude benchmark files. | ||
| 6. Document `pnpm run test:bench` in the project's `DEVELOPMENT.md`. | ||
|
|
||
| Benchmarking is opt-in unless the repository's CI policy explicitly adds it to a required workflow. Do not add unstable wall-clock thresholds without a baseline strategy and controlled runners. | ||
|
|
||
| ## Existing References | ||
|
|
||
| - [Icon browser updates](/projects/core/src/icon/icon.test.bench.ts) | ||
| - [Sparkline transforms](/projects/core/src/sparkline/sparkline.test.bench.ts) | ||
| - [Combobox filtering](/projects/core/src/combobox/combobox.test.bench.ts) | ||
| - [Grid navigation and traversal](/projects/core/src/grid/grid.test.bench.ts) | ||
| - [Tree synchronization](/projects/core/src/tree/tree.test.bench.ts) | ||
| - [Select synchronization](/projects/core/src/select/select.test.bench.ts) | ||
|
|
||
| ## Validation | ||
|
|
||
| After modifying benchmark code or configuration, run: | ||
|
|
||
| ```shell | ||
| cd projects/<project> | ||
| mise exec -- pnpm run lint | ||
| mise exec -- pnpm run test | ||
| mise exec -- pnpm run build | ||
| mise exec -- pnpm run test:bench | ||
| ``` | ||
|
|
||
| Also run Prettier, Vale for changed Markdown, and `git diff --check`. Confirm no benchmark source appears in production `dist/` output. |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -41,6 +41,7 @@ | |
| "build": "wireit", | ||
| "build:icons": "wireit", | ||
| "test": "wireit", | ||
| "test:bench": "wireit", | ||
| "test:types": "wireit", | ||
| "test:watch": "wireit", | ||
| "test:axe": "wireit", | ||
|
|
@@ -1058,6 +1059,7 @@ | |
| "public/**", | ||
| "src/**", | ||
| "!src/**/*.test.ts", | ||
| "!src/**/*.test.bench.ts", | ||
| "!src/**/*.test.lighthouse.ts", | ||
| "!src/**/*.test.visual.ts", | ||
| "!src/**/*.test.axe.ts", | ||
|
|
@@ -1132,6 +1134,25 @@ | |
| "NODE_ENV": "production" | ||
| } | ||
| }, | ||
| "test:bench": { | ||
| "command": "vitest bench --run --config=vitest.bench.ts", | ||
| "files": [ | ||
| "dist/**/*.js", | ||
| "src/**/*.test.bench.ts", | ||
| "vitest.bench.ts" | ||
| ], | ||
| "output": [], | ||
| "dependencies": [ | ||
| "../internals/vite:ci", | ||
| { | ||
| "script": "build", | ||
| "cascade": false | ||
| } | ||
|
Comment on lines
+1144
to
+1150
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. 🩺 Stability & Availability | 🟠 Major | ⚡ Quick win 🔎 Supported by static analysis🏁 Script executed: #!/bin/bash
set -e
printf '%s\n' '--- repository conventions ---'
find /tmp/coderabbit-repo-knowledge/nvidia-elements-2f055c47 -type f -name '*.md' -maxdepth 3 -print
for f in /tmp/coderabbit-repo-knowledge/nvidia-elements-2f055c47/*/*.md; do
[ -f "$f" ] || continue
printf '\n--- %s ---\n' "$f"
head -80 "$f"
done
printf '%s\n' '--- changed file context ---'
cat -n projects/core/package.json | sed -n '1,55p;1040,1080p;1125,1170p'
printf '%s\n' '--- relevant workspace definitions and benchmark imports ---'
rg -n -C 8 '"name": "`@internals/testing`"|"\.\./internals/testing:build"|test:bench|`@internals/testing`' projects/core/package.json projects/internals -g 'package.json' -g '*.ts' -g '*.js'Repository: NVIDIA/elements Length of output: 50371 🏁 Script executed: #!/bin/bash
set -e
printf '%s\n' '--- testing package ---'
testing_pkg=$(find projects -path '*/internals/testing/package.json' -print -quit)
printf 'package=%s\n' "$testing_pkg"
cat -n "$testing_pkg"
printf '%s\n' '--- testing source and generated-path references ---'
rg -n -C 5 '"build"|"exports"|"main"|"module"|dist/|src/' "$(dirname "$testing_pkg")" -g 'package.json' -g 'wireit*' -g '*.ts' -g '*.js'
printf '%s\n' '--- benchmark imports ---'
rg -n -C 3 'from [\"'\"']`@internals/testing`|import[ (].*[\"'\"']`@internals/testing`|require\\([\"'\"']`@internals/testing`' projects/core/src -g '*.test.bench.ts'
printf '%s\n' '--- benchmark resolver config ---'
find projects/core -maxdepth 1 -type f \( -name 'vitest.bench.ts' -o -name 'vite.config.ts' \) -print -exec cat -n {} \;Repository: NVIDIA/elements Length of output: 8204 🏁 Script executed: #!/bin/bash
set -e
printf '%s\n' '--- benchmark files importing `@internals/testing` ---'
rg -l -F '`@internals/testing`' projects/core/src -g '*.test.bench.ts' | sort
for f in $(rg -l -F '`@internals/testing`' projects/core/src -g '*.test.bench.ts' | sort); do
printf '\n--- %s ---\n' "$f"
rg -n -C 2 -F '`@internals/testing`' "$f"
done
printf '%s\n' '--- benchmark configuration ---'
for f in projects/core/vitest.bench.ts projects/core/vite.config.ts; do
if [ -f "$f" ]; then
printf '\n--- %s ---\n' "$f"
cat -n "$f"
fi
done
printf '%s\n' '--- workspace links for the bound package ---'
rg -n -C 2 '"`@internals/testing`"|internals/testing' pnpm-workspace.yaml pnpm-lock.yaml projects/core/package.jsonRepository: NVIDIA/elements Length of output: 8608 🏁 Script executed: #!/bin/bash
set -e
printf '%s\n' '--- tracked testing build output ---'
git ls-files projects/internals/testing/dist
printf '%s\n' '--- current testing build output ---'
if [ -d projects/internals/testing/dist ]; then
find projects/internals/testing/dist -maxdepth 2 -type f -print | sort
else
printf '%s\n' '<directory absent>'
fi
printf '%s\n' '--- ignore rules affecting testing dist ---'
rg -n -C 2 '(^|/)dist(/|$)|internals/testing' .gitignore projects/internals/testing/.gitignore 2>/dev/null || trueRepository: NVIDIA/elements Length of output: 530 Add On a clean checkout, the benchmark imports 🤖 Prompt for AI AgentsSource: MCP tools |
||
| ], | ||
| "env": { | ||
| "NODE_ENV": "production" | ||
| } | ||
| }, | ||
| "test:types": { | ||
| "command": "tsc --project tsconfig.types.json", | ||
| "files": [ | ||
|
|
||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,61 @@ | ||
| // SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | ||
| // SPDX-License-Identifier: Apache-2.0 | ||
|
|
||
| import { html } from 'lit'; | ||
| import type { BenchOptions } from 'vitest'; | ||
| import { bench, describe } from 'vitest'; | ||
| import { createFixture, elementIsStable, removeFixture } from '@internals/testing'; | ||
| import { Combobox } from '@nvidia-elements/core/combobox'; | ||
| import '@nvidia-elements/core/combobox/define.js'; | ||
|
|
||
| const optionTemplates = Array.from({ length: 1_000 }, (_, index) => { | ||
| const label = index === 0 ? 'target-a' : index === 1 ? 'target-b' : `${index % 2 ? 'odd' : 'even'} item ${index}`; | ||
| return html`<option value=${label}>${label}</option>`; | ||
| }); | ||
|
|
||
| describe(Combobox.metadata.tag, () => { | ||
|
Collaborator
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Bench tests do not run in CI for now. Bench tests are more for local performance baselines when iterating. This will help agents make better informed improvements. We might be able to enable this as a nightly job/report in follow up. |
||
| let element: Combobox; | ||
| let fixture: HTMLElement; | ||
| let input: HTMLInputElement; | ||
| let paritySearchIndex = 0; | ||
| let targetSearchIndex = 0; | ||
|
|
||
| const options: BenchOptions = { | ||
| throws: true, | ||
| async setup() { | ||
| fixture = await createFixture(html` | ||
| <nve-combobox> | ||
| <label>Benchmark</label> | ||
| <input type="search" /> | ||
| <datalist>${optionTemplates}</datalist> | ||
| </nve-combobox> | ||
| `); | ||
| element = fixture.querySelector<Combobox>(Combobox.metadata.tag)!; | ||
| input = fixture.querySelector<HTMLInputElement>('input')!; | ||
| await elementIsStable(element); | ||
| }, | ||
| teardown() { | ||
| removeFixture(fixture); | ||
| } | ||
| }; | ||
|
|
||
| bench( | ||
| 'filters 1,000 options to 499 matches', | ||
| async () => { | ||
| input.value = paritySearchIndex++ % 2 ? 'even' : 'odd'; | ||
| input.dispatchEvent(new InputEvent('input', { bubbles: true })); | ||
| await elementIsStable(element); | ||
| }, | ||
| options | ||
| ); | ||
|
|
||
| bench( | ||
| 'filters 1,000 options to one match', | ||
| async () => { | ||
| input.value = targetSearchIndex++ % 2 ? 'target-a' : 'target-b'; | ||
| input.dispatchEvent(new InputEvent('input', { bubbles: true })); | ||
| await elementIsStable(element); | ||
| }, | ||
| options | ||
| ); | ||
| }); | ||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🗄️ Data Integrity & Integration | 🟡 Minor | ⚡ Quick win
🔎 Supported by static analysis
🏁 Script executed:
Repository: NVIDIA/elements
Length of output: 5371
🌐 Web query:
Wireit 0.14.12 README cascade false files fingerprint dependency inputs💡 Result:
In Wireit 0.14.12, setting
"cascade": falseon a dependency modifies how Wireit determines whether a script needs to be re-executed by changing its fingerprint calculation [1][2]. By default, the fingerprint of a script includes the fingerprints of all its dependencies [1][2]. This means a script will automatically re-run whenever one of its dependencies re-runs, regardless of whether the output produced by that dependency actually changed [2]. When you set"cascade": falseon a dependency: - The fingerprint of that dependency is excluded from the script's own fingerprint [1][2]. - The script will no longer automatically re-run just because the dependency re-ran [2]. - Wireit will still ensure the dependency is executed first if it is not up-to-date, but the parent script will only re-run if its own fingerprint—calculated from its command, environment, andfiles—changes [2]. Critical Requirement: Because"cascade": falsedecouples the execution of the parent script from the dependency's own execution cycle, it becomes your responsibility to ensure the parent script is still aware of changes to the dependency's output [2]. You must explicitly add the relevant output files or glob patterns produced by the dependency to the parent script'sfilesarray [2]. Failure to do so may result in the script failing to re-run when the dependency's output changes, leading to stale results [2].Citations:
🏁 Script executed:
Repository: NVIDIA/elements
Length of output: 6122
🌐 Web query:
site:github.com/google/wireit README.md "cascade": false "files" parent dependency output💡 Result:
In the context of the Wireit build tool, setting "cascade": false for a dependency modifies the standard execution behavior of scripts [1][2]. By default, Wireit uses an execution cascade where a script's fingerprint—the data used to determine if a script needs to be re-run—includes the fingerprints of all its dependencies [3][4][2]. This ensures that if a dependency changes, the dependent script is automatically triggered to re-run [3][2]. When you set "cascade": false for a specific dependency, you remove that dependency's fingerprint from the dependent script's own fingerprint [3][4][2]. Consequently, the dependent script will not automatically re-run simply because the dependency was executed or its output changed [3]. This setting is useful in scenarios where: 1. Partial Consumption of Output: A script only relies on a subset of a dependency's output [1][2]. By setting "cascade": false, you prevent unnecessary re-runs caused by changes to files in the dependency's output that the dependent script does not actually use [1][2]. In this case, you must explicitly add the specific subset of output files that matter to the dependent script's files array to ensure correctness [1][2]. 2. Avoiding Redundant Restarts: A script (such as a server) might read files dynamically at runtime [1][2]. If the dependency generating those files changes, the script does not necessarily need to restart, allowing you to avoid unnecessary downtime in watch mode [1][2]. Because "cascade": false disables the automatic dependency tracking for that dependency, it is the developer's responsibility to ensure that all relevant input files are correctly listed in the files array to maintain build accuracy [3]. Wireit will still ensure the dependency is executed first if it is not up-to-date, but the outcome of that execution will not force the dependent script to invalidate its own cache [3].
Citations:
🏁 Script executed:
Repository: NVIDIA/elements
Length of output: 6893
🌐 Web query:
Wireit files field relative paths outside package ../ glob supported💡 Result:
In Wireit, the support for file paths and glob patterns differs between the files and output properties [1][2]. For the files property, Wireit explicitly supports reaching outside of the current package directory using relative path syntax, such as../foo [1][3]. This allows you to include input files from parent or sibling directories in a monorepo structure [1][4]. Conversely, the output property does not support referencing files outside of the current package [1][5]. Attempting to configure output paths to target locations outside of the package directory will result in a runtime error, as Wireit enforces that cached outputs must reside within the package root [5]. All paths in both files and output are interpreted relative to the package directory, and standard glob patterns (such as *,, and brace expansion) are supported for both [1][2]. Paths should always use forward-slash (/) delimiters, even on Windows [1][2].
Citations:
Track all shared benchmark configuration inputs in the Wireit fingerprint.
Because
../internals/vite:ciuses"cascade": false, its fingerprint does not invalidateprojects/core:test:bench. The benchmark configuration importsbench.js,test.js,console.js, andenv.js, but these files are not listed infiles. Configuration changes can therefore leave cached benchmark results stale.Add the shared configuration files to
files, or remove"cascade": false.🤖 Prompt for AI Agents
Source: MCP tools