Repository navigation
feat(check): rename the status to Vapi Simulations; one target, one status - #82
Merged
Merged
Conversation
…tatus The PR check posted `Vapi Evals`, though every run is a simulation and the docs now separate Simulations (whole conversations) from Evals (single decisions). It is now `Vapi Simulations`, matching the product the Details link opens. With one target, an --all run no longer posts a per-target status that repeats the aggregate: the aggregate carries the pending state and links straight to the run. With several targets, each still gets its own status linking its run. Running one named check by hand still posts per-target statuses only. - src/check-status.ts, check-cmd.ts, check-report.ts and the workflow use the new name. - Tests: one target posts only the aggregate (pending, then the verdict, both linking the run); several targets each get a status and the aggregate links the workflow run. - Docs: README and the PR checks guide use the new name, with a note for repos that already require `Vapi Evals` in branch protection. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Contributor
Author
This stack of pull requests is managed by Graphite. Learn more about stacking. |
scott-lowe-vapi
marked this pull request as ready for review
October 14, 2026 04:15
1 of 2 tasks
stephenvapiai
pushed a commit
to VapiAI/docs
that referenced
this pull request
Oct 14, 2026
Follows VapiAI/gitops#82, which renames the status the gitops PR check posts from Vapi Evals to Vapi Simulations.
vtkovapi
approved these changes
Oct 14, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

Value
V.A.L.U.E. tier: small. It changes the name of a commit status that customers may require in branch protection. Not micro: it changes behavior, not just intended behavior restored.
Vapi Evals, but every run is a simulation, and the public docs now separate Simulations (whole conversations) from Evals (single decisions). Next to "4 of 4 simulations passed", the name blurs exactly that line. Dogfooding also showed a single-target repo gets an overall status plus a per-target status that say the same thing and link the same run: three Vapi rows on a PR where two would do.Vapi Simulations, and per-target statuses areVapi Simulations / <check> / <target>. The job summary heading matches.--allrun posts only the overall status. It's pending with the run link while the run is going, then the verdict, still linking the run. With several targets, each still gets its own status linking its run, and the overall status links the workflow run. Running one named check by hand is unchanged.Vapi Evalsmust requireVapi Simulationsafter merging the update, or PRs will wait on a status that no longer posts.Alignment needed: Agent Loop (PAL-608 specifies
Vapi Evalsfor the planned shared GitHub Action). Merge after they agree, or update PAL-608 to match, so the two don't diverge. The public docs page (docs.vapi.ai/config-as-code) also namesVapi Evals: VapiAI/docs#1330 renames it there, and should merge after this PR.Evidence of value
check-cmd.test.tsruns a live--allagainst a stub. It posts onlyVapi Simulations(pending, then success), both linking the run.Testing plan
npm test(547) andnpx tsc --noEmitpass.Vapi Simulations, with two rows for thegoatandlebronchecks (two targets).Refs TEST-141
🤖 Generated with Claude Code