Runs VS Code end-to-end smoke tests and diagnoses flaky CI failures.
npx skills add https://github.com/Tyrizx/Tyrizx --skill smoke-tests-tyrizx
Please help me install this Agent Skill. Skill: smoke-tests Source: https://github.com/Tyrizx/Tyrizx/tree/main/.github/skills/smoke-tests Command: npx skills add https://github.com/Tyrizx/Tyrizx --skill smoke-tests-tyrizx
npm run smoketest or smoketest-no-compile, with grep filtering, tracing, and web/remote/headless modes. - Flaky Test Hunting: Apply a temporary repeat-loop technique in GitHub Actions or Azure DevOps to reproduce intermittent CI failures and capture traces. - CI Log Analysis: Download and interpret smoke test log artifacts from GitHub Actions (gh run download) or Azure DevOps (az pipelines runs artifact download), including Copilot runtime logs and Playwright screenshots. - Use Case: A smoke test fails intermittently only in CI. Add a temporary 20-iteration loop of the suspect suite to a throwaway branch, let CI reproduce the failure, then download the logs artifact to inspect the runner log and screenshots. ## Quick Start Run the VS Code smoke tests filtered to a specific suite with tracing enabled and show me how to debug any failures from the CI logs artifact.High-intent search queries and answers about installing and using this skill.
Run `npm run smoketest` to compile and execute the smoke tests, or `npm run smoketest-no-compile` to run already-compiled tests. Pass extra arguments after `--`, such as `-g "<suite name>"` to filter suites and `--tracing` to capture Playwright traces.
Add a temporary loop step to the CI workflow that runs the suspect suite 20 times with fail-fast on the first failure. Push it on a throwaway branch, let CI reproduce the flake with traces captured, and remove the loop before merging.
Use `gh run download <run-id> -n logs-<os>-<arch>-<suite>-<attempt> -D ./logs` with the run id from the workflow URL. The artifact contains the smoke-test-runner.log, per-suite extension host logs, and Playwright screenshots.
Smoke tests in `test/smoke/` drive a full VS Code instance through end-to-end UI flows via `npm run smoketest`. Unit tests (`.test.ts`) run via `scripts/test.sh`, and integration tests (`.integrationTest.ts`) run via `scripts/test-integration.sh`.
Check the Copilot runtime process logs under `<N>_suite_<Suite_Name>/copilot-runtime-logs/` in the logs artifact first. They record the SDK's startup, auth, model requests, and any protocol errors that explain timeouts the test error alone does not.
mako-aiAutomate build, test, packaging, and release workflows for Mako Desktop and Local Agent.
Chorus-AIDLCAutomate pull request workflows with git and the GitHub CLI.
oci-ai-incubationsCodify end-to-end test flows for API, UI, and infrastructure in the VSS stack.
az0512124155azz-sysRuns VS Code end-to-end smoke tests and diagnoses flaky CI failures.