running-release-tests

Runs automated UI and API release testing jobs via the AWS DevOps Agent using pre-configured test profiles.

1|Updated Aug 1, 2024
One-click install
npx skills add https://github.com/obispobruno/dotfiles --skill running-release-tests-obispobruno
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: running-release-tests
Source: https://github.com/obispobruno/dotfiles/tree/main/dot_agents/skills/running-release-tests
Command: npx skills add https://github.com/obispobruno/dotfiles --skill running-release-tests-obispobruno

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Manually validating multi-step workflows, checking for regressions, and testing API endpoints before a release is slow and error-prone. This Skill automates release testing in the cloud through the AWS DevOps Agent, using pre-configured test profiles that already contain the target URL, agent type, personas, and credentials. ## Core Features & Use Cases - UI and API Release Testing: Launch browser-based UI tests or OpenAPI-based API tests from an existing test profile (Knowledge Item ID). - Live Progress Monitoring: Poll task status and journal records to stream findings to the user in real time until the job completes. - Report Generation: On completion, retrieve the UI or API testing report and save it as a timestamped markdown file. - CLI Fallback: If the aws-devops-agent remote tools are unavailable, fall back to direct AWS CLI commands (create-backlog-task, get-backlog-task, list-journal-records). - Use Case: Before deploying a new version of your web app, ask the agent to run your QA test profile; it starts the job, reports progress, and saves a full regression report to disk. ## Quick Start Ask the agent to run release tests using your existing test profile, for example: "Run the QA release tests with test profile ki-12345 and save the report."

Frequently Asked Questions about running-release-tests

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run automated release tests with the AWS DevOps Agent?▼

Provide an existing test profile ID (like ki-12345) and optionally a test requirement. The agent creates a release testing job, polls its status every 30 seconds, streams journal records as progress updates, and saves the final report as a markdown file.

What is a test profile in AWS DevOps Agent release testing?▼

A test profile is a pre-existing Knowledge Item created in the AWS DevOps Agent console or API. It contains the target URL, agent type (UI or API), test personas, and credentials, so you do not need to supply these separately when running tests.

Can I create a test profile through this testing workflow?▼

No, test profiles must already exist before running release tests. They are created through the AWS DevOps Agent console or API, not through this tool. You only need to provide the profile's Knowledge Item ID.

What happens if the AWS DevOps Agent remote tools are unavailable?▼

The workflow falls back to direct AWS CLI commands such as create-backlog-task, get-backlog-task, and list-journal-records. The same job lifecycle is followed: start, poll, monitor journal records, and retrieve the UI or API testing report.

Why did my release testing job fail or time out?▼

Common causes include expired credentials (NoCredentialsError, ExpiredTokenException), throttling (429 or ThrottlingException), or the task not reaching IN_PROGRESS within 5 minutes. Refresh credentials, retry after 30 seconds for throttling, or cancel and restart the job.