MVP pilot · bugAgent-maintained community integration
bugAgent for Hermes Agent
Run curated bugAgent test plans with the agent runtime you choose, then return every result to one governed QA record.
This community integration is maintained by bugAgent. It is not maintained, endorsed, or supported by Nous Research.
One controlled execution loop
The agent executes. bugAgent governs.
Hermes provides the runtime, model, and browser tooling. bugAgent keeps the approved plan, tenant boundary, immutable snapshots, canonical results, and human review.
A human approves a project-bound suite in bugAgent.
Hermes retrieves a bounded snapshot and exercises the target.
Retry-safe batches update one canonical run and summary.
A person reviews failures and owns defect and release decisions.
Pilot setup
Connect a non-production suite
- 1Create a least-privilege key
Grant only
test_runs:readandtest_runs:write. The key is bound to its bugAgent workspace. - 2Add bugAgent MCP to Hermes
Allow only the suite listing and agent execution tools needed by the skill.
- 3Run a synthetic pilot
Use a staging target, a test account, and a suite created for integration testing before scheduling runs.
mcp_servers:
bugagent:
url: "https://mcp.bugagent.com/mcp"
headers:
Authorization: "Bearer ${BUGAGENT_API_KEY}"
tools:
include:
- list_test_suites
- start_test_plan
- get_test_run_plan
- report_test_results
- abort_test_run First run
Run your first governed suite
Install the public community skill, connect the scoped key, and name one approved suite and project in the prompt. Hermes executes the immutable plan; bugAgent remains the system of record.
- Create the scoped keyIn Developer settings, grant only
test_runs:readandtest_runs:write. - Install and verifyReview the skill, install it from GitHub, and test the MCP connection.
- Execute a safe targetUse a staging environment and a synthetic login with externally restricted browser and network access.
- Review in bugAgentConfirm every case appears once and the pass, fail, blocked, and skipped totals match.
hermes skills install TestLauncher/testlauncher/skills/bugagent-qa
hermes skills list
# Add the real key only to your local Hermes environment.
printf '%s\n' 'BUGAGENT_API_KEY=ba_live_REPLACE_LOCALLY' >> ~/.hermes/.env
chmod 600 ~/.hermes/config.yaml ~/.hermes/.env
hermes mcp test bugagent /bugagent-qa Execute the "Checkout smoke" suite in the API Testing project.
Use the staging target already configured for this Hermes profile. Do not make
purchases, invite users, or perform destructive actions. Report every result to
bugAgent and abort safely if the target cannot be reached. Replace the example suite and project names with your own. Never put target credentials or a live API key in the prompt.
Overlap evaluated honestly
Use each product for what it does best
Both can participate in test authoring and execution. The integration avoids duplicating a general agent runtime inside bugAgent or moving the QA system of record into an execution worker.
Plan and runtime boundary
Know the limits before you run
- Free includes 10 stored test cases, 1 suite, 3 folders, and 10 total test runs per UTC calendar month.
- Each Free test case has a 128 KB structured-content maximum. Free can use URL references; test-case file attachments require Team or Enterprise.
- Up to 3 Free runs per month may use Hermes or another external agent. Free allows 1 active external run and at most 10 cases in each external plan.
- Free allows 2 active workspace API keys, so Hermes can use a dedicated
test_runs:read/test_runs:writekey without sharing a general integration credential. - Free execution traffic is limited to 30 requests per key and 60 per workspace per minute. Team and Enterprise allow 120 per key and 600 per workspace per minute.
- Retrying with the same
external_run_idresumes the existing run and does not consume another run. Deleting data does not reset monthly run usage. - Completed and aborted external runs are final and cannot be reopened to recycle quota.
- Team and Enterprise test case storage and runs are unlimited, subject to general platform protections. AI test-case generation, AI tag suggestions, and Figma import also require Team or Enterprise.
- It executes approved suites; it does not silently expand test coverage.
- Result evidence is text in the MVP; agent attachment upload comes later.
- Target browser, model, and network costs remain customer-side, as do browser reliability and target authentication.
- Test case text is untrusted input; customers must restrict Hermes tools, target access, and network egress.
- Target credentials stay in the execution runtime and never enter the bugAgent plan contract.
- A human still decides whether to file a bug or approve a release.
Private pilot
Pilot one staging suite
Measure setup time, completion rate, result quality, and repeat use before expanding the integration.