Config file structure
Top-level fields
| Field | Type | Required | Description |
|---|---|---|---|
name | string | Yes | Human-readable name for this run, shown in the dashboard |
projectId | string | Yes | UUID of the project to associate this run with |
envFile | string | No | Path to a .env file with environment variables for the run |
agentInfo | object | No | Arbitrary metadata attached to the run report |
tasks | array | Yes | List of test tasks (see below) |
Task fields
Each item in thetasks array defines one test scenario:
| Field | Type | Required | Description |
|---|---|---|---|
id | string | Yes | Unique identifier for this task within the run |
description | string | Yes | Natural language description of what to test |
context | string | No | Additional context for the agent (credentials, notes) |
startUrl | string | Yes | The URL the agent navigates to at the start of this task |
subAgents | array | Yes | Which agents to run: "security", "uiux", or both |
Writing effective task descriptions
Thedescription field is interpreted by an LLM, so natural language works well. Be specific about what the agent should do and what you want it to look for.
- Good descriptions
- Vague descriptions
Choosing subAgents
You can run the security agent, UI/UX agent, or both on any given task.security alone may be sufficient. For static marketing pages, quality alone may be more relevant.
Two ways to configure
Visual UI Builder
Use the QAOS dashboard to generate a config file through a guided form — no JSON editing required.
JSON from Scratch
Write or edit the config file directly with the full field reference.