Skip to Content
DocsArchitectEndpoint Exploration

Endpoint Exploration

Before designing a test suite, Architect explores your endpoint — running real conversations against it to understand what it does and how it behaves.

Choosing a mode

When you mention an endpoint, Architect asks which mode you prefer:

ModeWhat it runsBest when
QuickDomain probing onlyYou know your endpoint, or just want to get started fast
ComprehensiveDomain probing → capability mapping → boundary discoveryYou’re testing an unfamiliar endpoint, or want full coverage

If you say “just go ahead” or don’t express a preference, Architect defaults to Quick.

You can always deepen exploration after a Quick run. Ask Architect to “dig into capabilities” or “check the boundary behavior” and it will run the relevant follow-up strategy.

What each strategy finds

Comprehensive mode chains all three, passing what it learned in each step into the next.

Domain probing

Discovers the endpoint’s core identity:

  • What domain does it operate in?
  • What is its purpose and persona?
  • What terminology does it use?
  • Which topics does it cover?

Capability mapping

Enumerates what the endpoint can actually do:

  • Supported query types and interaction patterns
  • Multi-turn conversation support
  • Functional features and limitations

Boundary discovery

Finds where the endpoint draws the line:

  • Refusal patterns and trigger phrases
  • Domain boundaries (what it redirects away from)
  • Safety guardrails and how consistently they’re enforced

What you get after exploration

Architect never dumps raw output. It synthesizes findings into a structured summary:

  • Domain and purpose — what it does and which domain it serves
  • Capabilities — what it can handle
  • Restrictions — what it refuses or redirects
  • Response patterns — tone, length, consistency
  • Areas worth testing — concrete dimensions to base the test suite on

Then it asks 2–3 targeted follow-up questions based on what it found — not generic questions like “what does your chatbot do?”, but specific ones tied to actual observations.

Example:

I noticed it handles cancellation requests but seems uncertain about partial cancellations. Should I include edge cases like split orders or refund-only scenarios in the test suite?

Connectivity check

Before exploring, Architect checks that your endpoint is reachable. If the connection fails, it reports the error and stops — it won’t attempt exploration against an unreachable target.