Skip to main content
Do not start by authoring an ontology or naming a learner. Start by drawing one event and asking what later evidence should change. When the task boundary is clear but the useful learner-facing structure is not, start with Discovery.
The same application can contain several relationships. Keep their targets and feedback meanings separate even when they share one Domain.
This page chooses the evidence relationship. It does not classify how state was earned. Use Choose a learning setup to fix the complete learning-run boundary and distinguish zero-start learning inside that run from state formed in a separate acquisition phase. A later episode or pass is not a warm start when its state was earned earlier inside the same zero-start run.

Start with three common cases

Start with the first matching case. Add a specialized relationship only when the application can name its observable inputs, target, consequence, and attribution boundary.

Complete relationship map

These relationships are not task categories or internal architecture modules. They describe what the application can observe and what it wants later behavior to use.

Pattern 1: multistep action task

The application must satisfy a goal through several actions that change the state encountered next. The Domain can supply:
  • Goal and object vocabulary.
  • Observable state fields.
  • Public action grammar or the currently available legal choices.
  • Native progress, failure, and terminal outcome meanings.
  • Episode and reset boundaries.
The Domain should not supply:
  • The correct current action.
  • Hidden object locations or roles.
  • A solved action sequence.
  • An oracle plan or private world state.
Interaction loop:
Use direct feedback when one action receives a sufficient attributable outcome. Use sequential learning when a later or terminal outcome should revise earlier actions that changed subsequent states. A long episode can still use ordinary feedback. A two-action episode can require sequential credit. Length does not decide the relationship.

Other task shapes

Use contextual policy feedback when each experiment has a measurable result that belongs to that choice.Use transition learning when the main result is the measured output expected from the conditions. Use typed hypotheses when the mechanism itself must remain inspectable. Use sequential learning only when an early experiment or process step changes the state used by later steps and a later result should revise that early choice.A separate acquisition phase helps when choice meanings and outcome scales transfer into future experimental runs. Zero-start task-local learning fits when each target has a different hidden mapping that should be discovered through local interventions and reset afterward. See Choose a learning setup for the complete schedule and boundary rules.
The application can choose interventions, observe resulting measurements, and must predict a held-out value. It may also need to return a typed mechanism that explains the evidence.The Domain can supply:
  • Variable names, units, and observable ranges.
  • Which variables are controllable.
  • The public meaning of an intervention.
  • The experiment budget and episode boundary.
  • The result schema for an intervention, numeric prediction, and typed hypothesis.
  • A public functional family when the task interface intentionally discloses it.
The Domain should not supply:
  • The hidden dependency graph.
  • Unknown equations or coefficients.
  • The held-out target value.
  • A preferred experiment chosen using hidden state.
Interaction loop:
The event order matters because evidence accumulates, but that fact alone does not require sequential credit. Structured transition learning can model:
Typed hypotheses can represent competing mechanisms. Sequential learning is appropriate when a later objective should assign delayed value to earlier experiment choices, rather than merely because the experiments occurred in a sequence.Keep final prediction accuracy and mechanism quality as separate outputs. A correct endpoint can coexist with a wrong explanation, and a plausible qualitative mechanism can miss the quantitative result.
The application must return a relation, scalar, coordinates, pose, grasp, path, or another structured result from observable scene information.The Domain can supply:
  • Public object identities and observable features.
  • Coordinate conventions, units, and reference frames.
  • Available operations or candidate objects when applicable.
  • The exact result grammar and validity constraints.
  • Native outcomes when a returned operation is actually executed.
The Domain should not supply:
  • Answer coordinates or target paths.
  • A preferred operation derived from private ground truth.
  • Labels unavailable to the application at query time.
  • A post-execution effect disguised as a pre-execution feature.
For independent items, use structured prediction, ordinary feedback, or a stateless route. Do not enable sequential learning merely because the items are processed in order.When the result is externally executed, preserve the complete record:
Different outputs may need separate learner views or Domains. A scalar, categorical relation, coordinate set, rigid pose, and variable-length path have different target geometry and evaluation meaning. A common source image does not make those contracts interchangeable.

History is not delayed credit

Recent history can be included as observable context without creating a sequential objective. Use sequential learning when both conditions hold:
  1. An earlier action changes the state encountered later.
  2. A later or terminal outcome should revise that earlier action.
If the current choice receives its own sufficient outcome, ordinary contextual feedback is usually the correct starting point.

Specialized relationships

One executed action can produce two different teaching relationships:
Do not put correct_action, a reward judgment, or a preferred policy into an observation-only transition target. Do not treat a next-state prediction as proof that the action was useful.Compatible relationships can coexist inside one Domain when they share the same public task semantics and lifecycle. They should still use separate targets, admission rules, and diagnostics.
Use bounded transition scoring when the application must compare candidate actions by how each is expected to change an explicit public numeric state toward one declared objective. All of these should be true:
  • The relevant state is public and numerically bounded.
  • Each candidate identifies the state and action it would affect.
  • Feedback can return the observed successor state.
  • One declared state feature is the objective.
This is not general next-state prediction and it is not delayed-return learning. Its configuration is nested under learning.sequential.bound_transition, but that location does not make every bounded-scoring task a sequential-credit task. Do not use it for hidden state, an undefined objective, or an ordinary context-to-outcome decision.The feedback and outcomes guide documents the exact mapping.
Use candidate hypotheses when the mechanism itself should remain inspectable or evaluable. Good candidates:
  • Compete over the same declared relation.
  • Predict different observable consequences.
  • Can receive supporting evidence and counterevidence.
  • Use the same public schema.
  • Do not encode a preferred answer.
Free-form notes can help an application preserve context, but a scored mechanism needs a typed result that can be compared consistently.

One Domain or several

Use one Domain when evidence should interact under one stable contract. Use several Domains when state must remain isolated because the public semantics, result geometry, feedback meaning, retention scope, or evaluation lifecycle differ. Every operation addresses one domain_id. One Core instance can retain several Domain states without blending them.

Start with the smallest configuration

Do not copy advanced controls from another task. Event boundaries, input geometry, target shape, grouping, support, and delayed-credit horizons express specific evidence relationships.

Validate the lifecycle, not only the score

Separate these stages: Frozen describes the write policy during inspection. It establishes transfer from separately acquired state only when the acquisition and evaluation split was fixed before state formation. If the state was earned earlier inside the same zero-start run, a later frozen checkpoint is a within-run frozen read. A successful API write does not prove learner admission. Preserve raw responses, event IDs, applicable sample counts, learner versions, external truth, and harness-derived metrics separately. During frozen evaluation, verify that the applicable learner state does not change.

Choose a learning setup

Fix the run boundary and distinguish zero-start learning from separately acquired state.

Use Discovery

Let Adapt-1 form learner-facing structure from admitted evidence.

Author a Domain ontology

Define explicit reviewed task-facing structure when you need it.

Sequential learning

Configure delayed credit for earlier state-changing actions without assuming a Discovery-only Domain.

Transition learning, advanced

Configure event admission, evidence geometry, targets, support, grouping, and abstention.

Use TCP

Add bounded episode history to contextual memory, model inference, and posterior selection.

Use CUP

Learn which posterior sources and source pairs add predictive utility.

Learn from outcomes

Connect the returned value, application commitment, execution, and measured result.

Verify adaptation

Test cold, adaptive, transfer, and frozen behavior without mixing the claims.