IntraSkill training timeline
Several GRPO rollout steps update the model under one frozen SkillBank; each validation gate selects the skill used by the next interval.
TRAINING INTERVAL 1 · S₀ FROZEN
TRAINING INTERVAL 2 · S₁ FROZEN
Every block is one GRPO rollout step
32 groups → retain 16 → 128 accepted episodes → 2 optimizer updates
Model parameters update at every step
all-wrong groups accumulate as candidate evidence
Between gates
skill text, order, q and inclusion probabilities stay fixed
At a gate
the frozen checkpoint evaluates current and candidate chunks; only then does the SkillBank change
Cold
start
M₀ + S₀
GRPO
rollout
step 1
same mask
within group
GRPO
rollout
step 2
same mask
within group
⋯
GRPO
rollout
step 20
same mask
within group
Validation
gate
freeze M
retry + compile
paired OLS
NEW
SKILL
S₀ → S₁
GRPO
rollout
step 21
same mask
within group
GRPO
rollout
step 22
same mask
within group
⋯
GRPO
rollout
step 40
same mask
within group
Validation
gate
freeze M
paired selection
NEW
SKILL
S₁ → S₂