Skip to content

Separate pipeline freshness from runtime tuning#766

Merged
FurtherAI merged 1 commit into
mainfrom
austin/pipeline_freshness_api
Jul 17, 2026
Merged

Separate pipeline freshness from runtime tuning#766
FurtherAI merged 1 commit into
mainfrom
austin/pipeline_freshness_api

Conversation

@FurtherAI

Copy link
Copy Markdown
Collaborator

Summary

  • move max_steps_off_policy from PipelineRuntimeConfig to a fixed PipelineTrainer keyword argument
  • keep strict and mean policy freshness constraints configurable while pipeline autotuning is enabled
  • update internal callsites to use the trainer-level freshness argument

Why

PipelineRuntimeConfig is rejected when autotuning is enabled because the autotuner owns its worker, batch, and queue settings. Policy freshness is a training constraint rather than a tunable runtime setting, so placing max_steps_off_policy in that object unnecessarily prevented users from configuring it with autotuning.

Mean-only in-flight update runs can now use:

PipelineTrainer(
    ...,
    autotune=PipelineAutotuneConfig(mode="online"),
    max_steps_off_policy=None,
    limit_mean_steps_off_policy=2.0,
)

The strict default remains 4.

Validation

  • 72 pipeline tests passed, 1 GPU test skipped
  • repository prek hooks passed: Ruff, Ruff format, ty, and lockfile sync

@FurtherAI
FurtherAI marked this pull request as ready for review July 17, 2026 00:11
@FurtherAI
FurtherAI merged commit a2c2bd3 into main Jul 17, 2026
11 checks passed
@FurtherAI
FurtherAI deleted the austin/pipeline_freshness_api branch July 17, 2026 03:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant