Dataset loader API#
Dataset loaders normalize external records for the selected training path. The exact record shape depends on the algorithm family.
Current loader shapes are documented in Dataset loaders:
SFT loaders provide prompts and target responses.
DPO loaders provide prompt, chosen, and rejected responses.
Prompt-based RL loaders provide prompts and task metadata for reward scoring.
Agentic RL loaders provide task state for agent functions.
Keep loaders small, deterministic, and testable outside the GPU training loop.