Enable teacher–student curriculum learning in ML training pipeline
AI Impact Summary
The change introduces a teacher–student curriculum learning approach, where a teacher guides the student model with a progressively harder curriculum. This will impact the ML training pipeline by requiring a teacher model, curriculum scheduling, and data-generation or annotation workflows, plus new evaluation hooks to monitor curriculum progress. If tuned poorly, convergence can slow or underfit; when properly calibrated, it can improve generalization and data efficiency, reducing labeled data needs for complex tasks.
Business Impact
Adopting this capability can improve model generalization and data efficiency, but will increase training complexity and compute costs during rollout and require changes to data generation and evaluation processes.
Risk domains
Source text
- Date
- Date not specified
- Change type
- capability
- Severity
- medium