Entropy by Design: Synthetic Data at Scale
Marah Abdin
2025 Talk
Abstract
At scale, under-constructed generation amplifies uniformity, causing synthetic data pipelines to plateau into self-similarity. We approach the problem through entropy-aware design as a system of variability levers - both structural and cognitive - preserving quality and diversity at pretraining scale.
Video
Chat is not available.
Successful Page Load