overfeed.news

Preparing data for supervised fine-tuning Part 2: Advanced data strategies

1mês

Idade

Publicado
Coletado
Imagem: AWS Machine Learning Blog

The advanced side of supervised fine-tuning data prep. This second post in a two-part series covers evaluating data readiness with learning curves, selecting high-value data subsets, augmenting data with synthetic and distilled examples, and mixing data sources to prevent catastrophic forgetting.

Trecho da fonte

Data preparation for supervised fine-tuning (SFT) doesn’t end when your dataset is clean and correctly formatted. The harder questions come next. How much data do you actually need? Should you collect more, or select a better subset of what you have? How do you generate high-quality examples when human annotation doesn’t scale? And how do you specialize a model without erasing its general capabilities? This post assumes you have prepared a quality-checked, schema-compliant SFT dataset and are…

Leia o artigo completo em aws.amazon.com

O overfeed.news indexa e aponta. Publicamos um trecho curto — o artigo completo fica em AWS Machine Learning Blog.

Entre para seguir esta fonte
Preparing data for supervised fine-tuning Part 2: Advanced data…