Skip to main content
Data Science

Return to Answer

added 72 characters in body
Source Link
noe
noe
  • 27.5k
  • 1
  • 49
  • 80

You can use Data Selection with Importance Resampling (DSIR), which applies importance resampling with bag-of-words ngrams estimators. This method is specifically meant to select good data for LLM training.

The authors of the method released their source code, so you can just use it.

This Twitter thread is a good summary.

You can use Data Selection with Importance Resampling (DSIR), which applies importance resampling with bag-of-words ngrams estimators.

The authors of the method released their source code, so you can just use it.

This Twitter thread is a good summary.

You can use Data Selection with Importance Resampling (DSIR), which applies importance resampling with bag-of-words ngrams estimators. This method is specifically meant to select good data for LLM training.

The authors of the method released their source code, so you can just use it.

This Twitter thread is a good summary.

Source Link
noe
noe
  • 27.5k
  • 1
  • 49
  • 80

You can use Data Selection with Importance Resampling (DSIR), which applies importance resampling with bag-of-words ngrams estimators.

The authors of the method released their source code, so you can just use it.

This Twitter thread is a good summary.