2
$\begingroup$

I'm new to Machine Learning and I just came across the sci-kit package. On this interesting page there are many toy data sets used to test different clustering algorithms. Each data set has a unique pattern and some algorithms perform better than others depending on the data sets.

I want to ask why these data sets are chosen as tests for the algorithms? What are the properties for them to be suitable for use in testing? Are there any other data sets with common attributes that are used for the same purpose? Do they have certain names that I can read more about?

Thank you.

$\endgroup$

1 Answer 1

0
$\begingroup$

The toy examples or the common datasets you are talking about are so because they are simple to visualise it and work with. Their simplicity helps the beginner to train simple models which don't require much compute. The simplicity in the structure of the dataset allows visualisation of the data on lower dimensions.

Reason for using them as test datasets is that they provide us a quick sanity check to see if the algorithm performs or not. The link you provided is specifically for clustering problems. So, datasets which can be easily visualised on 2D plane would be a simple dataset to check the performance of the algorithm via inspection. Had it been a complex datasets like a dataset of human faces, it would be difficult to evaluate the performance of the model through visualisation and inspection.

Some examples for such datasets:

MNIST dataset - collection of handwritten digits used to train classification network to identify the class of digit during test time.

Cifar-10 : collection of RGB images of 10 classes of objects in real world (e.g cars and birds).

Cifar-100: upgrade of Cifar-10. Contains images from 100 classes

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.