MSKL
  • Member for 3 years, 1 month
  • Last seen more than a month ago
  • Prague, Česko
Apache Spark Understanding
Accepted answer
3 votes

If you are just starting out, it is pretty unlikely that you come across such big datasets that require massive parallelization either in computing power or data storage means. When you start ...

View answer
Dealing with the test set of imbalanced data
2 votes

For a case like this, it would probably be the easiest to do the train/test split manually. Here is a quick example with Pandas: import pandas as pd import numpy as np # Create an empty dataframe ...

View answer
Can I use the test dataset to select a model?
Accepted answer
2 votes

Thanks for the answers. I consulted it with some more people and I think that I have settled for an explanation that makes sense for me: The truth is that although the "test dataset" can be used to ...

View answer
How to create a new column based on two other columns in Pandas?
Accepted answer
1 votes

You can try something like this to get a new dataframe that has pairs of (EventID, TeamCount): event_id_team_count = data.groupby('EventID').agg({'TeamID': lambda x: x.nunique()}) event_id_team_count....

View answer
How can I improve a machine learning model?
1 votes

It is questionable whether doing the PCA and reducing the dimension to 2D was a good idea. You can try experimenting with the number of components in PCA or even trying some non-linear dimensionality ...

View answer
Is Mac OS the most suitable OS for a beginner Data Scientist?
0 votes

First of all, welcome to the data science Stack Exchange. You should really use what you like. Half of my colleagues use Linux, the other half including myself OSX. It really comes down to what you ...

View answer
How does GlobalMaxPooling work on the output of Conv1D?
Accepted answer
0 votes

Apparently I forgot how the convolution works. The input is multiplied element wise with the filter weights and the products are then summed. That's how a single value is obtained on the output.

View answer