Questions tagged [kaggle]

Relating to Kaggle competitions, datasets, or kernels.

Filter by
Sorted by
Tagged with
19
votes
3answers
11k views

How to perform feature engineering on unknown features?

I am participating on a kaggle competition. The dataset has around 100 features and all are unknown (in terms of what actually they represent). Basically they are just numbers. People are performing ...
17
votes
3answers
12k views

Why do we convert skewed data into a normal distribution

I was going through a solution of the Housing prices competition on Kaggle (Human Analog's Kernel on House Prices: Advance Regression Techniques) and came across this part: ...
12
votes
1answer
5k views

Hashing Trick - what actually happens

When ML algorithms, e.g. Vowpal Wabbit or some of the factorization machines winning click through rate competitions (Kaggle), mention that features are 'hashed', what does that actually mean for the ...
8
votes
2answers
9k views

Why does Gradient Boosting regression predict negative values when there are no negative y-values in my training set?

As I increase the number of trees in scikit learn's GradientBoostingRegressor, I get more negative predictions, even though there are no negative values in my ...
6
votes
2answers
41k views

How can I fill NaN values in a pandas data frame?

Greeting everyone. I am trying to learn data analysis and machine learning by trying out some problems. I found a competition "House prices" which is actually a playground competition. Since I am very ...
5
votes
3answers
393 views

Can you recommend a machine learning challenge that is suitable for novices?

I am looking for a challenge that is suitable for a group of novices who want to learn the basics of data science and machine learning. The challenge should match the following criteria: is based on ...
4
votes
1answer
205 views

AUC ROC metric on a Kaggle competition

I am trying to learn data modeling by working on a dataset from Kaggle competition. As the competition was closed 2 years back, I am asking my question here. The competition uses AUC-ROC as the ...
4
votes
1answer
78 views

How to automate the encoding process?

I am working on the Boston challenge hosted on Kaggle and I'm still refining my features. Looking at the dataset, I realize that some columns need to be encoded in binary, some encoded in decimals (...
3
votes
2answers
2k views

one-hot-encoding categorical data gives error

I am currently working on the Boston problem hosted on Kaggle. The dataset is nothing like the Titanic dataset. There are many categorical columns and I'm trying to one-hot-encode these columns. I'...
3
votes
3answers
246 views

Should I perform cross validation only on the training set?

I am working with a dataset that I downloaded from Kaggle. The data set is already divided into two CSVs for Train and Test. I built a model using the training set because I imported the train CSV ...
3
votes
1answer
223 views

How will a rotation matrix affect contestants in machine learning contests?

Machine Learning contests like Kaggle usually layout the machine learning task in a human-understandable way. E.g. they might tell you the meaning of the input (features). But what if a Machine ...
3
votes
1answer
142 views

Owen Zhang's slides: what does the “time” mean?

Here is one of Owen Zhang's slideshares. At page 12, what does the time mean?
3
votes
1answer
3k views

Sklearn StratifiedKFold code explanation

While going through the following blog I came across the following code snippet ...
3
votes
1answer
710 views

How to automate ANOVA in Python

I am at the dimensionality reduction phase of my model. I have a list of categorical columns and I want to find the correlation between each column and my continuous ...
3
votes
1answer
734 views

Hyperparameter tuning for stacked models

I'm reading the following kaggle post for learning how to incorporate model stacking http://blog.kaggle.com/2016/12/27/a-kagglers-guide-to-model-stacking-in-practice/ in ML models. The structure ...
2
votes
2answers
210 views

What is the difference between public test and private test on Kaggle

I am trying to use the datasets from a competition held on Kaggle in which the dataset contains fer2013.csv file having columns emotion, pixels, and usage where usage contains 3 values i.e "training", ...
2
votes
3answers
174 views

Logistic Regression doesn't predict for the entire test set

I am working through Kaggle's Titanic competition. I am mostly done with my model but the problem is that the logistic regression model does not predict for all of 418 rows in the test set but ...
2
votes
2answers
126 views

Dummy variable for Categorical values

The question is in reference to solution of Titanic survival predictionat kaggle . As many have did the similar kind of feature extraction, They have converted some of the numerical features (Age, ...
2
votes
1answer
36 views

Importing .ipnyb file from Kaggle into local Jupyter

Total beginner question here, please let me know if it would be more appropriate somewhere else. I just created my first iPython notebook in Kaggle and I downloaded the ipnyb file. Now I have ...
2
votes
1answer
3k views

Pandas throwing “Error tokenizing data. C error” while loading data sets from URL

I am trying to work on the Titanic competition to get hands on experience with data science & machine learning. I tried to load up the datasets from GitHub but pandas threw the following error: <...
2
votes
2answers
200 views

kaggle Titanic what is GP?

sometimes I see the kernel with GP programming. but without explanation, they put some random number with unknown equation Here is some part of GP programming ...
2
votes
1answer
508 views

What's cooking Kaggle - Improve model

I'm participating in a Kaggle contest "What's cooking". The goal is to know wich kind of cuisine we have, depending on some ingredients. So it's a multiclass classification problem. I have an existing ...
2
votes
4answers
884 views

When should ordinal data be represented catigorically and when as integer?

I am doing the Kaggle competition House Prices: Advanced Regression Techniques to learn more about data analysis. I would like to apply multiple models to the data(Regularized LR, Random Forests, ...
2
votes
1answer
366 views

Finding parameters with extreme values (classification with scikit-learn)

I am currently working with the forest cover type prediction from Kaggle, using classification models with scikit-learn. My main purpose is learning about the different models, so I don't pretend to ...
2
votes
1answer
68 views

Kaggle Titanic submission score is higher than local accuracy score

This is the starter challenge, Titanic. The original question I posted on Kaggle is here. However, nobody really gives any insightful advice so I am turning to the powerful Stackoverflow community. ...
2
votes
0answers
158 views

Avoid hardware limitation while competing in Kaggle?

I've learned machine learning via textbooks and examples, which don't delve into the engineering challenges of working with "big-ish" data like Kaggle's. As a specific example, I'm working on the New ...
1
vote
2answers
1k views

Is numpy.corrcoef() enough to find correlation?

I am currently working through Kaggle's titanic competition and I'm trying to figure out the correlation between the Survived column and other columns. I am using <...
1
vote
2answers
1k views

Binary encoding and its interpretation in Python

I have a column named Street that has 2 values: Paved and Gravel. Here is what print(train[binary_columns[0]].unique().tolist())...
1
vote
1answer
10k views

“concat” mode can only merge layers with matching output shapes except for the concat axis

I have a function I am trying to debug which is yielding the following error message: ValueError: "concat" mode can only merge layers with matching output shapes except for the concat axis. Layer ...
1
vote
1answer
1k views

xgboost with tree_method = 'hist' in R

According to a benchmark of GBM vs. xgboost vs. LightGBM (https://www.kaggle.com/nschneider/gbm-vs-xgboost-vs-lightgbm) it is possible to implenet xgboost with the argument ...
1
vote
1answer
29 views

Sklearn Pipeline for mixed features: numerical and (skewed) categorical

I am working on a dataset from Kaggle (housing price prediction). I have done some pre-processing on the data (missing values, category aggregation, selecting ordinal vs one-hot). I am trying to ...
1
vote
1answer
53 views

What is wrong with the below code? [closed]

I have been working on a project which i took from kaggle. I didn't get the result as mentioned in the website. What am I doing wrong here? ...
1
vote
1answer
67 views

Printing all files' names from a folder (Kaggle kernel)

train_dir= '../input/train' for file in os.listdir(train_dir): print(file) I am trying to get all the file names in a directory called "train", from a ...
1
vote
1answer
259 views

xgboost GridSearchCV take too long or does not goes to the next step

just strange ...
1
vote
1answer
109 views

requesting password while git push in jupyter notebook

I am trying to push the commited changes from kaggle kernels using jupyter notebook but while pushing the changes git asking me for username and I really don't know how to give username as it seems ...
1
vote
1answer
70 views

How to do feature analyzing : pandas groupby(). mean

I'm analyzing Titanic data from Kaggle1 with a kind of guiding book. In the book, feature analyzing about the relationship between Pclass data and Survived data is done like below. ...
1
vote
1answer
215 views

Can I make kaggle kernels read directly from my computer?

For some reason jupyter notebooks never work the same as kaggle kernels for me. I want to use kaggle kernels but the downside is I don't know how to make it read from a file on the computer like a ...
1
vote
1answer
841 views

How to use ensemble of models in FM or FFM?

I am using Factorization Machines ( libfm) and also the Field Aware Factorization Machines (libffm) for a kaggle competition. I am currently using the single models of each respectively for ...
1
vote
0answers
24 views

What to do when feature engineering and parameter tuning don't add to the base model performance

I've been working on using LogisticRegression from scikit to try the Titanic Kaggle comp. I've found something interesting, and that is that no amount of feature engineering and paramater tuning is ...
1
vote
0answers
22 views

Extract features from Decision tree leaf nodes

Recently came across a coursera course on "How to win Kaggle competitions" where they explain how we can engineer a categorical feature from each leaf node of the decision tree. [Video Link][1] I ...
1
vote
0answers
194 views

Load in many files from google drive into colab

I am trying to load in 30k images (600mb) from Google drive into Google Colaboratory to further process them with Keras/PyTorch. Therefore I have first mounted my Google drive using: ...
1
vote
0answers
38 views

Scalable Data Science Pipeline

I was looking at this repository (https://github.com/jeffheaton/jh-kaggle-util) and was wondering if there's a better approach to creating a scalable machine learning pipeline for data science ...
1
vote
0answers
30 views

How do I handle division by 0 in Kaggle?

I have written a RNN algorithm in Python/IDLE and ran it. It works and is successful. My dataset is large so I wanted to run it using Kaggle's computers, rather than my laptop. However, when I copied ...
1
vote
1answer
59 views

How to use Random Forest to reduce dimensions

I am working on the Boston competition on Kaggle and at the moment I am trying to use Random Forest to find the columns with the highest correlation with the target variable ...
1
vote
0answers
87 views

Face Landmark Detection Solution

Lately I have been working on image classification problems but just recently I tried a new type of Problem on Kaggle. I have normalized image data(X) by dividing with 255 and also the keypoints ...
1
vote
1answer
29 views

Modelling regressor of historic data on basic features test set

I am using a historical dataset of sales of items in shops and I need to predict the sales of the next month of the period. I performed feature engineering, and now I have 10 features in the train ...
1
vote
1answer
305 views

How to use Kaggle Api in Google Colab for directly using dataset?

I know that we can use Kaggle's api directly in google colab which downloads the dataset. The commands are : ...
1
vote
1answer
3k views

merge 2 dataframe with Memory Error

trying to merge 2 data frame size with (13647309, 48) and I'm using 32 memory. df_train = train.merge(train_lag,on=['ncodpers','int_date'], how='left') after I ...
1
vote
0answers
68 views

Kaggle - Kernel dies continuously

I keep receiving the error message "The kernel appears to have died" when running a simple command such as pd.read_csv(.......) on my Kaggle kernel. I am not quite sure what the issue. Any thoughts ...
1
vote
0answers
599 views

Issues with pandas chunk merge

I'm trying to solve a kaggle competition - https://www.kaggle.com/c/ga-customer-revenue-prediction Since the data is too much to fit in memory at once, I'm trying to clean, process and save data back ...