Questions tagged [kaggle]
Relating to Kaggle competitions, datasets, or kernels.
1
vote
0answers
11 views
How to use Kaggle Api in Google Colab for directly using dataset?
I know that we can use Kaggle's api directly in google colab which downloads the dataset. The commands are :
...
0
votes
1answer
15 views
0
votes
0answers
122 views
merge 2 dataframe with Memory Error
trying to merge 2 data frame size with (13647309, 48)
and I'm using 32 memory.
df_train = train.merge(train_lag,on=['ncodpers','int_date'], how='left')
after I ...
2
votes
2answers
80 views
kaggle Titanic what is GP?
sometimes I see the kernel with GP programming.
but without explanation, they put some random number with unknown equation
Here is some part of GP programming
...
0
votes
0answers
30 views
Kaggle - Kernel dies continuously
I keep receiving the error message "The kernel appears to have died" when running a simple command such as pd.read_csv(.......) on my Kaggle kernel.
I am not quite sure what the issue.
Any thoughts ...
1
vote
1answer
33 views
requesting password while git push in jupyter notebook
I am trying to push the commited changes from kaggle kernels using jupyter notebook but while pushing the changes git asking me for username and I really don't know how to give username as it seems ...
1
vote
1answer
39 views
How to do feature analyzing : pandas groupby(). mean
I'm analyzing Titanic data from Kaggle1 with a kind of guiding book. In the book, feature analyzing about the relationship between Pclass data and Survived data is done like below.
...
2
votes
2answers
72 views
What is the difference between public test and private test on Kaggle
I am trying to use the datasets from a competition held on Kaggle in which the dataset contains fer2013.csv file having columns emotion, pixels, and usage where usage contains 3 values i.e "training", ...
1
vote
0answers
183 views
Issues with pandas chunk merge
I'm trying to solve a kaggle competition - https://www.kaggle.com/c/ga-customer-revenue-prediction
Since the data is too much to fit in memory at once, I'm trying to clean, process and save data back ...
3
votes
1answer
213 views
Hyperparameter tuning for stacked models
I'm reading the following kaggle post for learning how to incorporate model stacking
http://blog.kaggle.com/2016/12/27/a-kagglers-guide-to-model-stacking-in-practice/
in ML models. The structure ...
1
vote
1answer
46 views
Can I make kaggle kernels read directly from my computer?
For some reason jupyter notebooks never work the same as kaggle kernels for me. I want to use kaggle kernels but the downside is I don't know how to make it read from a file on the computer like a ...
1
vote
0answers
177 views
Comparing XGBR with CatBoost performance
I saw on a CatBoost site that it supposed to outperform any other boosted training model and decided to try it myself on a Kaggle's https://www.kaggle.com/c/house-prices-advanced-regression-techniques....
1
vote
0answers
154 views
How decision trees work in Python
I am new to the field of machine learning. I have just recently learnt Decision Trees and started solving Titanic Survival problem from Kaggle Competition. I understood the algorithm behind decision ...
3
votes
2answers
48 views
Dummy variable for Categorical values
The question is in reference to solution of Titanic survival predictionat kaggle . As many have did the similar kind of feature extraction,
They have converted some of the numerical features (Age, ...
3
votes
4answers
164 views
When should ordinal data be represented catigorically and when as integer?
I am doing the Kaggle competition House Prices: Advanced Regression Techniques to learn more about data analysis. I would like to apply multiple models to the data(Regularized LR, Random Forests, ...
3
votes
1answer
4k views
“concat” mode can only merge layers with matching output shapes except for the concat axis
I have a function I am trying to debug which is yielding the following error message:
ValueError: "concat" mode can only merge layers with matching output
shapes except for the concat axis. Layer ...
0
votes
1answer
133 views
Why there is two output in Titanic case in tflearn quickstart?
I am stuck in the tflearn quickstart guide.
I've tried tit and it works perfectly with accuracy around 78%, but the problem is I don't understand why the "labels" consist of two "survived" columns ...
2
votes
0answers
131 views
Avoid hardware limitation while competing in Kaggle?
I've learned machine learning via textbooks and examples, which don't delve into the engineering challenges of working with "big-ish" data like Kaggle's.
As a specific example, I'm working on the New ...
1
vote
1answer
805 views
xgboost with tree_method = 'hist' in R
According to a benchmark of GBM vs. xgboost vs. LightGBM (https://www.kaggle.com/nschneider/gbm-vs-xgboost-vs-lightgbm) it is possible to implenet xgboost with the argument
...
12
votes
3answers
8k views
Why do we convert skewed data into a normal distribution
I was going through a solution of the Housing prices competition on Kaggle (Human Analog's Kernel on House Prices: Advance Regression Techniques) and came across this part:
...
1
vote
0answers
35 views
Is it possible to detect which field does a rotated “kaggle” contest data come from?
Imagine I setup a Kaggle competition with normalized stock data (e.g. price, volume, etc) plus a random rotation matrix (i.e. so that it's less obvious what the features are). Is it possible for a ...
3
votes
1answer
176 views
How will a rotation matrix affect contestants in machine learning contests?
Machine Learning contests like Kaggle usually layout the machine learning task in a human-understandable way. E.g. they might tell you the meaning of the input (features). But what if a Machine ...
3
votes
1answer
124 views
Owen Zhang's slides: what does the “time” mean?
Here is one of Owen Zhang's slideshares. At page 12, what does the time mean?
1
vote
0answers
180 views
HIgher Order Interaction Variables. How to use them in model? [closed]
http://stats.idre.ucla.edu/stata/webbooks/logistic/chapter2/
This above website gives an example about using interaction effect between variables. Interacting variables are multiplied and used in the ...
5
votes
3answers
386 views
Can you recommend a machine learning challenge that is suitable for novices?
I am looking for a challenge that is suitable for a group of novices who want to learn the basics of data science and machine learning. The challenge should match the following criteria:
is based on ...
1
vote
1answer
748 views
How to use ensemble of models in FM or FFM?
I am using Factorization Machines ( libfm) and also the Field Aware Factorization Machines (libffm) for a kaggle competition. I am currently using the single models of each respectively for ...
0
votes
1answer
271 views
Titanic Disaster
I have been working on the Kaggle tutorial on the Titanic Disaster.
Although I get a result which seems good to me (on the training set) the trained model performs bad on the test set.
It would be ...
4
votes
2answers
13k views
How can I fill NaN values in a pandas data frame?
Greeting everyone. I am trying to learn data analysis and machine learning by trying out some problems. I found a competition "House prices" which is actually a playground competition. Since I am very ...
-1
votes
1answer
720 views
Feature engineering using XGBoost
I am participating in a kaggle competition. I am planning to use the XGBoost package (in R). I read the XGBoost documentation and understood the basics.
Can someone explain how is feature engineering ...
1
vote
2answers
185 views
Multivariate linear regression accounting for threshold / data cleaning
I am trying to make a linear regression model for the sale price of a house based on many variables (based on the data from this Kaggle challenge https://www.kaggle.com/c/house-prices-advanced-...
3
votes
1answer
2k views
Sklearn StratifiedKFold code explanation
While going through the following blog I came across the following code snippet
...
19
votes
3answers
10k views
How to perform feature engineering on unknown features?
I am participating on a kaggle competition. The dataset has around 100 features and all are unknown (in terms of what actually they represent). Basically they are just numbers.
People are performing ...
-1
votes
1answer
972 views
create a company to make money by winning Kaggle competition [closed]
I am thinking of creating a data science company (team) that aims to make money by winning Kaggle competitions. It will be actually a onsite data science learning service but I want to create the ...
2
votes
1answer
470 views
What's cooking Kaggle - Improve model
I'm participating in a Kaggle contest "What's cooking". The goal is to know wich kind of cuisine we have, depending on some ingredients. So it's a multiclass classification problem. I have an existing ...
1
vote
0answers
215 views
non-linear optimization for a linear classifier? (scikit-learn)
Using scikit-learn, why would you use bfgs optimization which is non-linear for a linear classifier as logistic regression? I am confused. Does the optimization method finds the optimum of the chosen ...
2
votes
1answer
332 views
Finding parameters with extreme values (classification with scikit-learn)
I am currently working with the forest cover type prediction from Kaggle, using classification models with scikit-learn. My main purpose is learning about the different models, so I don't pretend to ...
12
votes
1answer
5k views
Hashing Trick - what actually happens
When ML algorithms, e.g. Vowpal Wabbit or some of the factorization machines winning click through rate competitions (Kaggle), mention that features are 'hashed', what does that actually mean for the ...
8
votes
2answers
6k views
Why does Gradient Boosting regression predict negative values when there are no negative y-values in my training set?
As I increase the number of trees in scikit learn's GradientBoostingRegressor, I get more negative predictions, even though there are no negative values in my ...
