Questions tagged [kaggle]
Relating to Kaggle competitions, datasets, or kernels.
72
questions
0
votes
0answers
8 views
Load in many files from google drive into colab
I am trying to load in 30k images (600mb) from Google drive into Google Colaboratory to further process them with Keras/PyTorch.
Therefore I have first mounted my Google drive using:
...
0
votes
0answers
20 views
How to analyzes seaborn's regplot of features from kaggle's houses prices and decide to remove a specific feature?
As a machine learning beginner, I am trying my best to, to solve kaggle's houses prices competition.
I am doing pretty well. Some of the fields are confusing.
The data set contains about 80 features,...
0
votes
1answer
29 views
KNN scoring low compared to Logistic regression in MNIST challenge
KNN gives me a score of 0.76100 while it shows 94% accuracy for my training data (splitted with test_size =0.3) in my jupyter notebook while logistic regression gives me a score of 0.91485 with an ...
0
votes
0answers
10 views
How can I update the Kaggle Metadata file via Python?
I have a Kaggle dataset, that i want to automatically update via a python script from my pc. I am thinking about moving this to an online server later on, but for now, I will update this manually ...
0
votes
1answer
43 views
Python can't take input while using functions
While building my model, I figured that it makes sense to reuse some of the code that I've been using for the train dataset, on the test set as well so I took the code performing mutual operations ...
1
vote
0answers
34 views
Scalable Data Science Pipeline
I was looking at this repository (https://github.com/jeffheaton/jh-kaggle-util) and was wondering if there's a better approach to creating a scalable machine learning pipeline for data science ...
0
votes
1answer
21 views
Is there any kaggle competition for finding the feature for affecting revenue? [closed]
I have a question about finding the most significant feature of the data that affects the company revenue. I have data set that contains car share company data (car model, completed trips, lead_time, ...
0
votes
1answer
26 views
What should be the criteria to select features using correlation factors between features? [duplicate]
For the titanic dataset, I have done some feature engineering (one-hot encoded the features) and now I have developed a heatmap to view the correlation between different features.
I'm not able to ...
2
votes
3answers
87 views
Should I perform cross validation only on the training set?
I am working with a dataset that I downloaded from Kaggle. The data set is already divided into two CSVs for Train and Test.
I built a model using the training set because I imported the train CSV ...
1
vote
0answers
29 views
How do I handle division by 0 in Kaggle?
I have written a RNN algorithm in Python/IDLE and ran it. It works and is successful. My dataset is large so I wanted to run it using Kaggle's computers, rather than my laptop. However, when I copied ...
1
vote
1answer
53 views
What is wrong with the below code? [closed]
I have been working on a project which i took from kaggle. I didn't get the result as mentioned in the website. What am I doing wrong here?
...
1
vote
1answer
49 views
How to use Random Forest to reduce dimensions
I am working on the Boston competition on Kaggle and at the moment I am trying to use Random Forest to find the columns with the highest correlation with the target variable ...
3
votes
1answer
349 views
How to automate ANOVA in Python
I am at the dimensionality reduction phase of my model. I have a list of categorical columns and I want to find the correlation between each column and my continuous ...
0
votes
1answer
40 views
How to find the mean of a column relative to another column?
I am working on the Boston house price prediction. I have a column named GarageYrBlt that holds the year the garage was built for a specific house. My assumption ...
0
votes
1answer
183 views
How to handle missing date data?
I have a column named GarageYrBlt which just lists the year the garage of that house was built. I have one nan value for this ...
0
votes
0answers
105 views
Meaning of confidence interval in seaborn barplot
I'm working with titanic data.I'm using seaborn barplot to understand the data
so what this line means?I know it's 95% confidence interval,but how to understand this graph some of the line is long ...
0
votes
2answers
132 views
How to use the fillna method in a for loop
I am working on a housing dataset. In a list of columns (Garage, Fireplace, etc), I have values called NA which just means that the particular house in question ...
0
votes
1answer
362 views
Dataset columns throwing KeyError
For some reason, the columns in my dataset are throwing the following KeyError:
...
0
votes
1answer
77 views
Why n-split is not possible for a dataframe with KFold?
On running below code on python 3.7, I am getting the following response:
'DataFrame' object has no attribute 'n_splits'.
How to get rid of this?
...
1
vote
0answers
19 views
Face Landmark Detection Solution
Lately I have been working on image classification problems but just recently I tried a new type of Problem on Kaggle.
I have normalized image data(X) by dividing with 255 and also the keypoints ...
0
votes
1answer
39 views
Python Script using pandas to plot histograms between the features
I am working around with data from Kaggle : Titanic Competition dataset.
Script
...
1
vote
2answers
558 views
Binary encoding and its interpretation in Python
I have a column named Street that has 2 values: Paved and Gravel. Here is what print(train[binary_columns[0]].unique().tolist())...
4
votes
1answer
69 views
How to automate the encoding process?
I am working on the Boston challenge hosted on Kaggle and I'm still refining my features. Looking at the dataset, I realize that some columns need to be encoded in binary, some encoded in decimals (...
3
votes
2answers
979 views
one-hot-encoding categorical data gives error
I am currently working on the Boston problem hosted on Kaggle. The dataset is nothing like the Titanic dataset. There are many categorical columns and I'm trying to one-hot-encode these columns. I'...
2
votes
3answers
110 views
Logistic Regression doesn't predict for the entire test set
I am working through Kaggle's Titanic competition. I am mostly done with my model but the problem is that the logistic regression model does not predict for all of 418 rows in the test set but ...
0
votes
2answers
28 views
Changing categorical data to binary data is not reflected on the dataset
I am working through the Titanic competition. This is my code so far:
...
0
votes
1answer
1k views
Import data from google drive to Kaggle Kernel
I want to import a csv file from google drive . I tried using the link in add dataset tab but it is taking some thing else as "Open". Please see the image.
0
votes
0answers
43 views
Actually using scipy.signal.stft multidimensional array as a feature
I'm trying to improve my score in the LANL Earthquake Prediction challenge on Kaggle extracting more features from the acoustic data through STFT transforming. Eventually I've found this well written ...
0
votes
0answers
21 views
OSError in Kaggle using [Fastai]
I am trying to use fastai (v 1.0.52) in Kaggle and have been getting the following error very time call the tabular_learner or conv_learner
This error does not occurs when using ...
1
vote
1answer
40 views
Printing all files' names from a folder (Kaggle kernel)
train_dir= '../input/train'
for file in os.listdir(train_dir):
print(file)
I am trying to get all the file names in a directory called "train", from a ...
1
vote
2answers
802 views
Is numpy.corrcoef() enough to find correlation?
I am currently working through Kaggle's titanic competition and I'm trying to figure out the correlation between the Survived column and other columns. I am using <...
1
vote
1answer
1k views
Pandas throwing “Error tokenizing data. C error” while loading data sets from URL
I am trying to work on the Titanic competition to get hands on experience with data science & machine learning. I tried to load up the datasets from GitHub but pandas threw the following error:
<...
0
votes
0answers
135 views
How to learn LB probing?
Recently, I have joined a kaggle competition, Don't overfit 2.
And the 2nd place person has shared with their discussions and kernels, which use LB Probing to get such high rank.
BUT I still get ...
1
vote
1answer
24 views
Modelling regressor of historic data on basic features test set
I am using a historical dataset of sales of items in shops and I need to predict the sales of the next month of the period.
I performed feature engineering, and now I have 10 feature in the train ...
1
vote
1answer
208 views
How to use Kaggle Api in Google Colab for directly using dataset?
I know that we can use Kaggle's api directly in google colab which downloads the dataset. The commands are :
...
1
vote
1answer
135 views
1
vote
1answer
2k views
merge 2 dataframe with Memory Error
trying to merge 2 data frame size with (13647309, 48)
and I'm using 32 memory.
df_train = train.merge(train_lag,on=['ncodpers','int_date'], how='left')
after I ...
2
votes
2answers
177 views
kaggle Titanic what is GP?
sometimes I see the kernel with GP programming.
but without explanation, they put some random number with unknown equation
Here is some part of GP programming
...
0
votes
0answers
54 views
Kaggle - Kernel dies continuously
I keep receiving the error message "The kernel appears to have died" when running a simple command such as pd.read_csv(.......) on my Kaggle kernel.
I am not quite sure what the issue.
Any thoughts ...
1
vote
1answer
82 views
requesting password while git push in jupyter notebook
I am trying to push the commited changes from kaggle kernels using jupyter notebook but while pushing the changes git asking me for username and I really don't know how to give username as it seems ...
1
vote
1answer
56 views
How to do feature analyzing : pandas groupby(). mean
I'm analyzing Titanic data from Kaggle1 with a kind of guiding book. In the book, feature analyzing about the relationship between Pclass data and Survived data is done like below.
...
2
votes
2answers
148 views
What is the difference between public test and private test on Kaggle
I am trying to use the datasets from a competition held on Kaggle in which the dataset contains fer2013.csv file having columns emotion, pixels, and usage where usage contains 3 values i.e "training", ...
1
vote
0answers
475 views
Issues with pandas chunk merge
I'm trying to solve a kaggle competition - https://www.kaggle.com/c/ga-customer-revenue-prediction
Since the data is too much to fit in memory at once, I'm trying to clean, process and save data back ...
3
votes
1answer
561 views
Hyperparameter tuning for stacked models
I'm reading the following kaggle post for learning how to incorporate model stacking
http://blog.kaggle.com/2016/12/27/a-kagglers-guide-to-model-stacking-in-practice/
in ML models. The structure ...
1
vote
1answer
156 views
Can I make kaggle kernels read directly from my computer?
For some reason jupyter notebooks never work the same as kaggle kernels for me. I want to use kaggle kernels but the downside is I don't know how to make it read from a file on the computer like a ...
1
vote
0answers
295 views
Comparing XGBR with CatBoost performance
I saw on a CatBoost site that it supposed to outperform any other boosted training model and decided to try it myself on a Kaggle's https://www.kaggle.com/c/house-prices-advanced-regression-techniques....
1
vote
0answers
205 views
How decision trees work in Python
I am new to the field of machine learning. I have just recently learnt Decision Trees and started solving Titanic Survival problem from Kaggle Competition. I understood the algorithm behind decision ...
3
votes
2answers
88 views
Dummy variable for Categorical values
The question is in reference to solution of Titanic survival predictionat kaggle . As many have did the similar kind of feature extraction,
They have converted some of the numerical features (Age, ...
3
votes
4answers
602 views
When should ordinal data be represented catigorically and when as integer?
I am doing the Kaggle competition House Prices: Advanced Regression Techniques to learn more about data analysis. I would like to apply multiple models to the data(Regularized LR, Random Forests, ...
3
votes
1answer
8k views
“concat” mode can only merge layers with matching output shapes except for the concat axis
I have a function I am trying to debug which is yielding the following error message:
ValueError: "concat" mode can only merge layers with matching output
shapes except for the concat axis. Layer ...
