Questions tagged [kaggle]
Relating to Kaggle competitions, datasets, or kernels.
78
questions
0
votes
1answer
12 views
Python and Titanic competition how to get the median of specific range of values where class is 3
I am trying to solve Kaggle's titanic competition. In the test set, there is only 1 row having Fare value as null. It's so easy to replace it with median or average of all Fare values.
But I am ...
0
votes
0answers
10 views
box plot and the anomaly detection?
i'm doing a classification problem with 50000 rows × 5000 columns of dataset.
calssification label is 300 labels
1.
This is the few example of box plot of some feature.
what can I inference from ...
-1
votes
1answer
9 views
Meaning of 'hue" in seaborn [closed]
I know what "hue" does a little
I'm studying kaggle and the image is about bike sharing demand analysis
What I want to know is
shouldn't the second images's sum of each point's y axis be the first ...
2
votes
1answer
30 views
Importing .ipnyb file from Kaggle into local Jupyter
Total beginner question here, please let me know if it would be more appropriate somewhere else.
I just created my first iPython notebook in Kaggle and I downloaded the ipnyb file. Now I have ...
2
votes
1answer
43 views
Kaggle Titanic submission score is higher than local accuracy score
This is the starter challenge, Titanic. The original question I posted on Kaggle is here. However, nobody really gives any insightful advice so I am turning to the powerful Stackoverflow community.
...
0
votes
1answer
15 views
How to define the adequate cash prize sizing for hosting a Kaggle or similar compeition?
If you take Kaggle as a well known example of data science competition size, how do you know what is an adequate budget for the cash prize size? At least to determine an order of magnitude, given I am ...
1
vote
0answers
72 views
Load in many files from google drive into colab
I am trying to load in 30k images (600mb) from Google drive into Google Colaboratory to further process them with Keras/PyTorch.
Therefore I have first mounted my Google drive using:
...
0
votes
0answers
34 views
How to analyzes seaborn's regplot of features from kaggle's houses prices and decide to remove a specific feature?
As a machine learning beginner, I am trying my best to, to solve kaggle's houses prices competition.
I am doing pretty well. Some of the fields are confusing.
The data set contains about 80 features,...
0
votes
1answer
32 views
KNN scoring low compared to Logistic regression in MNIST challenge
KNN gives me a score of 0.76100 while it shows 94% accuracy for my training data (splitted with test_size =0.3) in my jupyter notebook while logistic regression gives me a score of 0.91485 with an ...
0
votes
0answers
13 views
How can I update the Kaggle Metadata file via Python?
I have a Kaggle dataset, that i want to automatically update via a python script from my pc. I am thinking about moving this to an online server later on, but for now, I will update this manually ...
0
votes
1answer
45 views
Python can't take input while using functions
While building my model, I figured that it makes sense to reuse some of the code that I've been using for the train dataset, on the test set as well so I took the code performing mutual operations ...
1
vote
0answers
37 views
Scalable Data Science Pipeline
I was looking at this repository (https://github.com/jeffheaton/jh-kaggle-util) and was wondering if there's a better approach to creating a scalable machine learning pipeline for data science ...
0
votes
1answer
23 views
Is there any kaggle competition for finding the feature for affecting revenue? [closed]
I have a question about finding the most significant feature of the data that affects the company revenue. I have data set that contains car share company data (car model, completed trips, lead_time, ...
0
votes
1answer
27 views
What should be the criteria to select features using correlation factors between features? [duplicate]
For the titanic dataset, I have done some feature engineering (one-hot encoded the features) and now I have developed a heatmap to view the correlation between different features.
I'm not able to ...
2
votes
3answers
170 views
Should I perform cross validation only on the training set?
I am working with a dataset that I downloaded from Kaggle. The data set is already divided into two CSVs for Train and Test.
I built a model using the training set because I imported the train CSV ...
1
vote
0answers
29 views
How do I handle division by 0 in Kaggle?
I have written a RNN algorithm in Python/IDLE and ran it. It works and is successful. My dataset is large so I wanted to run it using Kaggle's computers, rather than my laptop. However, when I copied ...
1
vote
1answer
53 views
What is wrong with the below code? [closed]
I have been working on a project which i took from kaggle. I didn't get the result as mentioned in the website. What am I doing wrong here?
...
1
vote
1answer
57 views
How to use Random Forest to reduce dimensions
I am working on the Boston competition on Kaggle and at the moment I am trying to use Random Forest to find the columns with the highest correlation with the target variable ...
3
votes
1answer
531 views
How to automate ANOVA in Python
I am at the dimensionality reduction phase of my model. I have a list of categorical columns and I want to find the correlation between each column and my continuous ...
0
votes
1answer
43 views
How to find the mean of a column relative to another column?
I am working on the Boston house price prediction. I have a column named GarageYrBlt that holds the year the garage was built for a specific house. My assumption ...
0
votes
1answer
365 views
How to handle missing date data?
I have a column named GarageYrBlt which just lists the year the garage of that house was built. I have one nan value for this ...
0
votes
0answers
156 views
Meaning of confidence interval in seaborn barplot
I'm working with titanic data.I'm using seaborn barplot to understand the data
so what this line means?I know it's 95% confidence interval,but how to understand this graph some of the line is long ...
0
votes
2answers
258 views
How to use the fillna method in a for loop
I am working on a housing dataset. In a list of columns (Garage, Fireplace, etc), I have values called NA which just means that the particular house in question ...
0
votes
1answer
736 views
Dataset columns throwing KeyError
For some reason, the columns in my dataset are throwing the following KeyError:
...
0
votes
1answer
90 views
Why n-split is not possible for a dataframe with KFold?
On running below code on python 3.7, I am getting the following response:
'DataFrame' object has no attribute 'n_splits'.
How to get rid of this?
...
1
vote
0answers
61 views
Face Landmark Detection Solution
Lately I have been working on image classification problems but just recently I tried a new type of Problem on Kaggle.
I have normalized image data(X) by dividing with 255 and also the keypoints ...
0
votes
1answer
47 views
Python Script using pandas to plot histograms between the features
I am working around with data from Kaggle : Titanic Competition dataset.
Script
...
1
vote
2answers
852 views
Binary encoding and its interpretation in Python
I have a column named Street that has 2 values: Paved and Gravel. Here is what print(train[binary_columns[0]].unique().tolist())...
4
votes
1answer
74 views
How to automate the encoding process?
I am working on the Boston challenge hosted on Kaggle and I'm still refining my features. Looking at the dataset, I realize that some columns need to be encoded in binary, some encoded in decimals (...
3
votes
2answers
1k views
one-hot-encoding categorical data gives error
I am currently working on the Boston problem hosted on Kaggle. The dataset is nothing like the Titanic dataset. There are many categorical columns and I'm trying to one-hot-encode these columns. I'...
2
votes
3answers
139 views
Logistic Regression doesn't predict for the entire test set
I am working through Kaggle's Titanic competition. I am mostly done with my model but the problem is that the logistic regression model does not predict for all of 418 rows in the test set but ...
0
votes
2answers
34 views
Changing categorical data to binary data is not reflected on the dataset
I am working through the Titanic competition. This is my code so far:
...
0
votes
1answer
2k views
Import data from google drive to Kaggle Kernel
I want to import a csv file from google drive . I tried using the link in add dataset tab but it is taking some thing else as "Open". Please see the image.
0
votes
0answers
56 views
Actually using scipy.signal.stft multidimensional array as a feature
I'm trying to improve my score in the LANL Earthquake Prediction challenge on Kaggle extracting more features from the acoustic data through STFT transforming. Eventually I've found this well written ...
0
votes
0answers
22 views
OSError in Kaggle using [Fastai]
I am trying to use fastai (v 1.0.52) in Kaggle and have been getting the following error very time call the tabular_learner or conv_learner
This error does not occurs when using ...
1
vote
1answer
54 views
Printing all files' names from a folder (Kaggle kernel)
train_dir= '../input/train'
for file in os.listdir(train_dir):
print(file)
I am trying to get all the file names in a directory called "train", from a ...
1
vote
2answers
1k views
Is numpy.corrcoef() enough to find correlation?
I am currently working through Kaggle's titanic competition and I'm trying to figure out the correlation between the Survived column and other columns. I am using <...
1
vote
1answer
2k views
Pandas throwing “Error tokenizing data. C error” while loading data sets from URL
I am trying to work on the Titanic competition to get hands on experience with data science & machine learning. I tried to load up the datasets from GitHub but pandas threw the following error:
<...
0
votes
0answers
154 views
How to learn LB probing?
Recently, I have joined a kaggle competition, Don't overfit 2.
And the 2nd place person has shared with their discussions and kernels, which use LB Probing to get such high rank.
BUT I still get ...
1
vote
1answer
27 views
Modelling regressor of historic data on basic features test set
I am using a historical dataset of sales of items in shops and I need to predict the sales of the next month of the period.
I performed feature engineering, and now I have 10 features in the train ...
1
vote
1answer
254 views
How to use Kaggle Api in Google Colab for directly using dataset?
I know that we can use Kaggle's api directly in google colab which downloads the dataset. The commands are :
...
1
vote
1answer
187 views
1
vote
1answer
2k views
merge 2 dataframe with Memory Error
trying to merge 2 data frame size with (13647309, 48)
and I'm using 32 memory.
df_train = train.merge(train_lag,on=['ncodpers','int_date'], how='left')
after I ...
2
votes
2answers
191 views
kaggle Titanic what is GP?
sometimes I see the kernel with GP programming.
but without explanation, they put some random number with unknown equation
Here is some part of GP programming
...
0
votes
0answers
63 views
Kaggle - Kernel dies continuously
I keep receiving the error message "The kernel appears to have died" when running a simple command such as pd.read_csv(.......) on my Kaggle kernel.
I am not quite sure what the issue.
Any thoughts ...
1
vote
1answer
95 views
requesting password while git push in jupyter notebook
I am trying to push the commited changes from kaggle kernels using jupyter notebook but while pushing the changes git asking me for username and I really don't know how to give username as it seems ...
1
vote
1answer
61 views
How to do feature analyzing : pandas groupby(). mean
I'm analyzing Titanic data from Kaggle1 with a kind of guiding book. In the book, feature analyzing about the relationship between Pclass data and Survived data is done like below.
...
2
votes
2answers
184 views
What is the difference between public test and private test on Kaggle
I am trying to use the datasets from a competition held on Kaggle in which the dataset contains fer2013.csv file having columns emotion, pixels, and usage where usage contains 3 values i.e "training", ...
1
vote
0answers
543 views
Issues with pandas chunk merge
I'm trying to solve a kaggle competition - https://www.kaggle.com/c/ga-customer-revenue-prediction
Since the data is too much to fit in memory at once, I'm trying to clean, process and save data back ...
3
votes
1answer
659 views
Hyperparameter tuning for stacked models
I'm reading the following kaggle post for learning how to incorporate model stacking
http://blog.kaggle.com/2016/12/27/a-kagglers-guide-to-model-stacking-in-practice/
in ML models. The structure ...
