Questions tagged [beginner]

For questions which concern getting started in Data Science or any of its related subdomains.

14 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
0answers
55 views

Learning a logical function with a 2 layer BDN network - manual weight setting rule question?

So I am trying to construct a 2-layer network of binary decision neurons as proposed by McCullough and Pitts (1943) to learn a logical function (a composition of AND's and OR's) such as: $((\neg x_1\...
2
votes
0answers
46 views

How to deal with large datasets?

I have some experience with data science but I wanted some insight on how to deal with a very large dataset. I understand simply downloading it to your computer is not plausible so where do you even ...
2
votes
0answers
24 views

Mapping a set of corrupted strings to the correct ones

I am fairly new into Data Science but encoutered it before. The following problem troubles me and i hope you guys can point me in the right direction. The input are some strings where some carry the ...
1
vote
0answers
12 views

Should I use a numeric scale or like/dislike for a ratings and recommendation engine?

I've very new to data science and am not sure what terms to even search for, so please forgive any ignorance. Let's assume that I'm building a movie recommendation engine. A user will rate a subset ...
1
vote
0answers
126 views

very large difference between cross_val and (multiple) r2 model evaluation

I did submit my first kaggle kernel, on the avocado dataset kernel link, I treated it like I should predict the avocado price so I splitted the dataset in a train & test set, fitted the model and ...
1
vote
0answers
87 views

MNIST digits… And what technique to find ZIP code on the envelope?

What techniques are currently available for e.g. locating the ZIP code on the envelope and cutting it to single digits prior to feeding them to digit recognition algorithm (trained on MNIST dataset)? ...
1
vote
0answers
206 views

Hadoop/Pig Aggregate Data

I am working on a project with two data sets. A time vs. speed data set (let's call it traffic), and a time vs. weather data set (called weather). I am looking to find a correlation between these ...
0
votes
1answer
18 views

Model with 2 datasets: combine time series data and statistics

I am new to data science modelling so apologies if using wrong terminology in advance. I have a standard time series dataset of historical prices which is used to train/test a simple Random Forest ...
0
votes
1answer
29 views

kMean clustering for recommendation

I have a file with 50000 rows from a library platform. Each individual row saves a user, and shows the order in which the user, has selected. The books could be from various categories (e.g. roman, ...
0
votes
0answers
17 views

Where to begin with high throughput regression analysis with Python?

I have been doing some multiple regression on a medium sized data set. 5 predictor variables, about 150 data points. OLS, L1 and L2 regularisation. I've defined interaction parameters and added them ...
0
votes
0answers
13 views

Using lmer in R Studio with a large data set

I have a very large data set (127,000 observations, each point has 22 variables). I am only interested in 7 of those variables. The two dependent variables (linear and rotational acceleration) are ...
0
votes
0answers
20 views
0
votes
0answers
22 views

What type of Machine Learning to use?

I have a beam loaded with random loads, for each timestep I obtain accelerations and maximum moments on the beam. My prediction should receive a timeseries of accelerometer data and output the ...
0
votes
2answers
38 views

Inspect false classified

Recently, I was able to train a simple classification algorithm (my first ML-Project) and I even got a pretty satisfying precision score. Now I am looking for a way to inspect, which datapoints in ...