Questions tagged [beginner]

For questions which concern getting started in Data Science or any of its related subdomains.

Filter by
Sorted by
Tagged with
-1
votes
1answer
21 views

Inputting Data for Machine Learning in PyTorch

I have scoured the internet and documentation, but have not yet been able to find a simple explanation of how to load data and/or simply type data into pytorch. I am just learning this library, and I ...
0
votes
0answers
9 views

Piecewise-linear activation function definition doesn't correspond to graph found in textbook

This question is a duplicate of this question on StackOverflow, but it hasn't been answered in 2 years, which is why I'm re-posting it. If this isn't an appropriate way to go about this, please let me ...
0
votes
1answer
36 views

On Python is the `i` variable defined inherently? [closed]

I am new to this whole landscape, please need some hand holding at first, I can't find a beginner section. Can someone please tell me if i is defined inherently in ...
2
votes
1answer
20 views

How to define a neural model as linear or non linear

TL;DR: in what sense is the model of a neuron seen in the image above nonlinear? In chapter 1, section 1.3 MODELS OF A NEURON of Simon Haykin's Neural Networks book, the standard model of a single ...
0
votes
1answer
24 views

What is the difference between the value -99 and NaN in a data column?

I am new to data science. I was looking into some datasets and I saw some values like -99, which I discovered later that it means that there is a missing value. Does this mean the same thing as NaN? ...
1
vote
1answer
34 views

Getting into data science and NLP outside of university

I'm almost 40. Four months ago I resigned from work to rest from stressing work and change my carerr direction. It took me some time to understand what I want to do and only then I started to learn ...
-1
votes
1answer
36 views

'Feature' definition

Precisely, what is a feature? Is it an attribute/property name or its value? E.g. would features examples be "name", "adress", ...? Or "Dorothy", "123 YellowBrick Road"?? If it is a property name, ...
0
votes
2answers
27 views

Inspect false classified

Recently, I was able to train a simple classification algorithm (my first ML-Project) and I even got a pretty satisfying precision score. Now I am looking for a way to inspect, which datapoints in ...
2
votes
0answers
23 views

How does permutation of training data improve convergence time when training a perceptron or neural network model? [duplicate]

I'm currently studying some basic concepts regarding Deep Learning and Neural Networks with this material. When discussing the training algorithm for a perceptron, the author states that looping ...
2
votes
1answer
36 views

Mapping of categorical features into binary indicator features

I am currently reading an introductory machine learning book by Daumé (ch. 03, p. 30) and when discussing the mapping of categorical features with "n" possible values into "n" binary indicator ...
0
votes
0answers
22 views

Help with Tensorflow 2.0 beta not learning

Have a tabular data set and have done some graphical exploration with Orange 3. Attempted NN regression with Keras/TensorFlow 2.0 beta on Python 3.6.7. The problem is that TF 2.0 is not "learning" (...
0
votes
1answer
27 views

My network optimises for mean_squared_error, but the predictions are useless

After going through the tutorials of tensorflow I decided to do my own project. For this I did the following: I have scraped movie reviews from a polish site called filmweb. I got a dataset o 5400 ...
0
votes
1answer
146 views

Prerequisites for openCV [closed]

I am looking to start learning openCV to perform a car detection program. Should I know data science and/or machine learning stuff before going for openCV? If not, where can I start learning openCV ...
0
votes
2answers
43 views

Tips for checking data integrity / data sanity?

I've read a few vague articles and watched a couple of YouTube videos on data integrity and data sanity, but none of them have mentioned ways to actually check these on datasets. I am interested in ...
2
votes
1answer
25 views

Representing state in Q-Learning

I have a fairly simple game in which I wish to use Q-learning to train an agent, but I have some questions regarding state representation. I'm new to RL so bare with me: If you have a game where you ...
1
vote
2answers
58 views

Is Mac OS the most suitable OS for a beginner Data Scientist? [closed]

As far as I understand a data scientist should learn both Excel and Bash. And the golden mean is this case is Mac OS, because it has both. And later I can install Ubuntu on Macbook.
0
votes
0answers
17 views

Autoencoder and Dimensionality

I'm pretty confused with the input/output/dense portion of an autoencoder. So my data consists of a numpy array of a 9 categorical features which have all been one hot encoded. So the input would ...
1
vote
1answer
54 views

Why can't I use data augmentation with a pretrained convnet?

Reading Deep Learning with Python by François Chollet. In section 5.3.1, we've instantiated a pretrained convnet, VGG16, and are given two options to proceed: A) Running the convolutional base over ...
0
votes
1answer
18 views

Train, test and submission files - what am I supposed to do with all of them?

this might be very beginner's question. I'm working on Kaggle's HomeCredit Default Risk problem which has among others dataset train, test and submission files as can be seen in the link provided. The ...
0
votes
2answers
97 views

How to handle continuous values and a binary target?

This is going to be a very beginner's question. I have a datset of continues features like LoanAmount, LoanDuration(multiclass?), ... ClientIncome, ClientFreeSources, etc. and a binary target whether ...
1
vote
1answer
27 views

MOOC importance [closed]

My problem is that at our masters program we have already been taught R, Statistics, Neural nets, Python (pandas, sklearn, etc). Also my master thesis is directly related to Deep Learning and Computer ...
1
vote
1answer
41 views

Data Exploration Tips & Tools

I am pretty new to the Data Science world and I am looking for some advices. One of the tasks that I have to do, is to go alone at a customer place for few days/weeks and dig into their data lake to ...
4
votes
4answers
753 views

Data Science Career: From Researcher To Data Scientist

I’m currently working as a Research Assistant in Computer Science, specializing in both Human-Computer Interaction (HCI) and Health Informatics (HI) fields. As part of my role, I collect data from ...
1
vote
0answers
27 views

What are the introductory mathematics courses that are most pertinent to machine learning?

To provide more context to this question, I have found the following list of courses in order to learn calculus: Course | 18.01.1x | edX Course | 18.01.2x | edX Course | 18.01.3x | edX I also have ...
2
votes
1answer
2k views

How to apply class weight to a multi-output model?

I have a model with 2 categorical outputs. The first output layer can predict 2 classes: [0, 1] and the second output layer can predict 3 classes: [0, 1, 2]. How can I apply different class weight ...
0
votes
1answer
35 views

Timeseries of odds in race - how to pick a model

Being new to AI/ML I'd like some pointers to where to begin. I got data from horse races. Specifically, I got the odds for each runner during the race - ca 5 times per second. ...
1
vote
0answers
58 views

very large difference between cross_val and (multiple) r2 model evaluation

I did submit my first kaggle kernel, on the avocado dataset kernel link, I treated it like I should predict the avocado price so I splitted the dataset in a train & test set, fitted the model and ...
3
votes
2answers
433 views

Can a single-layer ANN get XOR wrong?

I'm still pretty new to artificial neural networks. While I've played around with TensorFlow, I'm now trying to get the basics straight. Since I've stumbled upon a course which explains how to ...
4
votes
0answers
85 views

Which technologies and skills should the new generation of data scientists learn? [closed]

Having looked at various job requirements, I see that a lot of them require you to be an expert in Hadoop, use Spark but I am wondering how useful are these technologies (due to my lack of ...
0
votes
1answer
84 views

Chi-squared for continuous variables

I am using chi-squared to determine feature importance as I select features to train a supervised ML model. I create a contingency table for the feature/target, and feed this contingency table into ...
2
votes
2answers
5k views

Determine useful features for machine learning model

I am working with a dataset with hundreds of features. I wish to create a simple machine learning model using 7-10 features from the original dataset. My question is this: What quantitative metrics ...
1
vote
1answer
44 views

Where to upload a source text to datamine matching contents with constraint?

I am even unsure if this is the correct category. I have very minimal programming knowledge. I am curious how can I get started for a project I have in mind. I want to upload a file to a webcrawler ...
-1
votes
2answers
62 views

Guidance to create a machine learning alg to find multiple overlapping date over multiple period

i have a dataset of work period from a lot of people during multiple years and i would like to find the overlapping date between these periods, the data would look something like this: ...
2
votes
5answers
1k views

How to compare Timeseries Sequences?

I have multiple time series sequences and I want for each new time series to find the most alike old one. I found that I can use the sum of errors between points. Is this a good approach? Is there a ...
0
votes
2answers
75 views

Need sugestion to accuire a job in data mining [closed]

I interested in data mining specialization and have been enrolled in data mining specialization course at Coursera by University of Illinois. This specialization course contains four parts. The very ...
4
votes
0answers
38 views

Learning a logical function with a 2 layer BDN network - manual weight setting rule question?

So I am trying to construct a 2-layer network of binary decision neurons as proposed by McCullough and Pitts (1943) to learn a logical function (a composition of AND's and OR's) such as: $((\neg x_1\...
5
votes
2answers
2k views

What is a policy in machine learning?

While I was reading the paper "Grounded Action Transformation for Robot Learning in Simulation", I came across the term "policy". Could someone explain to me what that actually is (in general and in ...
1
vote
0answers
122 views

ElasticSearch for data scientists [closed]

This is to seek career advice for a data scientist. What pertains within the role of data scientist and what does not regarding ElasticSearch. Does backend development for ElasticSearch using ...
1
vote
0answers
57 views

MNIST digits… And what technique to find ZIP code on the envelope?

What techniques are currently available for e.g. locating the ZIP code on the envelope and cutting it to single digits prior to feeding them to digit recognition algorithm (trained on MNIST dataset)? ...
2
votes
0answers
43 views

Text recognition within images [closed]

I am a beginner and need further help to elaborate following problem. I want to "read" text from images. In my problem setting, the text on all the images has the same structure. I found this solution ...
1
vote
1answer
127 views

How to get started? [closed]

I am currently working as a registered nurse, but I have decided that I can no longer do this as a career. I was essentially forced by my parents to go into the health field. After doing research on ...
0
votes
1answer
2k views

How Natural language processing and elasticsearch are related

I got call from a recruiter for an elasticsearch job. I am not sure how these 2 are related. Can anyone suggest and provide example use case?
0
votes
1answer
2k views

Create similarity matrix

I have a training set and a testing set of vectors. All the vectors are labeled. For each labeled vector in the testing set, there are 3 vectors in the training set with the same label. I'm using ...
2
votes
0answers
23 views

Mapping a set of corrupted strings to the correct ones

I am fairly new into Data Science but encoutered it before. The following problem troubles me and i hope you guys can point me in the right direction. The input are some strings where some carry the ...
1
vote
1answer
49 views

Recording Data of my learning progress

I'm just starting out with learning about Data Science and programming through various online course. Was thinking a good first project would be a to create a log of what I'm learning and how long ...
1
vote
2answers
191 views

Advice on how to get started for someone a bit later in life? [closed]

I am 33 years old and graduated in 2006 from college with a degree in analytic philosophy. For a long time I thought that I was going to get a phd in phil and teach but that dream is long gone, and I ...
3
votes
1answer
628 views

Is there a comprehensive learning plan for a self-teaching beginner in data science with no programming background? [closed]

Situation I want to be a data scientist, but I have no programming or maths background. I have more than the basic understanding of python which I taught myself over a couple of months. Right now I ...
2
votes
2answers
149 views

What could be the value of having a business analyst in a data science team?

Correct me if I am wrong, but while business analysts are often an important role in software delivery teams, but it seems not the case in the data science field. Commonly available data scientist ...
1
vote
2answers
121 views

String classification beginner question

I analyse log files, very often there are strings that only differ on few places and are same every where else, I am trying to find the generic string that they most likely belong to e.g. : ...
0
votes
1answer
58 views

Why my Decision Tree Model is not further bifurcated in to Age

I've created a Decision Tree Model for expected candidates that buyed Villa. Though the Drilling down Green highlighted box, show data has Age in it. Question- But why my model is not bifurcating it ...