Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [beginner]

For questions which concern getting started in Data Science or any of its related subdomains.

1
vote
1answer
23 views

MOOC importance [closed]

My problem is that at our masters program we have already been taught R, Statistics, Neural nets, Python (pandas, sklearn, etc). Also my master thesis is directly related to Deep Learning and Computer ...
1
vote
1answer
32 views

Data Exploration Tips & Tools

I am pretty new to the Data Science world and I am looking for some advices. One of the tasks that I have to do, is to go alone at a customer place for few days/weeks and dig into their data lake to ...
4
votes
4answers
711 views

Data Science Career: From Researcher To Data Scientist

I’m currently working as a Research Assistant in Computer Science, specializing in both Human-Computer Interaction (HCI) and Health Informatics (HI) fields. As part of my role, I collect data from ...
1
vote
0answers
22 views

What are the introductory mathematics courses that are most pertinent to machine learning?

To provide more context to this question, I have found the following list of courses in order to learn calculus: Course | 18.01.1x | edX Course | 18.01.2x | edX Course | 18.01.3x | edX I also have ...
0
votes
0answers
12 views

Word embedding based on a tree structure

I need to train a model for MeSH Terms. The similarity metric I want to use is MeSH Tree Structure. Every MeSH term has one or more tree number(s), e.g.: Term, Tree Number(s): ...
0
votes
0answers
63 views

Comparison of Pytorch high level libraries

I have used keras for a few months and it provided me with some very useful high-level api such as it's callbacks. I am now interested in starting using pytorch and i'm interested to be assisted with ...
1
vote
1answer
299 views

How to apply class weight to a multi-output model?

I have a model with 2 categorical outputs. The first output layer can predict 2 classes: [0, 1] and the second output layer can predict 3 classes: [0, 1, 2]. How can I apply different class weight ...
0
votes
1answer
31 views

Timeseries of odds in race - how to pick a model

Being new to AI/ML I'd like some pointers to where to begin. I got data from horse races. Specifically, I got the odds for each runner during the race - ca 5 times per second. ...
1
vote
0answers
34 views

very large difference between cross_val and (multiple) r2 model evaluation

I did submit my first kaggle kernel, on the avocado dataset kernel link, I treated it like I should predict the avocado price so I splitted the dataset in a train & test set, fitted the model and ...
1
vote
0answers
16 views

What are the possibilities with userdata from a vast panel?

I have a panel of a few thousand people that I regularly send surveys to. Throughout the years, I have gathered for every person (legally, of course) their address, age, gender, line of work, family ...
3
votes
2answers
316 views

Can a single-layer ANN get XOR wrong?

I'm still pretty new to artificial neural networks. While I've played around with TensorFlow, I'm now trying to get the basics straight. Since I've stumbled upon a course which explains how to ...
4
votes
0answers
84 views

Which technologies and skills should the new generation of data scientists learn? [closed]

Having looked at various job requirements, I see that a lot of them require you to be an expert in Hadoop, use Spark but I am wondering how useful are these technologies (due to my lack of ...
0
votes
1answer
50 views

Chi-squared for continuous variables

I am using chi-squared to determine feature importance as I select features to train a supervised ML model. I create a contingency table for the feature/target, and feed this contingency table into ...
2
votes
2answers
2k views

Determine useful features for machine learning model

I am working with a dataset with hundreds of features. I wish to create a simple machine learning model using 7-10 features from the original dataset. My question is this: What quantitative metrics ...
1
vote
1answer
31 views

Where to upload a source text to datamine matching contents with constraint?

I am even unsure if this is the correct category. I have very minimal programming knowledge. I am curious how can I get started for a project I have in mind. I want to upload a file to a webcrawler ...
-1
votes
2answers
52 views

Guidance to create a machine learning alg to find multiple overlapping date over multiple period

i have a dataset of work period from a lot of people during multiple years and i would like to find the overlapping date between these periods, the data would look something like this: ...
2
votes
5answers
468 views

How to compare Timeseries Sequences?

I have multiple time series sequences and I want for each new time series to find the most alike old one. I found that I can use the sum of errors between points. Is this a good approach? Is there a ...
0
votes
2answers
66 views

Need sugestion to accuire a job in data mining [closed]

I interested in data mining specialization and have been enrolled in data mining specialization course at Coursera by University of Illinois. This specialization course contains four parts. The very ...
4
votes
0answers
25 views

Learning a logical function with a 2 layer BDN network - manual weight setting rule question?

So I am trying to construct a 2-layer network of binary decision neurons as proposed by McCullough and Pitts (1943) to learn a logical function (a composition of AND's and OR's) such as: $((\neg x_1\...
5
votes
2answers
1k views

What is a policy in machine learning?

While I was reading the paper "Grounded Action Transformation for Robot Learning in Simulation", I came across the term "policy". Could someone explain to me what that actually is (in general and in ...
1
vote
0answers
107 views

ElasticSearch for data scientists [closed]

This is to seek career advice for a data scientist. What pertains within the role of data scientist and what does not regarding ElasticSearch. Does backend development for ElasticSearch using ...
1
vote
0answers
44 views

MNIST digits… And what technique to find ZIP code on the envelope?

What techniques are currently available for e.g. locating the ZIP code on the envelope and cutting it to single digits prior to feeding them to digit recognition algorithm (trained on MNIST dataset)? ...
2
votes
0answers
39 views

Text recognition within images [closed]

I am a beginner and need further help to elaborate following problem. I want to "read" text from images. In my problem setting, the text on all the images has the same structure. I found this solution ...
1
vote
1answer
101 views

How to get started? [closed]

I am currently working as a registered nurse, but I have decided that I can no longer do this as a career. I was essentially forced by my parents to go into the health field. After doing research on ...
0
votes
0answers
76 views

How should I connect neurons to link groups of inputs to 1 output?

So, I want to design a NN, and something I am thinking of is a situation where I have an event, and say, for example, 4 entrants. I want to learn to predict the winner of the event. I have data ...
0
votes
1answer
1k views

How Natural language processing and elasticsearch are related

I got call from a recruiter for an elasticsearch job. I am not sure how these 2 are related. Can anyone suggest and provide example use case?
0
votes
1answer
2k views

Create similarity matrix

I have a training set and a testing set of vectors. All the vectors are labeled. For each labeled vector in the testing set, there are 3 vectors in the training set with the same label. I'm using ...
2
votes
0answers
23 views

Mapping a set of corrupted strings to the correct ones

I am fairly new into Data Science but encoutered it before. The following problem troubles me and i hope you guys can point me in the right direction. The input are some strings where some carry the ...
1
vote
1answer
47 views

Recording Data of my learning progress

I'm just starting out with learning about Data Science and programming through various online course. Was thinking a good first project would be a to create a log of what I'm learning and how long ...
2
votes
2answers
176 views

Advice on how to get started for someone a bit later in life? [closed]

I am 33 years old and graduated in 2006 from college with a degree in analytic philosophy. For a long time I thought that I was going to get a phd in phil and teach but that dream is long gone, and I ...
3
votes
1answer
584 views

Is there a comprehensive learning plan for a self-teaching beginner in data science with no programming background? [closed]

Situation I want to be a data scientist, but I have no programming or maths background. I have more than the basic understanding of python which I taught myself over a couple of months. Right now I ...
2
votes
2answers
133 views

What could be the value of having a business analyst in a data science team?

Correct me if I am wrong, but while business analysts are often an important role in software delivery teams, but it seems not the case in the data science field. Commonly available data scientist ...
1
vote
2answers
108 views

String classification beginner question

I analyse log files, very often there are strings that only differ on few places and are same every where else, I am trying to find the generic string that they most likely belong to e.g. : ...
0
votes
1answer
57 views

Why my Decision Tree Model is not further bifurcated in to Age

I've created a Decision Tree Model for expected candidates that buyed Villa. Though the Drilling down Green highlighted box, show data has Age in it. Question- But why my model is not bifurcating it ...
1
vote
3answers
498 views

How to approach a Data Science case study question?

I recently had a phone interview with a consumer tech company for a quant position. The question was basically, "imagine a facebook style social network site. Six months ago a new feature called '...
4
votes
2answers
11k views

Is there a C library for machine learning algorithms? [closed]

Are there any machine learning libraries for C. Specifically interested in unsupervised learning.
9
votes
3answers
602 views

What knowledge do I need in order to write a simple AI program to play a game?

I'm a B.Sc graduate. One of my courses was 'Introduction to Machine Learning', and I always wanted to do a personal project in this subject. I recently heard about different AI training to play games ...
4
votes
1answer
107 views

How do CNNs use a model and find the object(s) desired?

Background: I'm studying CNN's outside of my undergraduate CS course on ML. I have a few questions related to CNNs. 1) When training a CNN, we desire tightly bounded/cropped images of the desired ...
2
votes
1answer
118 views

Approaching data science [closed]

I'm totally naive to Data Science - that is, the relatively new, somewhat hyped-field that is so popular at the moment. But I'm not naive to data ... as a scientist and researcher I've worked with all ...
3
votes
3answers
585 views

Is a neural network suitable for this application

Apologies if this question is not a suitable format. I am a novice in data science. I have a database of species observation data consisting of ~16 million records. Each record consists of: latitude ...
1
vote
1answer
156 views

What is the best strategy to use on data with many classification labels?

In general, what sort of supervised algorithms and techniques should I use on data that has the following charactersitcs: 2 potential classification labels? 3-5 potential classification labels? 6-10 ...
2
votes
3answers
1k views

Is there any book for modern optimization in Python?

I was reading Modern Optimization with R (Use R!) and wondering if a book like this exists in Python too? To be precise something that covers stochastic gradient descent and other advanced ...
49
votes
8answers
13k views

Why do internet companies prefer Java/Python for data scientist job?

I see a many times in job description for data scientist asking for Python/Java experience and disregard R. Below is a personal email I received from chief data scientist of a company I applied for ...
0
votes
3answers
150 views

What are good films for teaching data-driven decision making? (like Moneyball)

What are good films for teaching data-driven decision making? In one of my classes, I asked my students to watch Moneyball at home and we discussed it in the class. It was successful and they learned ...
4
votes
2answers
5k views

How to further improve the kaggle titanic submission accuracy?

I am working on the Titanic dataset. So far my submission has 0.78 score using soft majority voting with logistic regression and random forest. As for the features, I used Pclass, Age, SibSp, Parch, ...
1
vote
1answer
94 views

From developper to data scientist [closed]

I code a lot for web, games and some basic ML scripts. Now I would like to learn about data science. This post is a good starting point but I would like some readings. I would like advices on books ...
8
votes
4answers
349 views

How to handle the CEO expectations from a company that's new to data science?

I'm new here. I'm about to have a final interview for a data scientist position for a company (it's in the e-commerce field) that is new for data science. It's a pretty new position for the company, ...
1
vote
2answers
8k views

what is the difference between the training and testdata set?

What is the difference between the test and training data sets.As per blogs and papers I studied what I understood is we will have 100 % data set then that is divided into 2 sets(test data set is 30% &...
0
votes
1answer
91 views

Understanding Bernoulli Trials, Bayesian Setting

I am required to complete a project on ML applications. I guess there is a lot of statistics in ML, not helpful for a non-maths background. I am getting too bogged down by notations. There are too ...
6
votes
1answer
236 views

Measuring Value in Data Science?

Why does it seem that it's difficult to find out how people in data science create measurable value? All I find on the internet are buzzwords like data cleaning, visualization, and writing about the ...