Questions tagged [beginner]

For questions which concern getting started in Data Science or any of its related subdomains.

Filter by
Sorted by
Tagged with
4
votes
0answers
87 views

Which technologies and skills should the new generation of data scientists learn? [closed]

Having looked at various job requirements, I see that a lot of them require you to be an expert in Hadoop, use Spark but I am wondering how useful are these technologies (due to my lack of ...
1
vote
3answers
1k views

How to best forecast simple binary data? [closed]

I have a set of timeseries binary (boolean) data, with intervals of 1 day. Each day can either be 1 or 0 (true/false). What is the best way to forecast the next day/week's data based on the data I ...
0
votes
1answer
360 views

Chi-squared for continuous variables

I am using chi-squared to determine feature importance as I select features to train a supervised ML model. I create a contingency table for the feature/target, and feed this contingency table into ...
-1
votes
2answers
69 views

Guidance to create a machine learning alg to find multiple overlapping date over multiple period

i have a dataset of work period from a lot of people during multiple years and i would like to find the overlapping date between these periods, the data would look something like this: ...
7
votes
2answers
4k views

Which supervised learning algorithms are available for matching?

I'm working on a non-profit where we try to help potential university applicants by matching them with alumni that want to share their experience/wisdom and, at the moment, it is happening manually. ...
8
votes
3answers
688 views

What knowledge do I need in order to write a simple AI program to play a game?

I'm a B.Sc graduate. One of my courses was 'Introduction to Machine Learning', and I always wanted to do a personal project in this subject. I recently heard about different AI training to play games ...
10
votes
4answers
854 views

What initial steps should I use to make sense of large data sets, and what tools should I use?

Caveat: I am a complete beginner when it comes to machine learning, but eager to learn. I have a large dataset and I'm trying to find pattern in it. There may / may not be correlation across the data,...
20
votes
3answers
20k views

Keyword/phrase extraction from Text using Deep Learning libraries

Perhaps this is too broad, but I am looking for references on how to use deep learning in a text summarization task. I have already implemented text summarization using standard word-frequency ...
0
votes
2answers
81 views

Need sugestion to accuire a job in data mining [closed]

I interested in data mining specialization and have been enrolled in data mining specialization course at Coursera by University of Illinois. This specialization course contains four parts. The very ...
4
votes
0answers
54 views

Learning a logical function with a 2 layer BDN network - manual weight setting rule question?

So I am trying to construct a 2-layer network of binary decision neurons as proposed by McCullough and Pitts (1943) to learn a logical function (a composition of AND's and OR's) such as: $((\neg x_1\...
1
vote
0answers
134 views

ElasticSearch for data scientists [closed]

This is to seek career advice for a data scientist. What pertains within the role of data scientist and what does not regarding ElasticSearch. Does backend development for ElasticSearch using ...
1
vote
0answers
85 views

MNIST digits… And what technique to find ZIP code on the envelope?

What techniques are currently available for e.g. locating the ZIP code on the envelope and cutting it to single digits prior to feeding them to digit recognition algorithm (trained on MNIST dataset)? ...
2
votes
0answers
44 views

Text recognition within images [closed]

I am a beginner and need further help to elaborate following problem. I want to "read" text from images. In my problem setting, the text on all the images has the same structure. I found ...
1
vote
1answer
163 views

How to get started? [closed]

I am currently working as a registered nurse, but I have decided that I can no longer do this as a career. I was essentially forced by my parents to go into the health field. After doing research on ...
3
votes
1answer
697 views

Is there a comprehensive learning plan for a self-teaching beginner in data science with no programming background? [closed]

Situation I want to be a data scientist, but I have no programming or maths background. I have more than the basic understanding of python which I taught myself over a couple of months. Right now I ...
0
votes
1answer
2k views

How Natural language processing and elasticsearch are related

I got call from a recruiter for an elasticsearch job. I am not sure how these 2 are related. Can anyone suggest and provide example use case?
1
vote
1answer
4k views

Create similarity matrix

I have a training set and a testing set of vectors. All the vectors are labeled. For each labeled vector in the testing set, there are 3 vectors in the training set with the same label. I'm using ...
1
vote
1answer
49 views

Recording Data of my learning progress

I'm just starting out with learning about Data Science and programming through various online course. Was thinking a good first project would be a to create a log of what I'm learning and how long ...
2
votes
0answers
23 views

Mapping a set of corrupted strings to the correct ones

I am fairly new into Data Science but encoutered it before. The following problem troubles me and i hope you guys can point me in the right direction. The input are some strings where some carry the ...
1
vote
2answers
197 views

Advice on how to get started for someone a bit later in life? [closed]

I am 33 years old and graduated in 2006 from college with a degree in analytic philosophy. For a long time I thought that I was going to get a phd in phil and teach but that dream is long gone, and I ...
4
votes
1answer
126 views

Predicting most likely application to be opened

Background I'm currently preparing for a paper in which I will discuss the ability to predict the most likely application to be opened by the user at the given time. The application will collect ...
56
votes
8answers
14k views

Why do internet companies prefer Java/Python for data scientist job?

I see a many times in job description for data scientist asking for Python/Java experience and disregard R. Below is a personal email I received from chief data scientist of a company I applied for ...
2
votes
2answers
175 views

What could be the value of having a business analyst in a data science team?

Correct me if I am wrong, but while business analysts are often an important role in software delivery teams, but it seems not the case in the data science field. Commonly available data scientist ...
1
vote
2answers
145 views

String classification beginner question

I analyse log files, very often there are strings that only differ on few places and are same every where else, I am trying to find the generic string that they most likely belong to e.g. : ...
12
votes
3answers
6k views

Unstructured text classification

I'm going to classify unstructured text documents, namely web sites of unknown structure. The number of classes to which I am classifying is limited (at this point, I believe there is no more than ...
0
votes
1answer
64 views

Why my Decision Tree Model is not further bifurcated in to Age

I've created a Decision Tree Model for expected candidates that buyed Villa. Though the Drilling down Green highlighted box, show data has Age in it. Question- But why my model is not bifurcating it ...
1
vote
3answers
746 views

How to approach a Data Science case study question?

I recently had a phone interview with a consumer tech company for a quant position. The question was basically, "imagine a facebook style social network site. Six months ago a new feature called '...
6
votes
2answers
21k views

Is there a C library for machine learning algorithms? [closed]

Are there any machine learning libraries for C. Specifically interested in unsupervised learning.
1
vote
1answer
191 views

What is the best strategy to use on data with many classification labels?

In general, what sort of supervised algorithms and techniques should I use on data that has the following charactersitcs: 2 potential classification labels? 3-5 potential classification labels? 6-10 ...
-3
votes
2answers
345 views

What is most likely the bare minimum knowledge one has to have to become data scientist? [closed]

I am a Python developer but I want to become a data scientist. My Question: At its core what is the bare minimum I need to have to make this transition? I know it cannot simply be that I need to ...
8
votes
2answers
598 views

Tips for a new data scientist

I am about to start a job in which I will be working with large datasets and will be expected to find trends, etc... I have found lots of resources on where to learn ML and other hard skills and feel ...
3
votes
1answer
125 views

How do CNNs use a model and find the object(s) desired?

Background: I'm studying CNN's outside of my undergraduate CS course on ML. I have a few questions related to CNNs. 1) When training a CNN, we desire tightly bounded/cropped images of the desired ...
7
votes
4answers
384 views

How to handle the CEO expectations from a company that's new to data science?

I'm new here. I'm about to have a final interview for a data scientist position for a company (it's in the e-commerce field) that is new for data science. It's a pretty new position for the company, ...
2
votes
1answer
135 views

Approaching data science [closed]

I'm totally naive to Data Science - that is, the relatively new, somewhat hyped-field that is so popular at the moment. But I'm not naive to data ... as a scientist and researcher I've worked with all ...
3
votes
3answers
865 views

Is a neural network suitable for this application

Apologies if this question is not a suitable format. I am a novice in data science. I have a database of species observation data consisting of ~16 million records. Each record consists of: latitude ...
0
votes
2answers
184 views

Principal components analysis with compositional data

Another beginner question: I'm trying to do PCA on compositional data. In other words, all the variables in the group add up to 100%. I've since learned on this forum that compositional data poses a ...
0
votes
3answers
202 views

What are good films for teaching data-driven decision making? (like Moneyball)

What are good films for teaching data-driven decision making? In one of my classes, I asked my students to watch Moneyball at home and we discussed it in the class. It was successful and they learned ...
4
votes
2answers
6k views

How to further improve the kaggle titanic submission accuracy?

I am working on the Titanic dataset. So far my submission has 0.78 score using soft majority voting with logistic regression and random forest. As for the features, I used Pclass, Age, SibSp, Parch, ...
1
vote
1answer
98 views

From developper to data scientist [closed]

I code a lot for web, games and some basic ML scripts. Now I would like to learn about data science. This post is a good starting point but I would like some readings. I would like advices on books ...
0
votes
1answer
123 views

Understanding Bernoulli Trials, Bayesian Setting

I am required to complete a project on ML applications. I guess there is a lot of statistics in ML, not helpful for a non-maths background. I am getting too bogged down by notations. There are too ...
1
vote
1answer
1k views

Beginner in programming and data science with 100 hours to spend learning the basics [closed]

I started using the below link to teach myself data science, with some mathematical knowledge (including calculus, linear algebra, stats/probability) but very little programming experience: Quora - ...
6
votes
1answer
259 views

Measuring Value in Data Science?

Why does it seem that it's difficult to find out how people in data science create measurable value? All I find on the internet are buzzwords like data cleaning, visualization, and writing about the ...
2
votes
3answers
110 views

Data sources problem

I’m doing an “analytics” project in which I have to collect data from small businesses (SMEs) in South America and try to come up with some insights about what are their needs in general. The project’...
0
votes
2answers
194 views

How to dive into data science quickly? [closed]

I'm new here - I hope this kind of question is legit. I have a background in mathematics - my field is probability theory, where I am quite strong (top 2% of University). I have little experience ...
2
votes
2answers
240 views

linear regression with “partitioned” data

I am not a stats/math expert by any stretch of the imagination, but have been trying some linear regression with census data and think I have run across a fundamental problem/obstacle. The response ...
0
votes
1answer
266 views

Data Scientist Prerequisites: What are the essential prerequisite statistics topics? [closed]

I have may years of experience with database application development mainly focused on SQL Server and Oracle. I like to move into Data Science field and I my understanding is that I need a solid ...
2
votes
1answer
101 views

How would I map categories between two similar but different sets of categories

Having multiple sets of categories from different listings sites (e.g. Yelp, yellowpages.com, Google My Business...). I want to figure out what category X on one site is on another site. We have ...
1
vote
1answer
1k views

Data science after a physics degree? [closed]

I'm currently pursuing a bachelor's degree in physics from a university in the UK. Most data science jobs here have a strong preference for people with PhDs in numerate degrees like physics and maths. ...
2
votes
2answers
168 views

Applying neural network for simple x^2 function for demonstration purpose [closed]

I have tried to train a neural network for a simple x^2 function I developed training data in excel. First column (X) is =RANDBETWEEN(-5,5) i.e random integer between -5 and 5 Second column ...
1
vote
1answer
44 views

Please suggest some simple functions that I can use to test my neural network implementation

I am a beginner and I have developed code in Octave to train a neural network (as part of Andrew Ng's coursera course). Now I would like to generate some datasets in Excel for simple mathematical ...