Questions tagged [beginner]

For questions which concern getting started in Data Science or any of its related subdomains.

Filter by
Sorted by
Tagged with
7
votes
2answers
3k views

Which supervised learning algorithms are available for matching?

I'm working on a non-profit where we try to help potential university applicants by matching them with alumni that want to share their experience/wisdom and, at the moment, it is happening manually. ...
8
votes
3answers
661 views

What knowledge do I need in order to write a simple AI program to play a game?

I'm a B.Sc graduate. One of my courses was 'Introduction to Machine Learning', and I always wanted to do a personal project in this subject. I recently heard about different AI training to play games ...
10
votes
4answers
786 views

What initial steps should I use to make sense of large data sets, and what tools should I use?

Caveat: I am a complete beginner when it comes to machine learning, but eager to learn. I have a large dataset and I'm trying to find pattern in it. There may / may not be correlation across the data,...
20
votes
3answers
19k views

Keyword/phrase extraction from Text using Deep Learning libraries

Perhaps this is too broad, but I am looking for references on how to use deep learning in a text summarization task. I have already implemented text summarization using standard word-frequency ...
0
votes
2answers
78 views

Need sugestion to accuire a job in data mining [closed]

I interested in data mining specialization and have been enrolled in data mining specialization course at Coursera by University of Illinois. This specialization course contains four parts. The very ...
4
votes
0answers
44 views

Learning a logical function with a 2 layer BDN network - manual weight setting rule question?

So I am trying to construct a 2-layer network of binary decision neurons as proposed by McCullough and Pitts (1943) to learn a logical function (a composition of AND's and OR's) such as: $((\neg x_1\...
1
vote
0answers
132 views

ElasticSearch for data scientists [closed]

This is to seek career advice for a data scientist. What pertains within the role of data scientist and what does not regarding ElasticSearch. Does backend development for ElasticSearch using ...
1
vote
0answers
78 views

MNIST digits… And what technique to find ZIP code on the envelope?

What techniques are currently available for e.g. locating the ZIP code on the envelope and cutting it to single digits prior to feeding them to digit recognition algorithm (trained on MNIST dataset)? ...
2
votes
0answers
43 views

Text recognition within images [closed]

I am a beginner and need further help to elaborate following problem. I want to "read" text from images. In my problem setting, the text on all the images has the same structure. I found this solution ...
1
vote
1answer
145 views

How to get started? [closed]

I am currently working as a registered nurse, but I have decided that I can no longer do this as a career. I was essentially forced by my parents to go into the health field. After doing research on ...
3
votes
1answer
651 views

Is there a comprehensive learning plan for a self-teaching beginner in data science with no programming background? [closed]

Situation I want to be a data scientist, but I have no programming or maths background. I have more than the basic understanding of python which I taught myself over a couple of months. Right now I ...
0
votes
1answer
2k views

How Natural language processing and elasticsearch are related

I got call from a recruiter for an elasticsearch job. I am not sure how these 2 are related. Can anyone suggest and provide example use case?
1
vote
1answer
3k views

Create similarity matrix

I have a training set and a testing set of vectors. All the vectors are labeled. For each labeled vector in the testing set, there are 3 vectors in the training set with the same label. I'm using ...
1
vote
1answer
49 views

Recording Data of my learning progress

I'm just starting out with learning about Data Science and programming through various online course. Was thinking a good first project would be a to create a log of what I'm learning and how long ...
2
votes
0answers
23 views

Mapping a set of corrupted strings to the correct ones

I am fairly new into Data Science but encoutered it before. The following problem troubles me and i hope you guys can point me in the right direction. The input are some strings where some carry the ...
1
vote
2answers
193 views

Advice on how to get started for someone a bit later in life? [closed]

I am 33 years old and graduated in 2006 from college with a degree in analytic philosophy. For a long time I thought that I was going to get a phd in phil and teach but that dream is long gone, and I ...
2
votes
1answer
111 views

Predicting most likely application to be opened

Background I'm currently preparing for a paper in which I will discuss the ability to predict the most likely application to be opened by the user at the given time. The application will collect ...
54
votes
8answers
13k views

Why do internet companies prefer Java/Python for data scientist job?

I see a many times in job description for data scientist asking for Python/Java experience and disregard R. Below is a personal email I received from chief data scientist of a company I applied for ...
2
votes
2answers
166 views

What could be the value of having a business analyst in a data science team?

Correct me if I am wrong, but while business analysts are often an important role in software delivery teams, but it seems not the case in the data science field. Commonly available data scientist ...
1
vote
2answers
134 views

String classification beginner question

I analyse log files, very often there are strings that only differ on few places and are same every where else, I am trying to find the generic string that they most likely belong to e.g. : ...
12
votes
3answers
6k views

Unstructured text classification

I'm going to classify unstructured text documents, namely web sites of unknown structure. The number of classes to which I am classifying is limited (at this point, I believe there is no more than ...
0
votes
1answer
60 views

Why my Decision Tree Model is not further bifurcated in to Age

I've created a Decision Tree Model for expected candidates that buyed Villa. Though the Drilling down Green highlighted box, show data has Age in it. Question- But why my model is not bifurcating it ...
1
vote
3answers
684 views

How to approach a Data Science case study question?

I recently had a phone interview with a consumer tech company for a quant position. The question was basically, "imagine a facebook style social network site. Six months ago a new feature called '...
6
votes
2answers
18k views

Is there a C library for machine learning algorithms? [closed]

Are there any machine learning libraries for C. Specifically interested in unsupervised learning.
1
vote
1answer
178 views

What is the best strategy to use on data with many classification labels?

In general, what sort of supervised algorithms and techniques should I use on data that has the following charactersitcs: 2 potential classification labels? 3-5 potential classification labels? 6-10 ...
-3
votes
2answers
330 views

What is most likely the bare minimum knowledge one has to have to become data scientist? [closed]

I am a Python developer but I want to become a data scientist. My Question: At its core what is the bare minimum I need to have to make this transition? I know it cannot simply be that I need to ...
8
votes
2answers
578 views

Tips for a new data scientist

I am about to start a job in which I will be working with large datasets and will be expected to find trends, etc... I have found lots of resources on where to learn ML and other hard skills and feel ...
3
votes
1answer
123 views

How do CNNs use a model and find the object(s) desired?

Background: I'm studying CNN's outside of my undergraduate CS course on ML. I have a few questions related to CNNs. 1) When training a CNN, we desire tightly bounded/cropped images of the desired ...
7
votes
4answers
377 views

How to handle the CEO expectations from a company that's new to data science?

I'm new here. I'm about to have a final interview for a data scientist position for a company (it's in the e-commerce field) that is new for data science. It's a pretty new position for the company, ...
2
votes
1answer
133 views

Approaching data science [closed]

I'm totally naive to Data Science - that is, the relatively new, somewhat hyped-field that is so popular at the moment. But I'm not naive to data ... as a scientist and researcher I've worked with all ...
3
votes
3answers
802 views

Is a neural network suitable for this application

Apologies if this question is not a suitable format. I am a novice in data science. I have a database of species observation data consisting of ~16 million records. Each record consists of: latitude ...
0
votes
2answers
178 views

Principal components analysis with compositional data

Another beginner question: I'm trying to do PCA on compositional data. In other words, all the variables in the group add up to 100%. I've since learned on this forum that compositional data poses a ...
0
votes
3answers
184 views

What are good films for teaching data-driven decision making? (like Moneyball)

What are good films for teaching data-driven decision making? In one of my classes, I asked my students to watch Moneyball at home and we discussed it in the class. It was successful and they learned ...
3
votes
2answers
5k views

How to further improve the kaggle titanic submission accuracy?

I am working on the Titanic dataset. So far my submission has 0.78 score using soft majority voting with logistic regression and random forest. As for the features, I used Pclass, Age, SibSp, Parch, ...
1
vote
1answer
97 views

From developper to data scientist [closed]

I code a lot for web, games and some basic ML scripts. Now I would like to learn about data science. This post is a good starting point but I would like some readings. I would like advices on books ...
0
votes
1answer
118 views

Understanding Bernoulli Trials, Bayesian Setting

I am required to complete a project on ML applications. I guess there is a lot of statistics in ML, not helpful for a non-maths background. I am getting too bogged down by notations. There are too ...
1
vote
1answer
1k views

Beginner in programming and data science with 100 hours to spend learning the basics [closed]

I started using the below link to teach myself data science, with some mathematical knowledge (including calculus, linear algebra, stats/probability) but very little programming experience: Quora - ...
6
votes
1answer
250 views

Measuring Value in Data Science?

Why does it seem that it's difficult to find out how people in data science create measurable value? All I find on the internet are buzzwords like data cleaning, visualization, and writing about the ...
2
votes
3answers
109 views

Data sources problem

I’m doing an “analytics” project in which I have to collect data from small businesses (SMEs) in South America and try to come up with some insights about what are their needs in general. The project’...
0
votes
2answers
190 views

How to dive into data science quickly? [closed]

I'm new here - I hope this kind of question is legit. I have a background in mathematics - my field is probability theory, where I am quite strong (top 2% of University). I have little experience ...
2
votes
2answers
208 views

linear regression with “partitioned” data

I am not a stats/math expert by any stretch of the imagination, but have been trying some linear regression with census data and think I have run across a fundamental problem/obstacle. The response ...
0
votes
1answer
262 views

Data Scientist Prerequisites: What are the essential prerequisite statistics topics? [closed]

I have may years of experience with database application development mainly focused on SQL Server and Oracle. I like to move into Data Science field and I my understanding is that I need a solid ...
2
votes
1answer
100 views

How would I map categories between two similar but different sets of categories

Having multiple sets of categories from different listings sites (e.g. Yelp, yellowpages.com, Google My Business...). I want to figure out what category X on one site is on another site. We have ...
1
vote
1answer
1k views

Data science after a physics degree? [closed]

I'm currently pursuing a bachelor's degree in physics from a university in the UK. Most data science jobs here have a strong preference for people with PhDs in numerate degrees like physics and maths. ...
2
votes
2answers
159 views

Applying neural network for simple x^2 function for demonstration purpose [closed]

I have tried to train a neural network for a simple x^2 function I developed training data in excel. First column (X) is =RANDBETWEEN(-5,5) i.e random integer between -5 and 5 Second column ...
1
vote
1answer
41 views

Please suggest some simple functions that I can use to test my neural network implementation

I am a beginner and I have developed code in Octave to train a neural network (as part of Andrew Ng's coursera course). Now I would like to generate some datasets in Excel for simple mathematical ...
2
votes
0answers
125 views

Which is the most appropiate algorithm to use with Mlib for predicting prices [closed]

I am reading the docs of MLlib, but I am new with it and I don't know which would be the best algorithm to predict prices. I have seen that with RandomRDDs I can use a generator for random numbers ...
2
votes
0answers
103 views

Jobs for gaining experience in preperation for data science [closed]

Data Scientist positions are not the most common entry level jobs. They require hard work, knowledge and most of all experience. The problem is, I am uncertain what entry level jobs can help you get ...
15
votes
5answers
17k views

Open source data science projects to contribute

Contribution into open source projects is typically a good way to get some practice for newbies, and try a new area for experienced data scientists and analysts. Which projects do you contribute? ...
1
vote
2answers
608 views

How can one can aim for a career in machine learning? [closed]

I'm interested in various machine learning methods and wonder how can I aim for a career in the field. What are most basic skills to have? I mean the matters strictly connected to the machine ...