Questions tagged [beginner]

For questions which concern getting started in Data Science or any of its related subdomains.

Filter by
Sorted by
Tagged with
2
votes
0answers
44 views

Text recognition within images [closed]

I am a beginner and need further help to elaborate following problem. I want to "read" text from images. In my problem setting, the text on all the images has the same structure. I found this solution ...
1
vote
1answer
151 views

How to get started? [closed]

I am currently working as a registered nurse, but I have decided that I can no longer do this as a career. I was essentially forced by my parents to go into the health field. After doing research on ...
0
votes
1answer
2k views

How Natural language processing and elasticsearch are related

I got call from a recruiter for an elasticsearch job. I am not sure how these 2 are related. Can anyone suggest and provide example use case?
1
vote
1answer
4k views

Create similarity matrix

I have a training set and a testing set of vectors. All the vectors are labeled. For each labeled vector in the testing set, there are 3 vectors in the training set with the same label. I'm using ...
2
votes
0answers
23 views

Mapping a set of corrupted strings to the correct ones

I am fairly new into Data Science but encoutered it before. The following problem troubles me and i hope you guys can point me in the right direction. The input are some strings where some carry the ...
1
vote
1answer
49 views

Recording Data of my learning progress

I'm just starting out with learning about Data Science and programming through various online course. Was thinking a good first project would be a to create a log of what I'm learning and how long ...
1
vote
2answers
196 views

Advice on how to get started for someone a bit later in life? [closed]

I am 33 years old and graduated in 2006 from college with a degree in analytic philosophy. For a long time I thought that I was going to get a phd in phil and teach but that dream is long gone, and I ...
3
votes
1answer
692 views

Is there a comprehensive learning plan for a self-teaching beginner in data science with no programming background? [closed]

Situation I want to be a data scientist, but I have no programming or maths background. I have more than the basic understanding of python which I taught myself over a couple of months. Right now I ...
2
votes
2answers
174 views

What could be the value of having a business analyst in a data science team?

Correct me if I am wrong, but while business analysts are often an important role in software delivery teams, but it seems not the case in the data science field. Commonly available data scientist ...
1
vote
2answers
145 views

String classification beginner question

I analyse log files, very often there are strings that only differ on few places and are same every where else, I am trying to find the generic string that they most likely belong to e.g. : ...
0
votes
1answer
63 views

Why my Decision Tree Model is not further bifurcated in to Age

I've created a Decision Tree Model for expected candidates that buyed Villa. Though the Drilling down Green highlighted box, show data has Age in it. Question- But why my model is not bifurcating it ...
1
vote
3answers
740 views

How to approach a Data Science case study question?

I recently had a phone interview with a consumer tech company for a quant position. The question was basically, "imagine a facebook style social network site. Six months ago a new feature called '...
6
votes
2answers
21k views

Is there a C library for machine learning algorithms? [closed]

Are there any machine learning libraries for C. Specifically interested in unsupervised learning.
8
votes
3answers
686 views

What knowledge do I need in order to write a simple AI program to play a game?

I'm a B.Sc graduate. One of my courses was 'Introduction to Machine Learning', and I always wanted to do a personal project in this subject. I recently heard about different AI training to play games ...
3
votes
1answer
124 views

How do CNNs use a model and find the object(s) desired?

Background: I'm studying CNN's outside of my undergraduate CS course on ML. I have a few questions related to CNNs. 1) When training a CNN, we desire tightly bounded/cropped images of the desired ...
2
votes
1answer
134 views

Approaching data science [closed]

I'm totally naive to Data Science - that is, the relatively new, somewhat hyped-field that is so popular at the moment. But I'm not naive to data ... as a scientist and researcher I've worked with all ...
3
votes
3answers
855 views

Is a neural network suitable for this application

Apologies if this question is not a suitable format. I am a novice in data science. I have a database of species observation data consisting of ~16 million records. Each record consists of: latitude ...
1
vote
1answer
189 views

What is the best strategy to use on data with many classification labels?

In general, what sort of supervised algorithms and techniques should I use on data that has the following charactersitcs: 2 potential classification labels? 3-5 potential classification labels? 6-10 ...
2
votes
3answers
2k views

Is there any book for modern optimization in Python?

I was reading Modern Optimization with R (Use R!) and wondering if a book like this exists in Python too? To be precise something that covers stochastic gradient descent and other advanced ...
56
votes
8answers
14k views

Why do internet companies prefer Java/Python for data scientist job?

I see a many times in job description for data scientist asking for Python/Java experience and disregard R. Below is a personal email I received from chief data scientist of a company I applied for ...
0
votes
3answers
200 views

What are good films for teaching data-driven decision making? (like Moneyball)

What are good films for teaching data-driven decision making? In one of my classes, I asked my students to watch Moneyball at home and we discussed it in the class. It was successful and they learned ...
4
votes
2answers
6k views

How to further improve the kaggle titanic submission accuracy?

I am working on the Titanic dataset. So far my submission has 0.78 score using soft majority voting with logistic regression and random forest. As for the features, I used Pclass, Age, SibSp, Parch, ...
1
vote
1answer
97 views

From developper to data scientist [closed]

I code a lot for web, games and some basic ML scripts. Now I would like to learn about data science. This post is a good starting point but I would like some readings. I would like advices on books ...
7
votes
4answers
383 views

How to handle the CEO expectations from a company that's new to data science?

I'm new here. I'm about to have a final interview for a data scientist position for a company (it's in the e-commerce field) that is new for data science. It's a pretty new position for the company, ...
2
votes
2answers
12k views

What is the difference between the training and testdata set?

What is the difference between the test and training data sets? As per blogs and papers I studied, what I understood is that we will have 100% data set that is divided into 2 sets (test data set is 30%...
0
votes
1answer
122 views

Understanding Bernoulli Trials, Bayesian Setting

I am required to complete a project on ML applications. I guess there is a lot of statistics in ML, not helpful for a non-maths background. I am getting too bogged down by notations. There are too ...
6
votes
1answer
257 views

Measuring Value in Data Science?

Why does it seem that it's difficult to find out how people in data science create measurable value? All I find on the internet are buzzwords like data cleaning, visualization, and writing about the ...
1
vote
1answer
1k views

Beginner in programming and data science with 100 hours to spend learning the basics [closed]

I started using the below link to teach myself data science, with some mathematical knowledge (including calculus, linear algebra, stats/probability) but very little programming experience: Quora - ...
8
votes
5answers
1k views

What does it mean when people say a cost function is something you want to minimize?

I am having a lot of trouble understanding this. Does it mean you should not use the cost function very often?
2
votes
3answers
110 views

Data sources problem

I’m doing an “analytics” project in which I have to collect data from small businesses (SMEs) in South America and try to come up with some insights about what are their needs in general. The project’...
7
votes
2answers
4k views

Which supervised learning algorithms are available for matching?

I'm working on a non-profit where we try to help potential university applicants by matching them with alumni that want to share their experience/wisdom and, at the moment, it is happening manually. ...
0
votes
2answers
192 views

How to dive into data science quickly? [closed]

I'm new here - I hope this kind of question is legit. I have a background in mathematics - my field is probability theory, where I am quite strong (top 2% of University). I have little experience ...
0
votes
2answers
183 views

Principal components analysis with compositional data

Another beginner question: I'm trying to do PCA on compositional data. In other words, all the variables in the group add up to 100%. I've since learned on this forum that compositional data poses a ...
8
votes
2answers
595 views

Tips for a new data scientist

I am about to start a job in which I will be working with large datasets and will be expected to find trends, etc... I have found lots of resources on where to learn ML and other hard skills and feel ...
0
votes
1answer
265 views

Data Scientist Prerequisites: What are the essential prerequisite statistics topics? [closed]

I have may years of experience with database application development mainly focused on SQL Server and Oracle. I like to move into Data Science field and I my understanding is that I need a solid ...
2
votes
2answers
237 views

linear regression with “partitioned” data

I am not a stats/math expert by any stretch of the imagination, but have been trying some linear regression with census data and think I have run across a fundamental problem/obstacle. The response ...
56
votes
3answers
72k views

RNN vs CNN at a high level

I've been thinking about the Recurrent Neural Networks (RNN) and their varieties and Convolutional Neural Networks (CNN) and their varieties. Would these two points be fair to say: Use CNNs to break ...
1
vote
1answer
364 views

xgboost performance with predicted values as input

I have predicted the probability of loss using different features. Now when I used this with a non-important feature to predict the probability of loss. The first one is very close. logloss was close ...
-3
votes
2answers
344 views

What is most likely the bare minimum knowledge one has to have to become data scientist? [closed]

I am a Python developer but I want to become a data scientist. My Question: At its core what is the bare minimum I need to have to make this transition? I know it cannot simply be that I need to ...
2
votes
1answer
101 views

How would I map categories between two similar but different sets of categories

Having multiple sets of categories from different listings sites (e.g. Yelp, yellowpages.com, Google My Business...). I want to figure out what category X on one site is on another site. We have ...
1
vote
3answers
1k views

How to best forecast simple binary data? [closed]

I have a set of timeseries binary (boolean) data, with intervals of 1 day. Each day can either be 1 or 0 (true/false). What is the best way to forecast the next day/week's data based on the data I ...
1
vote
1answer
1k views

Data science after a physics degree? [closed]

I'm currently pursuing a bachelor's degree in physics from a university in the UK. Most data science jobs here have a strong preference for people with PhDs in numerate degrees like physics and maths. ...
5
votes
2answers
535 views

Data scientist light?

Im a 26 year old guy with an MBA and I work as an ERP system administrator. I have been interested in the field of data science for a while now. I've always liked statistics and various analytical ...
1
vote
1answer
44 views

Please suggest some simple functions that I can use to test my neural network implementation

I am a beginner and I have developed code in Octave to train a neural network (as part of Andrew Ng's coursera course). Now I would like to generate some datasets in Excel for simple mathematical ...
2
votes
2answers
168 views

Applying neural network for simple x^2 function for demonstration purpose [closed]

I have tried to train a neural network for a simple x^2 function I developed training data in excel. First column (X) is =RANDBETWEEN(-5,5) i.e random integer between -5 and 5 Second column ...
3
votes
1answer
125 views

Predicting most likely application to be opened

Background I'm currently preparing for a paper in which I will discuss the ability to predict the most likely application to be opened by the user at the given time. The application will collect ...
2
votes
0answers
127 views

Which is the most appropiate algorithm to use with Mlib for predicting prices [closed]

I am reading the docs of MLlib, but I am new with it and I don't know which would be the best algorithm to predict prices. I have seen that with RandomRDDs I can use a generator for random numbers ...
20
votes
3answers
20k views

Keyword/phrase extraction from Text using Deep Learning libraries

Perhaps this is too broad, but I am looking for references on how to use deep learning in a text summarization task. I have already implemented text summarization using standard word-frequency ...
2
votes
0answers
104 views

Jobs for gaining experience in preperation for data science [closed]

Data Scientist positions are not the most common entry level jobs. They require hard work, knowledge and most of all experience. The problem is, I am uncertain what entry level jobs can help you get ...
1
vote
2answers
612 views

How can one can aim for a career in machine learning? [closed]

I'm interested in various machine learning methods and wonder how can I aim for a career in the field. What are most basic skills to have? I mean the matters strictly connected to the machine ...