Questions tagged [beginner]

For questions which concern getting started in Data Science or any of its related subdomains.

Filter by
Sorted by
Tagged with
54
votes
8answers
13k views

Why do internet companies prefer Java/Python for data scientist job?

I see a many times in job description for data scientist asking for Python/Java experience and disregard R. Below is a personal email I received from chief data scientist of a company I applied for ...
54
votes
3answers
69k views

RNN vs CNN at a high level

I've been thinking about the Recurrent Neural Networks (RNN) and their varieties and Convolutional Neural Networks (CNN) and their varieties. Would these two points be fair to say: Use CNNs to break ...
22
votes
2answers
7k views

How to deal with time series which change in seasonality or other patterns?

Background I'm working on a time series data set of energy meter readings. The length of the series varies by meter - for some I have several years, others only a few months, etc. Many display ...
19
votes
3answers
18k views

Keyword/phrase extraction from Text using Deep Learning libraries

Perhaps this is too broad, but I am looking for references on how to use deep learning in a text summarization task. I have already implemented text summarization using standard word-frequency ...
16
votes
3answers
4k views

How to self-learn data science? [closed]

I am a self-taught web developer and am interested in teaching myself data science, but I'm unsure of how to begin. In particular, I'm wondering: What fields are there within data science? (e.g., ...
14
votes
5answers
17k views

Open source data science projects to contribute

Contribution into open source projects is typically a good way to get some practice for newbies, and try a new area for experienced data scientists and analysts. Which projects do you contribute? ...
13
votes
2answers
8k views

Data science without knowledge of a specific topic, is it worth pursuing as a career? [closed]

I had a conversation with someone recently and mentioned my interest in data analysis and who I intended to learn the necessary skills and tools. They suggested to me that while it is great to learn ...
13
votes
7answers
1k views

I am a programmer, how do I get into field of Data Science?

First of all this term sounds so obscure. Anyways..I am a software programmer. One of the languages I can code is Python. Speaking of Data I can use SQL and can do Data Scraping. What I figured out ...
12
votes
3answers
6k views

Unstructured text classification

I'm going to classify unstructured text documents, namely web sites of unknown structure. The number of classes to which I am classifying is limited (at this point, I believe there is no more than ...
10
votes
4answers
776 views

What initial steps should I use to make sense of large data sets, and what tools should I use?

Caveat: I am a complete beginner when it comes to machine learning, but eager to learn. I have a large dataset and I'm trying to find pattern in it. There may / may not be correlation across the data,...
10
votes
1answer
9k views

Do you have to normalize data when building decision trees using R?

So, our data set this week has 14 attributes and each column has very different values. One column has values below 1 while another column has values that go from three to four whole digits. We ...
8
votes
3answers
657 views

What knowledge do I need in order to write a simple AI program to play a game?

I'm a B.Sc graduate. One of my courses was 'Introduction to Machine Learning', and I always wanted to do a personal project in this subject. I recently heard about different AI training to play games ...
8
votes
5answers
1k views

What does it mean when people say a cost function is something you want to minimize?

I am having a lot of trouble understanding this. Does it mean you should not use the cost function very often?
8
votes
2answers
578 views

Tips for a new data scientist

I am about to start a job in which I will be working with large datasets and will be expected to find trends, etc... I have found lots of resources on where to learn ML and other hard skills and feel ...
8
votes
4answers
1k views

Online machine learning tutorial

Does anyone know some good tutorials on online machine learning technics? I.e. how it can be used in real-time environments, what are key differences compared to normal machine learning methods etc. ...
8
votes
1answer
544 views

Some suggestion for career in data science or predictive modeling

I am looking to choose my career in the area of decision science or predictive modeling and I am aware that this is kind of opinion based but I would like to have some suggestion from experts that I ...
7
votes
4answers
376 views

How to handle the CEO expectations from a company that's new to data science?

I'm new here. I'm about to have a final interview for a data scientist position for a company (it's in the e-commerce field) that is new for data science. It's a pretty new position for the company, ...
7
votes
2answers
3k views

Which supervised learning algorithms are available for matching?

I'm working on a non-profit where we try to help potential university applicants by matching them with alumni that want to share their experience/wisdom and, at the moment, it is happening manually. ...
6
votes
2answers
17k views

Is there a C library for machine learning algorithms? [closed]

Are there any machine learning libraries for C. Specifically interested in unsupervised learning.
6
votes
1answer
249 views

Measuring Value in Data Science?

Why does it seem that it's difficult to find out how people in data science create measurable value? All I find on the internet are buzzwords like data cleaning, visualization, and writing about the ...
6
votes
3answers
296 views

Distance calculation/vector range significance

I'm trying to implement item based collaborative filtering. Do any distance calculations allow for weighting of certain ranges of values within each vector? For example, I would like to be able to ...
5
votes
2answers
521 views

Data scientist light?

Im a 26 year old guy with an MBA and I work as an ERP system administrator. I have been interested in the field of data science for a while now. I've always liked statistics and various analytical ...
5
votes
2answers
2k views

What is a policy in machine learning?

While I was reading the paper "Grounded Action Transformation for Robot Learning in Simulation", I came across the term "policy". Could someone explain to me what that actually is (in general and in ...
5
votes
3answers
844 views

Recommendation - item based vs user based [closed]

I have one clarification - First the definitions- User-based: Recommend items by finding similar users. This is often harder to scale because of the dynamic nature of users. Item-based: Calculate ...
4
votes
4answers
511 views

Reference about social network data-mining

I am not in the data science field, but I would like to examine in depth this field and, particularly, I would like to start from the analysis of the social networks data. I am trying to find some ...
4
votes
4answers
769 views

Data Science Career: From Researcher To Data Scientist

I’m currently working as a Research Assistant in Computer Science, specializing in both Human-Computer Interaction (HCI) and Health Informatics (HI) fields. As part of my role, I collect data from ...
4
votes
1answer
314 views

Route to picking up Deep learning [closed]

I would like to pick up on the topic of deep learning. Should I begin from the topic of AI before working my way into Deep learning?
4
votes
2answers
2k views

How to apply class weight to a multi-output model?

I have a model with 2 categorical outputs. The first output layer can predict 2 classes: [0, 1] and the second output layer can predict 3 classes: [0, 1, 2]. How can I apply different class weight ...
4
votes
0answers
86 views

Which technologies and skills should the new generation of data scientists learn? [closed]

Having looked at various job requirements, I see that a lot of them require you to be an expert in Hadoop, use Spark but I am wondering how useful are these technologies (due to my lack of ...
4
votes
0answers
42 views

Learning a logical function with a 2 layer BDN network - manual weight setting rule question?

So I am trying to construct a 2-layer network of binary decision neurons as proposed by McCullough and Pitts (1943) to learn a logical function (a composition of AND's and OR's) such as: $((\neg x_1\...
3
votes
6answers
903 views

Where to start, which books [closed]

What is a good book or resource to start learning Artificial Intelligence ?
3
votes
2answers
970 views

Cheat Sheet of UNIX commands for Data Science

I was looking for a cheat sheet of UNIX commands, which are specifically usable for data science. I mean an introduction to very basic commands (starting from cd, <...
3
votes
2answers
5k views

How to further improve the kaggle titanic submission accuracy?

I am working on the Titanic dataset. So far my submission has 0.78 score using soft majority voting with logistic regression and random forest. As for the features, I used Pclass, Age, SibSp, Parch, ...
3
votes
1answer
640 views

Is there a comprehensive learning plan for a self-teaching beginner in data science with no programming background? [closed]

Situation I want to be a data scientist, but I have no programming or maths background. I have more than the basic understanding of python which I taught myself over a couple of months. Right now I ...
3
votes
1answer
217 views

Avoid iterations while calculating average model accuracy

I am fitting a model in R. use createFolds method to create several k folds from the data set loop through the folds, repeating ...
3
votes
1answer
4k views

R aggregate() with dates

I am working on a data set that has multiple traffic speed measurements per day. My data is from the city of chicago, and it is taken every minute for about six months. I wanted to consolidate this ...
3
votes
2answers
502 views

Can a single-layer ANN get XOR wrong?

I'm still pretty new to artificial neural networks. While I've played around with TensorFlow, I'm now trying to get the basics straight. Since I've stumbled upon a course which explains how to ...
3
votes
1answer
122 views

How do CNNs use a model and find the object(s) desired?

Background: I'm studying CNN's outside of my undergraduate CS course on ML. I have a few questions related to CNNs. 1) When training a CNN, we desire tightly bounded/cropped images of the desired ...
3
votes
3answers
780 views

Is a neural network suitable for this application

Apologies if this question is not a suitable format. I am a novice in data science. I have a database of species observation data consisting of ~16 million records. Each record consists of: latitude ...
3
votes
1answer
286 views

What are the best sites to display your data science skills & projects? [closed]

What are the best sites to display your data science skills & projects? Obviously there's kaggle, but any others that recruiters look at?
2
votes
5answers
1k views

How to compare Timeseries Sequences?

I have multiple time series sequences and I want for each new time series to find the most alike old one. I found that I can use the sum of errors between points. Is this a good approach? Is there a ...
2
votes
6answers
7k views

How much of a background in programming is necessary to become a data scientist? [closed]

I once knew some Java, but that was close to 10 years ago. Assuming I can learn a language to get into data analytics.... what language do you recommend?
2
votes
3answers
109 views

Data sources problem

I’m doing an “analytics” project in which I have to collect data from small businesses (SMEs) in South America and try to come up with some insights about what are their needs in general. The project’...
2
votes
3answers
2k views

Is there any book for modern optimization in Python?

I was reading Modern Optimization with R (Use R!) and wondering if a book like this exists in Python too? To be precise something that covers stochastic gradient descent and other advanced ...
2
votes
2answers
160 views

What could be the value of having a business analyst in a data science team?

Correct me if I am wrong, but while business analysts are often an important role in software delivery teams, but it seems not the case in the data science field. Commonly available data scientist ...
2
votes
2answers
158 views

Applying neural network for simple x^2 function for demonstration purpose [closed]

I have tried to train a neural network for a simple x^2 function I developed training data in excel. First column (X) is =RANDBETWEEN(-5,5) i.e random integer between -5 and 5 Second column ...
2
votes
3answers
6k views

Determine useful features for machine learning model

I am working with a dataset with hundreds of features. I wish to create a simple machine learning model using 7-10 features from the original dataset. My question is this: What quantitative metrics ...
2
votes
1answer
3k views

What is the best way to scale a numerical dataset [closed]

I have a dataset with differents attributes which don't have the same range on their values which is a problem when we need to compute distance beetween objects. After some research i found that i can ...
2
votes
1answer
132 views

Approaching data science [closed]

I'm totally naive to Data Science - that is, the relatively new, somewhat hyped-field that is so popular at the moment. But I'm not naive to data ... as a scientist and researcher I've worked with all ...
2
votes
1answer
30 views

How to define a neural model as linear or non linear

TL;DR: in what sense is the model of a neuron seen in the image above nonlinear? In chapter 1, section 1.3 MODELS OF A NEURON of Simon Haykin's Neural Networks book, the standard model of a single ...