Questions tagged [reference-request]
"References" is our generic tag for questions seeking information about books, papers, presentations, videos of lectures, on-line tutorials, etc., regarding any subject matter that is on-topic for Data Science.
75
questions
0
votes
1
answer
33
views
How to use API Documentation of dataset
Some websites provide a link to a dataset (in Excel sheets format) which allows the dataset to be downloaded. But some others additionally provide API documentation, like this site. Can you please ...
- 103
0
votes
1
answer
42
views
Is it ok to normalize data using minmaxscalar on dependent variable?
I'm trying to make a sales prediction using the column X = item_amount and y = item_price_total, I'm confused whether it's okay to normalize data on the dependent variable using minmaxscalar?
With the ...
- 1
0
votes
0
answers
22
views
What (ML) algorithms take an image as input and optimal action as output?
I have a given 2d image describing a top down view of a grid (think e.g. a labirynth.)
I want an algorithm to take it as an input and return a single action to be performed in the setting of this grid....
0
votes
0
answers
15
views
How can a pullback dissimilarity on a nasty space be interpolated/approximated?
I have a map $\gamma : X \rightarrow Y$ that is expensive to compute. $X$ is a nasty, very non-Euclidean, not even manifold-like, space of variable-length and "structurally inhomogeneous" ...
- 101
0
votes
0
answers
13
views
Finding keywords for my time series task
So I currently have a time series signals which I need to classify each point on each signal.
For example, this problem can really be with just one dimensional signal array (if I have many or one ...
4
votes
1
answer
43
views
Resources for Promotion/Demotion Strategies for ML Item Recommendation Systems?
We are looking to design a system where specific items or categories of items can be boosted/promoted up or relegated/demoted down the recommendation order.
What are the common strategies or standards ...
0
votes
0
answers
5
views
Bibliographic References on Denoising Distributed Acoustic data with Deep Learning
Distributed Acoustic Sensing (DAS)
I have an iDAS (intelligent distributed acoustic sensing) dataset obtain from an undersea optical fibre. iDAS data have a 2D dimensional representation. On the one ...
- 123
0
votes
3
answers
801
views
How to remove outliers properly?
I was wondering what is the best practice for removing outliers from data. Plotting a boxplot for each feature (column of the dataset) and removing data that fall outside the whiskers seems like a ...
- 73
1
vote
1
answer
60
views
What are the possible applications of a Data Scientist in the design fase of an Aerospace Or Railway Engineering industry? [closed]
I have been trying to understand this for a long time, but this information proves to be incredibly elusive online.
What are possible jobs that a pure Data Scientist, without much background knowledge,...
0
votes
1
answer
452
views
Word Embeddings fastText in 50 dimension
Is there a fastText embedding in 50 dimensions? I'm aware of GloVe embedding is dimensions (50, 100, 200, 300) dimensions. I am trying to sentiment analysis with a very small dataset.
If there is ...
- 1
2
votes
1
answer
156
views
Rate of convergence - comparison of supervised ML methods
I am working on a project with sparse labelled datasets, and am looking for references regarding the rate of convergence of different supervised ML techniques with respect to dataset size.
I know that ...
- 131
3
votes
1
answer
59
views
References/tutorials about data mining and machine learning
I am learning data analytics and I wonder if there are some good references and tutorials about machine learning, data analytics and data mining.
What I'm searching for is an understandable reference/...
- 155
1
vote
0
answers
39
views
What are some good resources for setting up and debugging neural networks?
I am aware of Troubleshooting Deep Neural Networks by Josh Tobin and A Recipe for Training Neural Networks by Andrej Karpathy, but I am interested in other resources that can give me some guidelines ...
- 131
8
votes
1
answer
336
views
Who invented the concept of over-fitting?
I list the references that I found so far.
Shortly, the first appearance of the term was in 1670, first appearance in in close meaning was in 1827, first appearance in a biological paper was in 1923 ...
- 2,623
1
vote
0
answers
119
views
Machine learning for circular sequences
My data are sequences of real numbers $a_0,a_1,...,a_{n-1}$. The length of a sequence is fixed and equals $n$. Each sequence is mapped to a real number $y$ and I want to predict $y$ given the sequence....
- 1,086
2
votes
0
answers
114
views
What is the difference between ICR and OCR?
I've just found the term "Intelligent Character Recognition" (ICR) on Wikipedia and other pages. According to Wikipedia:
In computer science, intelligent character recognition (ICR) is an ...
- 18.7k
0
votes
1
answer
71
views
Where to upload large (0.5Gb) weights anonymously?
I need to upload a number of checkpoints for ConvNets (weights + optimizers, all dicts of pytorch tensors), each about 0.5Gb anonymously. I don't want to use Google Drive. I trained models on the ...
- 757
3
votes
1
answer
115
views
Outlier/Anomaly Detection History
I have been reading about different methods of anomaly detection, their structure and the way they work.
Recently I have been trying to find some scholar articles, writings or books where I can learn ...
- 605
2
votes
1
answer
17k
views
What is "lag" in time series forecasting?
I'm studying machine learning (e.i. time series analysis). I encountered an Azure tutorial, Retail Forecasting.
https://gallery.azure.ai/Experiment/Retail-Forecasting-Step-2-of-6-train-time-series-...
- 21
2
votes
0
answers
29
views
What could be proper terms for a research direction in natural language processing to measure meaningfulness?
For some time, I did assessments to design metrics on how to recognize well-written and meaningful software requirements. Then I decided to work with Stack Overflow question posts because they are a ...
- 381
2
votes
1
answer
2k
views
Tutorial for restricted Boltzmann machine using PyTorch or Tensorflow?
I am trying to find a tutorial on training Restricted Boltzmann machines on some dataset (e.g. MNIST), using either PyTorch or Tensorflow. The few I found are outdated.
Can you recommend any?
- 129
10
votes
4
answers
1k
views
Math PhD (Nonlinear Programming) switching to Data Science?
I am a math Ph.D. student who is interested in going to the industry as a Data Scientist after graduation. I will briefly give some background on my education before posing my question, so that it is ...
- 123
1
vote
1
answer
559
views
How CNN applies backpropagation to update its weights and biases?
I understand that the 3 main layers for CNN are convolutional layer, ReLU layer and pooling layer.
However, I do not understand how CNN updates its weights and biases using backpropagation.
I ...
- 101
1
vote
1
answer
46
views
Book about distances for data science (can't remember the name)
I saw a book somewhere that listed a big amount of mathematical distance functions (the usual euclidean norms, the discrete distance, the hamming distance, etc) used for data science.
The name of the ...
- 335
1
vote
1
answer
64
views
How has data generation evolved over the years (and centuries)?
I would like to know how data generation has evolved through the years.
My end goal would be to generate a logarithmic line plot showing the ridiculous increase in data generation. Please, does ...
- 335
4
votes
2
answers
1k
views
Given a machine learning algorithm, what is the minimum size of the training set for it?
I understand that the more data we have, the more reliable is our model trained on that data. I also understand that the more parameters a machine learning model has, the more training data it ...
- 1,086
1
vote
0
answers
21
views
Correlation between (average daily) impressions and user response ratio in social media
I'm doing a preliminary study on data from a (niche) social media platform. Studying the correlations between impressions of an object (aka views), interactions (aka likes, comments, ...) and their ...
- 161
4
votes
1
answer
2k
views
What is the best practice to test a ETL pipeline?
In traditional software development practice, before going into production, a piece of code should go through various stages of testing (unit test, integration test, user acceptance test) to secure ...
- 41
0
votes
1
answer
88
views
Protein interaction prediction- how to input this data structure
I know the basics of machine learning and have quite an experience with time series data or data fed in a tabular format. But in the picture, the data is arranged as a graph. Is there a way to input ...
- 469
1
vote
0
answers
148
views
Recognition of objects in almost plain background
I want to recognize climbing holds in a climbing wall. I thought about implementing my own heuristic algorithm for background detection because it's almost plain, but I was wondering if this kind of ...
- 111
2
votes
1
answer
502
views
Do 3D bar charts have advantages over 2D bar charts?
I vaguely remember that there was a study / blog post which made a strong point against 3D bar charts. Do you have a source at hand which compares the two - 2D bar charts and 3D bar charts?
- 18.7k
0
votes
1
answer
70
views
algorithm to auto-download articles from the internet
I have an issued in my homeworks and I thinked if there is an rxisted algorithm or if can i create new one that takes key words like "germany" and "polution" and parses in google scholar. It parses ...
- 9
4
votes
2
answers
163
views
Why Gradient methods work in finding the parameters in Neural Networks?
After reading quite a lot of papers (20-30 or so), I feel that I am quite not understanding things.
Let us focus on the supervised learnings (for example).
Given a set of data $\mathcal{D}_{train}=\{...
- 153
1
vote
0
answers
22
views
Learning Attention Based Models [books]
Today I read an interesting post to drop RNNs for sequential models.
However, the post, unfortunately, didn't go into much detail on how one would study the attention based models and start ...
- 173
7
votes
5
answers
1k
views
Mastering NLP: Reading List
I've searched the web and there are hundreds of recommendations on what to read. The time moves on and new better quality techniques are published, so I would like to know what is relevant in 2018?
...
- 173
0
votes
3
answers
885
views
Forecast vs Prediction: What is the difference?
I use the two terms as follows:
A prediction model gets features (which can be a time series) as input and gives a fixed-length output (might be multiple values, but "atomic" in some sense)
Examples:...
- 18.7k
4
votes
1
answer
150
views
Common Techniques to Generate from a Regression Neural Network Model
I am used to train neural networks that are designed for generation, such as GANs or VAEs.
I am wondering what are the common techniques to generate data that would minimize the target/energy learned ...
- 141
1
vote
1
answer
32
views
Voting patterns similarities
I'm interested in any research materials on voting patterns.
I have a data set of how PMs (members of parliament) voted in my country during last couple of years. Each PM has 3 buttons: Yes, No, ...
- 139
2
votes
2
answers
689
views
Help me choose a Data Science book in Python [closed]
I've been a Data Scientist for a few years now, but I've only recently started to do most of my work in Python (boy, do I miss ggplot2! But ...
- 399
7
votes
3
answers
6k
views
Is there any proven disadvantage of transfer learning for CNNs?
Suppose I know that I want to use a ResNet-101 architecture for my specific problem. There are ReseNet-101 models trained on ImageNet.
Is there any disadvantage of using those pre-trained models and ...
- 18.7k
1
vote
2
answers
192
views
What is the relationship between AI and data science?
I think they share a lot (e.g. machine learning is a subset of both, right?), but maybe both have elements the other doesn't have?
Could you name some in that case? Or is one a subset of the other?
...
1
vote
0
answers
148
views
ElasticSearch for data scientists [closed]
This is to seek career advice for a data scientist. What pertains within the role of data scientist and what does not regarding ElasticSearch.
Does backend development for ElasticSearch using ...
- 865
17
votes
5
answers
4k
views
Beginner math books for Machine Learning
I'm a Computer Science engineer with no background in statistics or advanced math.
I'm studying the book Python Machine Learning by Raschka and Mirjalili, but when I tried to understand the math of ...
1
vote
0
answers
26
views
Possibility of self-growing neural nets
What is the state of the art for DNNs to infer that they need more neurons than in the initial setup? Can they be acquired dynamically from the underlying "resource substrate"?
- 381
1
vote
1
answer
34
views
Classes of neural nets and their applications
Would you say, you could design, tune and/or train any DNN for any application, or do their designs inherently postulate some specialization?
Is there such a review?
For example, are CNNs better for ...
- 381
-2
votes
1
answer
57
views
Can you use machine learning to extract the entropy from a hand print reliably?
Let's say that I want to generate a cryptographic key based on my hand (I'm using hands just as an example). What I could do is I scan my hand (so that the friction ridges are apparent) and then use a ...
- 97
2
votes
2
answers
62
views
Deep Learning to estimate what is beyond the edge
I have an image of some data which is approximately 4,000 x 8,000 pixels. I am interested in finding out if anyone has used a deep learning algorithm to predict what would be on the image if it ...
- 255
1
vote
1
answer
194
views
MOOCs for Python in Data Science
Thanks also to SE, I've recently changed job and now I'm working in Data Science, mainly on Analytics for the IoT (Internet of Things). Analytics are applications on cloud platforms which collect real-...
- 399
4
votes
2
answers
1k
views
MOOC or book on Deep Learning in Python for someone with a basic knowledge of neural networks
I know the concept of a neural network, and I followed the Machine Learning course by Andrew Ng on Coursera, so I also coded some simple ones. However, I miss all the new tricks which are useful to ...
- 399
8
votes
1
answer
10k
views
Keras categorical_crossentropy loss (and accuracy)
When training a neural network with keras for the categorical_crossentropy loss, how exactly is the loss defined? I expect it to be the average over all samples of
$$\textstyle\text{loss}(p^\text{true}...
- 194