Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

5
votes
0answers
182 views

Clustering for high dimensional data

I am having a data set with 52 variables .Most of them are having zeros it resembles like sparse matrix .How to cluster this kind of data and is there any special types of clustering? Here I am ...
5
votes
0answers
480 views

document classification : what is the difference betwen fasttext and DANs ?

I came across two interesting papers which describe promising approaches for document classification using word embedding. [1] the first one is the fasttext algorithm described in the paper : Bag of ...
5
votes
0answers
103 views

How to model segmentation of a sequence to similar parts?

I guess LSTM is good for sequence modeling but how would you model "clustering" with it? Meaning, the input is a sequence and the output is labels with similar properties (I have labeled data). For ...
5
votes
0answers
331 views

Solving multi label image classification using TimeDistributed dense layer

I have a multi label image dataset having 5 labels. Each image can have more than one label at the same time. I am using a convolutional neural network to extract features and those extracted features ...
5
votes
0answers
74 views

Is Minimax Linkage a Lance-Williams hierarchical clustering?

I found the following article on "Hierarchical Clustering With Prototypes via Minimax Linkage". It is stated in Property 6 that Minimax linkage cannot be written using Lance–Williams updates. A ...
4
votes
0answers
49 views

Neural Network Architecture for Identifying Image Copies

I have a large image collection and wish to identify the images within that collection that appear to copy other images from the collection. To give you a sense of the kinds of image pairs that I ...
4
votes
0answers
687 views

AdaBoost implementation and tuning for high dimensional feature space in R

I am trying to implement the AdaBoost.M1 algorithm (trees as base-learners) to a data set with a large feature space (~ 20.000 features) and ~ 100 samples in R. There exists a variety of different ...
4
votes
0answers
427 views

Checkers playing Neural Network evolved with Genetic Algorithm becomes too sensitive to input data changes

I recently embarked on a very ambitious project and I have to say it has turned out a lot better than I expected, I succeeded in coding from scratch a neural network that plays checkers at a very ...
4
votes
0answers
380 views

I am struggling with Time Series pattern recognition and classification problem?

I have some sensor data and it is labelled. Now I want to know how can I extract features from time series using DFT, DWT and HAAR transforms. I know that transformations above transform a signal ...
4
votes
0answers
206 views

how to propagate error from convolutional layer to previous layer?

I've been trying to implement a simple convolutional neural network. But I've been stuck at this problem for over a week. To be specific, assume there are 3 layers in a convolutional pass, marked as ...
4
votes
0answers
165 views

Human Activity Recognition - How to process gyroscope and magnetometer data

I've found many articles (like this one) on HAR that mention using the gyroscope and magnetometer because it improves the precision of HAR performed just with the accelerometer. However no one ...
4
votes
0answers
110 views

Heterodox use of Deep Learning to find hidden patterns

I would appreciate your comments/help about a strategy I am applying in one of my analysis. In short, my case is: 1) My data have biological origin, collected in a period of 120s, from a subject ...
4
votes
0answers
24 views

Completing MDS manually in R

Given a matrix A, I want to complete Multidimensional Scaling by hand, instead of using any given R functions. As such, I have calculated the centered matrix ...
4
votes
0answers
51 views

Error on multitask neural nets where all outputs not observed for every example

Let's say I have 2 datasets, each from a set of experiments. Dataset A measures a set of properties X for set S, while dataset B measures properties Y for set T. X and Y are highly correlated, and S ...
3
votes
0answers
14 views

Do CNNs benefit from HDR images?

I have images with 12 bits per color channel which I use for several detection networks (YOLO, RetinaNet, etc.). Can I expect any precision difference between 12 bpp and 8 bpp as network input? Or is ...
3
votes
0answers
56 views

What is the best way to read SQL dataset in to Tensorflow?

What is the best way to read SQL database in to Tensorflow? Currently, I am using Postgres on server and developed DL algorithm on Tensorflow using Jupyter Lab. How can I import data into Jupyter Lab ...
3
votes
0answers
25 views

How to extract characteristics from text using machine learning?

I would like to develop some kind of model/algorithm that allows me to extract the characteristics of a given product name. (let's say the brand, model and color). I am looking for a solution similar ...
3
votes
0answers
38 views

RNN-based Predictions of Sine Waves with Frequency Different From Training Data

I am wondering if I can generate a sine wave with a frequency different from training data using RNN. For example, Using two training data of two time series, say 0[sec] ~ 10[sec] each: sin(t) and ...
3
votes
0answers
143 views

Interactive labeling/annotating of time series data

I have a data set of time series data. I'm looking for an annotation (or labeling) tool to visualize it and to be able to interactively add labels on it, in order to get annotated data that I can use ...
3
votes
0answers
36 views

How to best estimate the coefficients of a confusion matrix in case of strong class imbalance?

I have a trained binary classifier (forget about how this was trained and think of it as a magical black box) and I would like to measure its classification performance (e.g. compute a confusion ...
3
votes
0answers
15 views

Tuning Lexicon Sentiment-values Using Machine-learning

I'm constructing a sentiment-analysis model using the lexicon-based approach, and wondering if I can tune the weights of each word-feature in the lexicon using machine-learning. Is this achievable ...
3
votes
0answers
30 views

Feature importance over a subset of instance space instead of an entire instance space

I'm really curious if anyone has faced this problem before, or is it even widely studied at all. Imagine we have a feature that isn't important (based on many widely available and textbook feature ...
3
votes
0answers
77 views

Machine Learning & Image Recognition: How to start?

I've been a full stack web developer for 15 years now and would like to be involved in machine learning. There is already a specific scenario for this: We have a database with several million products ...
3
votes
0answers
145 views

Defining State Representation in Deep Q-Learning

So I am having difficulty difficulty figuring out exactly how I want to represent my environment state in my Deep Q-learning problem. Premise: There is a 2D grid space of which an agent needs to ...
3
votes
0answers
42 views

Predicting change of shapes/coordinates

I'm trying to find a way to predict/calculate how a shape (e.g. outline of a glacier) will change in the future—based on its history (previous shape) and additional factors (e.g. Δtemperature). In my ...
3
votes
0answers
152 views

How to properly represent a tic tac toe board to a CNN?

I'm figuring out how to manipulate convolutional neural networks (CNN) in python and I want to apply this kind of NN to an agent player that plays tic tac toe. I know that's weird and the problem ...
3
votes
0answers
33 views

Hochreiter LSTM (p. 4): Maximal values of logistic sigmoid derivative times weight

My questions follow the below page 4 excerpt from Hochreiter's LSTM paper: If $f_{l_{m}}$ is the logistic sigmoid function, then the maximal value of $f^\prime_{l_{m}}$ is 0.25. If $y^{l_{m-1}}$ ...
3
votes
0answers
762 views

ValueError: operands could not be broadcast together with shapes (60002,39) (38,) during pca.transform

I am trying to solve the San Francisco Crime Problem on Kaggle. To begin with, here is my code: ...
3
votes
0answers
25 views

Formula to calculate size of Capsule output similar to the formula for CNN?

Is there any formula to find the output dimensions of a capsule network similar to that of a Convolutional Neural Network? For Example: In CNN, we know that ...
3
votes
0answers
36 views

Deriving diagonal approximation of Hessian in a neural network

Consider the equations relating to the diagonal approximation for the hessian matrix for a neural network in "Pattern Recognition and Machine Learning - Christopher Bishop" (on pg. 250 eq. 5.80) $\...
3
votes
0answers
85 views

How to do give input to CNN when doing a text processing?

As a signal processing engineering and being new to NLP, I am confused with giving input to CNN network. With my knowledge of CNN, I am trying to build a classifier for ethnicity with inputs as text ...
3
votes
0answers
49 views

make prediction with a time serie

I want to build a model that can detect which driver is driving now the car based on a dataset that contains 20 driver records for 3600s each driver ( the dataset contains all the car sensors values ...
3
votes
0answers
436 views

Input for LSTM for financial time series directional prediction

I'm working on using an LSTM to predict the direction of the market for the next day. My question concerns the input for the LSTM. My data is a financial time series $x_1 \ldots x_t$ where each $x_i$...
3
votes
0answers
414 views

AUC computation on multilabel classification

I'm using Tensorflow for an auto-tagging task on audio clips. The problem is actually a multilabel classification problem meaning that each clip can have multiple tags at the same time. Regarding ...
3
votes
0answers
1k views

Why we should not feed LDA with tfidf

Can someone explain why we can not feed LDA topic model with TFIDF? What is wrong with this approach conceptually?
3
votes
0answers
380 views

Sales Dataset to determine best model for predicting future sales

We have a set of products in which we are trying to determine which products we should continue to sell, and which products to remove from our inventory. The file contains BOTH historical sales data ...
3
votes
0answers
326 views

What causes the error in a RNN to increase late in training?

I'm training a 2-layer, 1024 node, dropout of 0.5 RNN over natural text. Specifically, I'm using karpathy's char-rnn which I found to work quite well for most of my use cases. Sometimes however, late ...
3
votes
0answers
369 views

Illustrating the dimensionality reduction done by a classification or regression model

Tl;DR: You can predict something, but how do you explain the prediction? Your usual classification/regression setup Lets say the data is a classic regression/classification problem: several ...
3
votes
0answers
69 views

Train a classifier for a game with feedback on chosen move instead of true labels

I'm having some trouble describing in one line what I want, which is probably why I haven't had much luck with Google. Say I have a game like 2048 where the possible actions each step are fixed (and ...
3
votes
0answers
82 views

Is there an interface for bootstrap sampling in rattle in R?

I am using rattle in R for predictive models and am trying to see whether there is a difference in different sampling methods. The split function at the start of rattle for splitting into training and ...
3
votes
0answers
65 views

Various algorithms performance in a problem and what can be deduced about data and problem?

HI I am currently trying to apply various algorithms to a classification problem to assess which could be better and then try to fine tune the bests of the first approach. I am a beginner so I use ...
2
votes
0answers
21 views

Non-linear Support Vector Regression issue - Sklearn Python 3.6

I am fairly new to Sklearn and machine learning and have encountered an issue when using SVR with an RBF kernel. Below is my predicted data compared directly with my real data: I do not know what I ...
2
votes
0answers
22 views

Detect Missing Records in Dataset

I have a dataset that contains several measures from various widgets on a daily basis. While the widgets remain relatively stable over time, sometimes there are legitimate reasons for one to disappear ...
2
votes
0answers
12 views

How to predict multiple iterations in the future based on current close prices? Keras Python

I have data from CoinMarketCap for the close prices of Bitcoin. How can I use this data to predict multiple days into the future using past days with a function? I want the function to look like: <...
2
votes
0answers
49 views

How does the multi-input deep learning work?

I have a multi-input convolutional neural network model that inputs 2 images from 2 datasets to give one output which is the class of the two inputs. The two datasets have the same classes. I used 2 ...
2
votes
0answers
57 views

Extreme Learning Machine - why random weights rather than space-spanning?

Putting aside the pros and cons of Extreme Learning Machines (ELMs), there is something pretty fundamental that I don't understand: why are the weights and biases in the hidden layer randomised? ...
2
votes
0answers
23 views

it is possible to use features maps of CNN to localised important areas in image?

I'm new in deep learning and CNN, I understand how convolutional and pooling layers work, I understand how and why feature maps are created. How I can localize from the feature maps important area in ...
2
votes
0answers
19 views

Conditional Probabilities on store data

I have data on store level purchases, Panel-level purchases and demographic information of loyalty cards. In the store purchases information, the data consists of a product code which can be assigned ...
2
votes
0answers
38 views

Does Min Max algorithm leads to information loss?

Simplifying the question with an example. Lets say I have a time series data and the variables are time, temperature, growth_of_microbe. Now I have observed usually with a higher high of temperature ...
2
votes
0answers
24 views

detecting anomaly from cdr data

I need to find anomalies from this. The term anomaly in my case is in which square id and in which time the total activity goes higher, how can I detect anomalies with the help of machine learning ...