All Questions

8,057 questions with no answers
Filter by
Sorted by
Tagged with
3 votes
0 answers
153 views

How to design the generator in generative adversarial network (GAN)?

I am new to GAN. And recently read a paper about how to implement GAN in recommender system here I have a question in the paper. The Eq (20) in the paper should ...
jason's user avatar
  • 329
3 votes
0 answers
548 views

Knowing when a GAN is overfitting (sequence classification study)

I have sequences of long, sparse 1_D vectors (3000 digits, made of of 0s and 1s) that I am trying to classify. I have previously implemented a simple CNN to classify them with relative success (with ...
which_command's user avatar
3 votes
0 answers
947 views

Bounding box regression in R-CNN

In R-CNN paper, they give the definition of the target values for bounding box regression Given that $(P, G)$ is a (prediction box, ground-truth box) pair of the form $(x, y, w, h)$ where $x, y$ is ...
HOANG GIANG's user avatar
3 votes
0 answers
453 views

What is the difference between KL-divergence, JS-divergence, Wasserstein distance and MMD?

I was reading about different distribution distances, and came across Kullback-Leibler divergence Jensen-Shannon divergence Wasserstein distance Maximum mean discrepancy (MMD) The book was too ...
asahi kibou's user avatar
3 votes
0 answers
725 views

Deep Reinforcement Learning for dynamic pricing

I am trying to implement a Deep Q Network model for Dynamic pricing in Logistics. I can define State Space (Origin, Destination, type of the shipment, customer, Type of the product, Commodity of the ...
Karthik Rajkumar's user avatar
3 votes
0 answers
329 views

convLSTM : how to structure input data

I have the following dataframe containing training data that I have been using to perform a regression task using CNN + FC : ...
FenryrMKIII's user avatar
3 votes
0 answers
1k views

Multi label classification and sigmoid function

I'm new to neural networks so this may be silly question. I have build standard CNN network for image classification. I want multi-label classification network so I use binary_crossentropy as loss ...
Kamil's user avatar
  • 31
3 votes
0 answers
440 views

Kronecker product using sparse matrices / tensors in tensorflow

I am currently trying to perform a kronecker product on a pair of sparse tensors in tensorflow. I have found some code on another thread to perform the kronecker product using normal tensors. ...
DeepLearner's user avatar
3 votes
0 answers
1k views

How to add control variable in regression using sklearn

I am trying to perform controlled regression using sklearn, I have been using sklearn for fitting dependent variable and independent variable, however, if there is a variable that I want to control ...
Jibin Mathew's user avatar
3 votes
0 answers
61 views

Standardizing data from different distributions

I have energy data from different homes (~200), and I wish to merge all the energy data to create a combined dataset. Since the individual homes have different power consumption, I get different ...
user1439018's user avatar
3 votes
0 answers
1k views

Hierarchical classification with multi-class predictor for every parent node

Edit: It turned out that I had an error in my function to compute the combined probabilities (a typo that changed the behavior of my function quite a bit without giving me an error message). Without ...
Amelia Bones's user avatar
3 votes
0 answers
47 views

How to make machine learning model that reports ambiguity of the input?

Suppose I want to build a neural network regression model that takes one input and return one output. Here's the training data: ...
offchan's user avatar
  • 305
3 votes
0 answers
991 views

Seaborn lmplot hue plotting error

I am trying to colour the points on an lmplot by a categorical variable contained within a column of a DataFrame and I am getting the following error: ...
Geodatsci's user avatar
3 votes
0 answers
753 views

Xgboost rank:ndcg learning per group or for all dataset

I'm trying to implement xgboost with an objective of rank:ndcg I want the target to be between 0-3. In my data for most of the groups, there is only 1 event per ...
Dkova's user avatar
  • 161
3 votes
0 answers
27 views

looking for databases of audio with labelled 'true' and 'deceptive' sections

For lie-detection research I'm looking for databases of speech audio with labelled 'true' and 'deceptive' sections - does anyone have any leads?
jeremy_rutman's user avatar
3 votes
0 answers
59 views

How to use Zero-Shot Learning on text?

Zero-shot learning used to predict the unseen classes using the attributes for each image. For example, we feed the model pictures of horses and pandas. The model will learn how horses look like and ...
ananya's user avatar
  • 131
3 votes
0 answers
254 views

static graphs v.s. dynamic graphs

In summary, static graphs are easy to optimize but lack the expressivity found in higher-level languages; dynamic graphs provide this missing expressivity but introduce new compilation and execution ...
skytree's user avatar
  • 131
3 votes
0 answers
751 views

How to train tensorflow's transformer model on my own data?

https://github.com/tensorflow/models/blob/master/official/transformer has an implementation of transformer model. I want to train the model on my own data(consisting of two files, src.txt, and tgt.txt)...
Abhishek Niranjan's user avatar
3 votes
0 answers
362 views

Multivariate time Series classification - One class

I need your help with time series classification. I have measurements of different medical parameters for patients captured at every one hour. The output label is whether the patient has Acute Kidney ...
The Great's user avatar
  • 2,565
3 votes
0 answers
63 views

How to help neuronal network with an other model

I am working on an image classification problem, the input data normally is images to classify, but I thought latitude and longitude would play something on these satellite images. I sorted by ...
bacloud14's user avatar
  • 453
3 votes
0 answers
877 views

Target transformation for tree models

Can anybody explain why/if target variable transformations could help when dealing with tree based models? I've seen this excellent reply which explains quite well why it shouldn't affect if ...
Ludecan's user avatar
  • 261
3 votes
0 answers
392 views

Layman's explanation of when to use which smoother algorithm/technique: FFT, loess, Savitzky-Golay, etc

As an analytics practitioner, I frequently come across noisy data (e.g. IoT data). When building a model or machine learning algorithm, it can be advantageous to smooth this data. Over the years, I ...
JasonAizkalns's user avatar
3 votes
0 answers
248 views

Best linear algebra library for C++?

I have been trying to find the substitute of numpy and perform some linear algebra using C++. Here's a list of the libraries I have encountered: Eigen Armadillo Dlib GNU Scientific library Please ...
thanatoz's user avatar
  • 2,425
3 votes
0 answers
2k views

Using Keras masking layer with 2D convolutions (Conv2D)

I'm trying to design a neural network including time dependent input with different lengths and I'm currently using a Masking layer. This network worked well with TensorFlow version 1.9.0 but after ...
nirR's user avatar
  • 31
3 votes
0 answers
54 views

Is linear regression on the trees of XGBoost (rather than taking their mean) useful/popular?

Given training data $(\underline{x}_1, y_1),...,(\underline{x_N}, y_N)$, one can choose a variety of ensemble method for trees. These algorithms output a set of trees $T_1, ..., T_n$, and then the ...
Andrew NC's user avatar
  • 131
3 votes
0 answers
425 views

PCA and FastICA in scikit-learn giving near identical results

So after importing my data, transforming it, and splitting into training and test sets I tried running this script for PCA: ...
Jon M's user avatar
  • 31
3 votes
0 answers
147 views

What is an intuitive explanation for the Importance Weighted Autoencoder?

I have been reading a paper by Burda et al. on Importance Weighted Autoencoders(IWAE) but I can't quite grasp what they mean by sampling the terms h1...hk. Do they mean you have separate models from ...
deZakelijke's user avatar
3 votes
0 answers
356 views

How many pairs of image needed for training Siamese Network? And how to augment them?

Hi Deep Learning researchers and engineers, Does anyone have experience in Siamese Network regarding the training data size? How many pairs of image do I need to train a Siamese Network? And what ...
Liang Niu's user avatar
3 votes
0 answers
147 views

Feature Importance Python

My dataset has around 1000 features and 30k rows. All the feautres have value either 1 or 0. My target variable is Size which 3 classes : Small, Medium and Large. I have around 5k "small" data ...
TigSh's user avatar
  • 243
3 votes
0 answers
471 views

Genarate one hour time interval array using pandas in python (import from csv) to predict next value

I am trying to generate one hour one hour time interval to predict next value according to my data set imported from csv file. Here according to the time it will give outputs include in x column. This ...
awa's user avatar
  • 97
3 votes
0 answers
3k views

Is regularization only for regression?

I am making a classification model. I understand that the regularization minimizes loss functions. Can i use regularization techniques to minimize loss function in classification if doing so is ...
Siddhi Kiran Bajracharya's user avatar
3 votes
0 answers
314 views

Do I need to fit on train data for truncated SVD and then transform the test data on fitted train data?

Regarding truncated SVD(single value decomposition) do I need to fit on train data and transform the test data on fitted train data? or can I fit on test and transform on test fit?
Harika M's user avatar
  • 345
3 votes
0 answers
545 views

Convolutional neural network with cross validation in Keras

I want to use K-fold cross-validation on my dataset of images. I am reading the data (images) from a directory. How do I use cross validation with convolutional neural network in Keras?
Noran's user avatar
  • 768
3 votes
0 answers
115 views

Encoder-Decoder Sequence-to-Sequence Model for Translations in Both Directions

Is it possible to use a pre-trained sequence to sequence encoder-decoder model which translates an input text in source language to an output in target language to do an inverse translation? That is, ...
Amir's user avatar
  • 193
3 votes
0 answers
127 views

multiple intents for modifying an intent of a sentence?

Say I have a sentence like 'I refuse to fly' or 'I'd like to fly'. I also have a sentence like 'I don't want to sit'. When training custom intents in one of the available NLU engines (rasa/wit/luis), ...
Lior Messinger's user avatar
3 votes
0 answers
429 views

For stateful LSTM, does sequence length matter?

With stateful LSTM the entire state is retained between both the sequences in the batch that is submitted, and even between separate batches until ...
BigBadMe's user avatar
  • 750
3 votes
0 answers
469 views

Neural Network Prediction regression task, output is a multiple factor of input with same peaks

When I missed some details please point this out. I made a simple sequential LSTM model for regression. The model loss is 3.2145e-06. The data is scaled between 0 and 1. I tried different variations ...
annstudent93's user avatar
3 votes
0 answers
524 views

Validation score (f1) remains the same when swapping labels

I have an imbalanced dataset (True labels are ~10x than False labels) and thus use the f_beta score as a metric for model performance, as such: ...
Jens de Bruijn's user avatar
3 votes
0 answers
1k views

Defining State Representation in Deep Q-Learning

So I am having difficulty difficulty figuring out exactly how I want to represent my environment state in my Deep Q-learning problem. Premise: There is a 2D grid space of which an agent needs to ...
Andrew Spittlemeister's user avatar
3 votes
0 answers
206 views

Identifying computer scanned digits

I have digit images as below which I would like to identify: Some are of slightly worse quality : The images are not of a fixed resolution but are mostly in the range (80*20 to 130 *40). Due to ...
Syed Saad's user avatar
3 votes
0 answers
127 views

Stacking when the the target variable is categorical?

I'm trying to use stacking when predicting for the infamous Iris dataset. Also, I'd like to build to stacked classifier by myself which means I don't want to use mlxtend because it's too "easy" and ...
Nathan Furnal's user avatar
3 votes
0 answers
563 views

What are towers in inception architecture and tensorflow?

My understanding of towers in inception architecture and in tensorflow terminology is that they are part of a neural network model for which separate computation can happen on forward phase and ...
Gaurav Srivastava's user avatar
3 votes
0 answers
313 views

Importing TensorFlow trained model in OpenCV

I want to import a TensorFlow pretrained model in OpenCV dnn C++ module. How can this be done? Are there any examples available?
Naser Piltan's user avatar
3 votes
0 answers
42 views

Ethics of using Existing Algorithms in Competitions

Lets say a paper is published which describes a data science algorithm, and the paper is made available on arxiv (no patent or anything else mentioned in paper). The paper is by a university ...
Pavel Savine's user avatar
3 votes
0 answers
1k views

TypeError: unsupported operand type(s) for %: 'int' and 'NoneType'(Stateful LSTM Keras)

So I have a trained LSTM model with which I am trying to predict future values. The model is stateful as seen below ...
hisairnessag3's user avatar
3 votes
0 answers
49 views

Formula to calculate size of Capsule output similar to the formula for CNN?

Is there any formula to find the output dimensions of a capsule network similar to that of a Convolutional Neural Network? For Example: In CNN, we know that ...
Reuben_v1's user avatar
  • 151
3 votes
0 answers
96 views

Deriving diagonal approximation of Hessian in a neural network

Consider the equations relating to the diagonal approximation for the hessian matrix for a neural network in "Pattern Recognition and Machine Learning - Christopher Bishop" (on pg. 250 eq. 5.80) $\...
ps_'s user avatar
  • 31
3 votes
0 answers
191 views

Next events prediction based on previous events

I have data set of sequences of user executed commands sorted in the order of its occurrence. The data looks like this. ...
msp12's user avatar
  • 31
3 votes
0 answers
165 views

Create top 10 index fund based on >100 stocks

Data I have a zip with ca M=160 csv files, with one csv file per stock. The ticker symbol is in the file name. Each csv file contain the same columns: date, txVolume(USD), txCount, marketcap(USD), ...
jacob's user avatar
  • 287
3 votes
0 answers
377 views

Anomaly detection in cooling process data without exact labels

I have a data set where I look at the cooling of a process. The starting temperature may vary between 580 and 180 degrees. I know that at some point the cooling system failed (see examples in the plot)...
Eulenfuchswiesel's user avatar

15 30 50 per page