All Questions

6,141 questions with no answers
Filter by
Sorted by
Tagged with
3
votes
0answers
177 views

Why does my model only converge when I add a MaxPooling with stride of 1 layer at the beginning?

I have a model that takes an input of inertial sensor data collected at 60 hertz and outputs one of two classes. I have broken the data into 1 min snapshots which seems to be appropriate. I have split ...
3
votes
0answers
327 views

Adjust class weights due to class imbalance and class importance Multi class classification XGBoost

With respect to this question and the answer given by @Esmailian, Would anyone be able to let me know if Class B has a higher importance or the positive class ( i.e. it needs to have a higher ...
3
votes
0answers
263 views

Grouping the Input Features for LSTM (keras)

When I have a input feature of 2-dimension (variable*feature), is it still good to flatten them into 1-dimension input ...
3
votes
0answers
115 views

How to design the generator in generative adversarial network (GAN)?

I am new to GAN. And recently read a paper about how to implement GAN in recommender system here I have a question in the paper. The Eq (20) in the paper should ...
3
votes
0answers
275 views

Knowing when a GAN is overfitting (sequence classification study)

I have sequences of long, sparse 1_D vectors (3000 digits, made of of 0s and 1s) that I am trying to classify. I have previously implemented a simple CNN to classify them with relative success (with ...
3
votes
0answers
37 views

How to prepare the data for text generation task

First, I'm not sure whether the model contains the encoder during training. EOS means end-of-sentence. Encoder and decoder are part of transformer network. If without-encoder, training time: ...
3
votes
0answers
636 views

How Transformer is Bidirectional - Machine Learning

Asking question in datascience forum, as this forum seems well suited for data science related questions: https://stackoverflow.com/questions/55158554/how-transformer-is-bidirectional-machine-learning/...
3
votes
0answers
641 views

Deep Reinforcement Learning for dynamic pricing

I am trying to implement a Deep Q Network model for Dynamic pricing in Logistics. I can define State Space (Origin, Destination, type of the shipment, customer, Type of the product, Commodity of the ...
3
votes
0answers
227 views

convLSTM : how to structure input data

I have the following dataframe containing training data that I have been using to perform a regression task using CNN + FC : ...
3
votes
0answers
847 views

Multi label classification and sigmoid function

I'm new to neural networks so this may be silly question. I have build standard CNN network for image classification. I want multi-label classification network so I use binary_crossentropy as loss ...
3
votes
0answers
256 views

Kronecker product using sparse matrices / tensors in tensorflow

I am currently trying to perform a kronecker product on a pair of sparse tensors in tensorflow. I have found some code on another thread to perform the kronecker product using normal tensors. ...
3
votes
0answers
583 views

Decision Tree - Preprocessing for very sparse features

How do we pre-process data for very sparse features for a decision tree? From this Turi documentation for decision trees It mentioned this: Why chose decision trees? Different kinds of models ...
3
votes
0answers
43 views

How to make machine learning model that reports ambiguity of the input?

Suppose I want to build a neural network regression model that takes one input and return one output. Here's the training data: ...
3
votes
0answers
2k views

What are the differences between Glueviz and Orange that come installed with Anaconda and how do they compare on performance and workflows?

I've been using Anaconda for quite a while now and these two libraries glue and Orange have sparked interest lately. I've ...
3
votes
0answers
773 views

Seaborn lmplot hue plotting error

I am trying to colour the points on an lmplot by a categorical variable contained within a column of a DataFrame and I am getting the following error: ...
3
votes
0answers
167 views

Training deep CNN with noisy dataset

I am training a Mask RCNN model with a train dataset that has been generated from some simple computer vision operations (color thresholding) and some morphological filtering. The train set captures ...
3
votes
0answers
503 views

Model the predictive relationship between images

Hello fellow machine learners, We have numerous pairs of 64 x 64 (or other dimensionality) images (maps). In each pair, the first image demonstrates a physical parameter, e.g. wind speed, at each ...
3
votes
0answers
17 views

looking for databases of audio with labelled 'true' and 'deceptive' sections

For lie-detection research I'm looking for databases of speech audio with labelled 'true' and 'deceptive' sections - does anyone have any leads?
3
votes
0answers
697 views

How to train tensorflow's transformer model on my own data?

https://github.com/tensorflow/models/blob/master/official/transformer has an implementation of transformer model. I want to train the model on my own data(consisting of two files, src.txt, and tgt.txt)...
3
votes
0answers
252 views

Multivariate time Series classification - One class

I need your help with time series classification. I have measurements of different medical parameters for patients captured at every one hour. The output label is whether the patient has Acute Kidney ...
3
votes
0answers
53 views

How to help neuronal network with an other model

I am working on an image classification problem, the input data normally is images to classify, but I thought latitude and longitude would play something on these satellite images. I sorted by ...
3
votes
0answers
495 views

Target transformation for tree models

Can anybody explain why/if target variable transformations could help when dealing with tree based models? I've seen this excellent reply which explains quite well why it shouldn't affect if ...
3
votes
0answers
131 views

Layman's explanation of when to use which smoother algorithm/technique: FFT, loess, Savitzky-Golay, etc

As an analytics practitioner, I frequently come across noisy data (e.g. IoT data). When building a model or machine learning algorithm, it can be advantageous to smooth this data. Over the years, I ...
3
votes
0answers
82 views

Best linear algebra library for C++?

I have been trying to find the substitute of numpy and perform some linear algebra using C++. Here's a list of the libraries I have encountered: Eigen Armadillo Dlib GNU Scientific library Please ...
3
votes
0answers
39 views

Detect Missing Records in Dataset

I have a dataset that contains several measures from various widgets on a daily basis. While the widgets remain relatively stable over time, sometimes there are legitimate reasons for one to disappear ...
3
votes
0answers
39 views

How can I get the original pixels that lead to the decision in CNN?

I work on medical images and I want to locate the most relevant regions of the image based on deep learning spatially CNN. So I feed my data into VGG16 architecture and get the features maps. Now I ...
3
votes
0answers
2k views

Why does Position Embeddings work?

In the papers "Convolutional Sequence to Sequence Learning" and "Attention Is All You Need", positions embeddings are simply added to the input words embeddings to give the model a sense of the order ...
3
votes
0answers
49 views

Is linear regression on the trees of XGBoost (rather than taking their mean) useful/popular?

Given training data $(\underline{x}_1, y_1),...,(\underline{x_N}, y_N)$, one can choose a variety of ensemble method for trees. These algorithms output a set of trees $T_1, ..., T_n$, and then the ...
3
votes
0answers
151 views

PCA and FastICA in scikit-learn giving near identical results

So after importing my data, transforming it, and splitting into training and test sets I tried running this script for PCA: ...
3
votes
0answers
167 views

How many pairs of image needed for training Siamese Network? And how to augment them?

Hi Deep Learning researchers and engineers, Does anyone have experience in Siamese Network regarding the training data size? How many pairs of image do I need to train a Siamese Network? And what ...
3
votes
0answers
1k views

Cross validation for convolutional neural network

I am using Keras to create a CNN model, and I would to use K-fold cross-validation to train the dataset. The dataset contains images and I am using ...
3
votes
0answers
131 views

Feature Importance Python

My dataset has around 1000 features and 30k rows. All the feautres have value either 1 or 0. My target variable is Size which 3 classes : Small, Medium and Large. I have around 5k "small" data ...
3
votes
0answers
212 views

Genarate one hour time interval array using pandas in python (import from csv) to predict next value

I am trying to generate one hour one hour time interval to predict next value according to my data set imported from csv file. Here according to the time it will give outputs include in x column. This ...
3
votes
0answers
206 views

Do I need to fit on train data for truncated SVD and then transform the test data on fitted train data?

Regarding truncated SVD(single value decomposition) do I need to fit on train data and transform the test data on fitted train data? or can I fit on test and transform on test fit?
3
votes
0answers
343 views

convolutional neural network with cross validation in Keras

I want to use K-fold cross-validation on my dataset of images. I am reading the data (images) from a directory. How do I use cross validation with convolutional neural network in Keras?
3
votes
0answers
1k views

Multivariate, multistep forecasting with LSTM

I want to use an RNN with LSTM to forecast multiple steps into the future, based on multiple inputs. I have some ideas for different ways to approach this, but I'm afraid I'm missing the "right way" ...
3
votes
0answers
633 views

Estimation of Bayes Error / Human-level error

In one of course Andrew Ng mentioned that model (Machine learning) error can't outperform Bayes / human level performance and hence the bias can't avoided.. (Unavoidable bias) How do we determine / ...
3
votes
0answers
958 views

how does XGBoost's exact greedy split finding algorithm determine candidate split values for different feature types?

Based on the paper by Chen & Guestrin (2016) "XGBoost: A Scalable Tree Boosting System", XGBoost's "exact split finding algorithm enumerates over all the possible splits on all the features to ...
3
votes
0answers
110 views

Encoder-Decoder Sequence-to-Sequence Model for Translations in Both Directions

Is it possible to use a pre-trained sequence to sequence encoder-decoder model which translates an input text in source language to an output in target language to do an inverse translation? That is, ...
3
votes
0answers
103 views

multiple intents for modifying an intent of a sentence?

Say I have a sentence like 'I refuse to fly' or 'I'd like to fly'. I also have a sentence like 'I don't want to sit'. When training custom intents in one of the available NLU engines (rasa/wit/luis), ...
3
votes
0answers
312 views

For stateful LSTM, does sequence length matter?

With stateful LSTM the entire state is retained between both the sequences in the batch that is submitted, and even between separate batches until ...
3
votes
0answers
425 views

Neural Network Prediction regression task, output is a multiple factor of input with same peaks

When I missed some details please point this out. I made a simple sequential LSTM model for regression. The model loss is 3.2145e-06. The data is scaled between 0 and 1. I tried different variations ...
3
votes
0answers
32 views

neural network function approximation with constraints

I would like to approximate a function $f(\cdot)$ by means of a neural network given a finite set of observations $f(x_i)$ where $x_i\in\mathbb{R}^n$ and $i=1\dots,N$. However, I have some prior ...
3
votes
0answers
113 views

Deep advantage learning: how to predict the value

I'm currently working on a collection of reinforcement algorithms: https://github.com/lhk/rl_gym For deep q-learning, you need to calculate the q-values that should be predicted by your network. ...
3
votes
0answers
99 views

Pandas: Calculating the best seller to incorporate number of houses sold

I have been analysing seller data and trying to get insights. I have written a groupby statement to get the average price of selling for every seller ...
3
votes
0answers
59 views

Determine the most important documents for supervised learning

I have somewhat of a general/high level question. Assume I'm doing supervised machine learning on some text data (tweets for example) and categorizing the documents to a certain taxonomy (multi-class ...
3
votes
0answers
41 views

Image grid - labels?

I was wondering if labels could be visualized below images in the image grid tool in Image Analytics? I know, this feature might be not terribly useful for images in general, hence unlikely to be ...
3
votes
0answers
489 views

Validation score (f1) remains the same when swapping labels

I have an imbalanced dataset (True labels are ~10x than False labels) and thus use the f_beta score as a metric for model performance, as such: ...
3
votes
0answers
188 views

Identifying computer scanned digits

I have digit images as below which I would like to identify: Some are of slightly worse quality : The images are not of a fixed resolution but are mostly in the range (80*20 to 130 *40). Due to ...
3
votes
0answers
542 views

Keras single sample prediction returns different values

I'm using a pre-trained ResNet50 model in keras and am trying to see predictions for single samples The issue is that model.predict() is returning different values,...

15 30 50 per page