Questions tagged [deep-learning]

a new area of Machine Learning research concerned with the technologies used for learning hierarchical representations of data, mainly done with deep neural networks (i.e. networks with two or more hidden layers), but also with some sort of Probabilistic Graphical Models.

Filter by
Sorted by
Tagged with
0
votes
0answers
12 views

Autoencoder anamoly detection

I recently learnt about the anamoly detection using autoencoders(specifically denoisinng autoencoders).To train the autoencoders do we need a data having some pattern? or is there some way to ...
0
votes
0answers
5 views

Cannot convert between a TensorFlowLite buffer with 1392640 bytes and a Java Buffer with 4177920 bytes

I am using Tensorflow.Lite.Support function for Inference of a model that takes two input and gives output in the form of Image. The first input is an RGB image whereas the second image is a single-...
3
votes
0answers
28 views

Gradient of Mean Squared Error

For a neural network I'm building, I'm using Mean Squared Error defined as $$E = \frac{1}{N}\sum_{n}(\hat{y_n}-y_n)^2$$ where $\hat{y}$ and $y$ are both vectors of length $N$ and $n = 0,\dots,n-1$. ...
0
votes
0answers
26 views

How to approach new project in Medical Image analysis?

I am working on a project in medical image analysis - Breast cancer detection. And since I am the one who has proposed this project I was wondering, what would be the (data science) steps its ...
1
vote
0answers
20 views

Why would one use Deep Learning on non-local datas?

I understand the using of deep-learning for datas that have "local" datas, for example images/videos/texts, as the convolutionals layers reduce the amount of dimensions. However, I saw that some ...
0
votes
1answer
18 views

Does it make sense to do train test split when trainning GANS?

For normal supervised learning the dataset is split in train and test (let's keep it simple). Generative Adversarial Networks are unsupervised learning but there is a supervised loss function in the ...
1
vote
0answers
31 views

Can anyone direct me on how to got to [closed]

I am a newbie to python. I have uploaded about 2000 images into my google drive, assigned a variable to all content in the folder and tried to split the folder's content into training and testing, ...
2
votes
1answer
51 views

How to properly apply CrossValidation and/or split the dataset?

I have a particular problem and do not really now how to properly validate my experiments in this scenario. There is one big data set with 100.000 samples, 99.000 y=0, 1.000 y=1 Each sample has 1.000 ...
2
votes
1answer
28 views

Why does MAE differ after prediction (Neural Network)?

I'm having trouble understanding what's happening in the following code. I already have defined x_train, y_train, x_val, y_val and x_test which define my training, validation and test sets. I'm using ...
5
votes
1answer
39 views

Activation function between LSTM layers

I'm aware the LSTM cell uses both sigmoid and tanh activation functions internally, however when creating a stacked LSTM architecture does it make sense to pass their outputs through an activation ...
2
votes
1answer
24 views

Risk prediction vs classification model

I am working on a binary classification model. Currently when I use Scikit logistic regression, it outputs me binary values like 0s and 1s. But I understand through online reading that it outputs ...
5
votes
3answers
77 views
+100

How can we extract fields from images?

I am making an document parser which extracts data fields from the documents and store them in a structured way. Each field in my dataset is horizontal which is easy to extract. But the model fails ...
2
votes
0answers
23 views

Generative Model for learning Periodic solutions 3-body/N-body problems

I am tasked with finding research where a GAN or any other generative model is used to generate new shapes of 3-bodies moving under the influence of each others' gravitational pull, in a periodic ...
2
votes
0answers
30 views
+50

Will this MAPE implementation work for multidimensional output?

I'm currently working on a CNN problem where the output is a 60x59 array of numerical values. I wanted to verify if the mean absolute percentage error (MAPE) function I'm employing will properly ...
1
vote
0answers
19 views

How to classify unseen text data?

I am training an text classifier for addresses such that if given sentence is an address or not. ...
0
votes
1answer
15 views

Structuring CIFAR100 for resnet18

This will probably be a basic question since I am starting with computer vision. I am trying to use resnet18 from pytorch and work with CIFAR-100 dataset. Single image has size 3x32x32 and the model ...
1
vote
0answers
11 views

How to build Explanatory Graph for Convolutional Neural Network?

I m reading very interesting paper (https://arxiv.org/pdf/1812.07997.pdf) that aims to interpret convolutional neural network using graph. The general idea is when there are co-related parts in layers ...
1
vote
0answers
12 views

how to train a model to fetch the organization from Resume

I would like to train a model , which can be used to extract the Skills and Organization from CV. Though i have fetched the same manually through regular expression but i want to build a model for ...
1
vote
0answers
40 views

How could we use a neuron instead of 100 neurons in 0.01 standard Weight initialization

Many books explain that we don't need to use 100 neurons and just can use a neuron if all result values(sigmoid(Wx)) are same at each of hidden layers. but, I don't know that we can just use a ...
1
vote
1answer
44 views

Fastest way to relearn machine/deep learning

I hope I came to the right place to ask this question. Back when I was at collage I studied machine and deep learning in-depth. My whole programme was based on those areas. I knew all underlying ...
0
votes
0answers
14 views

Generic object detection - unspecified list of classes and high accuracy

As a part of a small project, I would like to create tags for a set of pictures (posters). I know that if I want to recognize a lot of objects I need to have a model which was trained on a large ...
1
vote
0answers
19 views

Deep learning based Resume Parser and Scoring

I want to know if Deep learning can be used for Resume Parsing and scoring of the resume. Currently what I am doing is extracting the text from pdf or image using OCR/tesseract and finding the ...
3
votes
1answer
37 views

What do positive and negative gradient values mean for Convolutional Neural Network?

As we have the typicall pass of the neural network we make a forawrd pass to predict classes and then we have cost function and based on that we calculate gradients. I'm wondering what are the ...
2
votes
1answer
23 views

Using embedding layer output as input to .fit() call in Keras

I want to build a classifier in Keras that predicts the next item bought by a customer (i.e. multiclass classification). One of the features I intend to input to the model will be the last item bought ...
3
votes
1answer
62 views

Fake News Detection problem

I would like to work on a project for Fake News Detection especially for Indians news which are in different languages and different formats. Fake news as image with no or very less text Fake news on ...
1
vote
0answers
12 views

Determining position of anchor boxes in original image using downsampled feature map

From what I have read, I understand that methods used in faster-RCNN and SSD involve generating a set of anchor boxes. We first downsample the training image using a CNN and for every pixel in the ...
5
votes
1answer
218 views

Why ML model produces different results despite random_state defined? And how to set global random seed for sklearn

I have been running few ML models on same set of data for a binary classification problem with class proportion of 33:67. I had the same algorithms and same set of hyperparamters during yesterday and ...
2
votes
1answer
27 views

Find Net Reclassification Improvement/Index metric using Python

I am working on a binary classification problem with ~5k records and class proportion of 33:67. I have 60 features/variables in my dataset and finally I have come to about 10 variables based on ...
2
votes
1answer
31 views

How to evaluate performance of a new feature in a model?

I am working on a binary classification where I have 4712 records with Label 1 being 1554 records and Label 0 being 3558 records. When I tried multiple models based on 6,7 and 8 features, I see the ...
1
vote
1answer
27 views

Why results of statsmodel logreg is different from scikit-learn logreg?

I am trying to do a binary classification. I have only 6 input variables and one output variables. Label 1 is 1554 records and Label 0 is 3558 records. As you can see below, the metrics that I get ...
1
vote
0answers
17 views

Count number of cards stacked one over the other [closed]

I have a stack of ATM cards and I want to count the number of cards available in the stack. How to proceed through it? I'm using Python 3.6.0 and opencv2. I'm attaching PNG file of the images. Kindly ...
2
votes
1answer
18 views

Extracting name, date and total from a set of heterogeneous receipts

So, this is how the problem goes: I am trying to extract information from scanned receipts like this, What I have been told is that I would get the textual data from a OCR software, so in short I ...
8
votes
4answers
321 views

How to impute Missing values not the usual way?

I have a dataset of 4712 records working on binary classification. Label 1 is 33% and Label 0 is 67%. I can't drop records because my sample is already small. Because there are few columns which has ...
2
votes
1answer
24 views

Unable to do resampling using Python SMOTE

I am trying to do a simple ML re-sampling approach after the train-test split. However when I do this, it throws the below error. Can you please help me understand what is this error about? ...
2
votes
0answers
21 views

Proper loss function for sequence prediction model with multi-step output

Consider a typical time series (sequence) prediction problem that use previous $k$ step historical features to predict the next step target. We use RNN model as an ...
1
vote
0answers
17 views

How to handle data with dependency on two different dates

I am currently dealing with a dataset that contains multiple date-time fields: "buy-date" and "receive-date" which both have an effect on the prices and amount of offers made. One example could be: <...
0
votes
1answer
16 views

PELU activation: how does it work, and how to implement?

I have encountered PELU (Parametric Exponential Linear Unit) in the literature, but I can't find practical applications of it. Moreover, I have some questions about how it works: Are its parameters ...
0
votes
1answer
23 views

How can I extract the reason of the legal compensation from a court report?

I'm working on a project (court-related). At a certain point, I have to extract the reason of the legal compensation. For instance, let's take these sentences (from a court report) Order mister X to ...
1
vote
0answers
18 views

Does Minibatch reduce drawback of SGD?

Many expert said "Batch has more local optimal possibility than SGD". But, I don't know the reason.. How SGD could avoid local optimal better than Batch? (Some people tell me about over shooting as ...
3
votes
0answers
20 views

How to quantitatively evaluate raw neural network activations?

Below are the activations for 2 different predictions. These predictions are for different labels/classes. They are being run through a dense Keras NN (96.6% accurate) with 2 hidden layers and adam ...
3
votes
1answer
43 views

TensorFlow / Keras: What is stateful = True in LSTM layers?

Could you elaborate on this argument? I found the brief explanation from the docs unsatisfying: stateful: Boolean (default False). If True, the last state for each sample at index i in a batch will ...
1
vote
1answer
27 views

How to use scikit metrics for a statsmodel or vice versa?

Am working on binary classification problem with 5K records. Label 1 is 1554 and Label 0 is 3558. I did refer this post but not sure whether it is updated now or anyone has any way to compute this ...
2
votes
1answer
27 views

Multilingual Bert sentence vector captures language used more than meaning - working as interned?

Playing around with BERT, I downloaded the Huggingface Multilingual Bert and entered three sentences, saving their sentence vectors (the embedding of [CLS]), then ...
1
vote
1answer
18 views

Extract Information from PDF using DL

We are having this requirement of extracting information from a credit history document. Usually it is a PDF and a computer generated document. Because these PDFs are generated by different sources, ...
2
votes
1answer
44 views

How to Bootstrap dataset for 10000 AUC scores?

I am new to ML and trying to learn the nuances. I work on a binary classification problem with 5K records. Label 1 is 1554 and Label 0 is 3554. What I currently do is 1) split the data into train(...
2
votes
1answer
35 views

Predicting future order dates and order amounts for customers with online retail data

Using the online retail II dataset (https://archive.ics.uci.edu/ml/datasets/Online+Retail+II), I'm trying to predict when each customer will place subsequent orders, and if possible, the monetary ...
2
votes
1answer
22 views

reduction of model accuracy while using PCA for a regression problem

I am trying to build a prection problem to predict the fare of flights. My data set has several catergorical variables like class,hour,day of week, day of month, month of year etc. I am using multiple ...
0
votes
0answers
10 views

CNN filter for music spectrograms

I am new to Data science and I am trying to build a neural Network to recognise Musical Instruments .. I am Kind lost here on how to choose the CNN filter size ?
1
vote
1answer
32 views

Threshold to consider new feature as a new finding to a model?

I am working on binary classification problem with 5K records and 60 features. Through feature selection, I narrowed it down to 14 features. In existing literature, I see that there are well-known 5 ...
0
votes
1answer
27 views

How neural style transfer work in pytorch?

I am using this pytorch script to learn and understand neural style transfer. I understood most part of the code but having some hard time understanding some parts of the code. In ...