Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

Filter by
Sorted by
Tagged with
0
votes
0answers
8 views

Deep learning on 2D dataset

I have a 2d array of size 2*10^6 uniformly distributed values with array[0,:] as training data with values in range(-40k,40k) and array[1,:] as corresponding labels with values in range(-1,1).How to ...
0
votes
0answers
6 views

Data Entry Automation with ML

I am working on a data entry task with approximately 6000 entries to go over. The source comes in the form of a string and can look something like this: Air Canada B737 FFS From this I can ...
0
votes
1answer
11 views

Does gensim use Negative sampling in Word2vec?

When I train a word2vec model in Gensim on a huge amount of words/data (let's say hundreds of thousands of word vectors), is gensim using negative sampling automatically? Alternatively, is there a ...
0
votes
0answers
12 views

Timestamp sequence classification

I am trying to classify a series of timestamps using RNN with LSTM. The data consists of timing information extracted from the uplink packets recorded during a website fetch. The dataset contains 100 ...
3
votes
2answers
10 views

Why does Lasso behave “erratically” when the number of features is greater than the number of training instances?

From the book "Hands-on Machine Learning with Scikit-Learn and TensorFlow 2nd edition" chapter 4: In general, Elastic Net is preferred over Lasso since Lasso may behave erratically when the ...
0
votes
1answer
6 views

Dimension Mismatch Error during dot product in Python

I have two vectors user_vecs and item_vecs I am trying to take the dot product of the two to build a recommendation engine: ...
0
votes
0answers
15 views

What kind of model is this?

Can anyone help me identify what kind of Architecture is behind this Application? Is it a "simple" Classification Network? If so how are the heatmaps generated? https://www.youtube.com/watch?v=...
0
votes
2answers
13 views

Low prediction/classification accuracy due to imbalance in data feeding

I am building the neural network for image analysis to do Chest Xray classification (Abnormal/Pass). The classification accuracy for abnormal Xray is low, I guess it is due to the lack of abnormal ...
2
votes
2answers
15 views

Pre-trained models

I am starting off with machine learning so could someone tell if there is some site where one can find the current best performing trained models for any specific problem like sentiment analysis or ...
0
votes
0answers
18 views

How to detect anomalies (errors and exceptions) in log files?

Is this a good approach? So I'm working on a Root Cause Analysis system which should help find the cause/the root error of failed system builds (packaged in a tarball), through the analysis of log ...
0
votes
0answers
16 views

Handling different length string features and prediction of these based on other features

I am currently working on a problem where the dataset contains 200+ features (Let's call them the code features, e.g no.of.loops, memoryInst, loadInst, etc and Flags that are used to compile code ...
1
vote
0answers
9 views

Preparing new samples for ML classifier with the same encoders

I was wondering what's the best way to preprocess new samples for my ML classifier. I have a raw data with about 3000 samples. I'm preprocessing it with some LabelEncoders and TargetEncdoders for ...
0
votes
0answers
11 views

Why does BatchNorm on FC layers increase my error?

I am training a deep CNN for multivariate regression, with three fully connected layers on top of the convolutions. I am using Sigmoid activation for FC layers. When adding BatchNormalization (BN) I ...
0
votes
0answers
9 views

Comparing satellite data and ground data using RNN

I have extracted data from 4 satellites and ground data (for the past 10 years) of rainfall in excel files separately . Now i need to compare each satellite data with the ground data and find the ...
0
votes
0answers
9 views

How to shift predicted value to the next input value using neural network model

I have a dataset with three inputs: X1,X2,X3. I wrote a code to predict the next value of X1 in every 60 minute using lstm and I want to shift that value to the next input, then predict its next value ...
0
votes
0answers
8 views

Text extraction from drwaing files

I need some serious help . I have some mechanical drawing PDF files which are generated from Autocad and Soildwork. attached some images. All I need is I have to extract the text which all are inside ...
1
vote
0answers
19 views

How to classify product by specific category without machine learning?

I am working on a product classification problem which I have to identify product category. Say for the category, there are 5 levels (Big / medium / small / detail / double detail) 5 million ...
0
votes
0answers
17 views

Computing complexity for pair-wise distance in single linkage clustering [on hold]

Consider an algorithm to update pair-wise distance between clusters after a merge operation when using single linkage. If the number of points to cluster is n, then the complexity of such an algorithm ...
0
votes
1answer
20 views

How to normalize complex-valued data?

I'm taking the abs of all elements, compute the mean, subtract it off from the original values. I just feel that this is not correct and can change the vectors. I'm also dividing by the standard ...
1
vote
1answer
13 views

Sklearn train_test_split() error: Found input variables with inconsistent numbers of samples

I am fitting a regression model on randomly generated X1,x2 and Y be the sum of x1, x2 but I am getting this error ValueError: Found input variables with inconsistent numbers of samples: [2, ...
1
vote
0answers
28 views

Homomorphism in GloVe (Global Vectors)

Part of GloVe paper for word embeddings (https://nlp.stanford.edu/pubs/glove.pdf), there is a model derivation. It's not clear to me what's going on after Eqn. (3) Where may I find a detailed, easy, ...
1
vote
1answer
22 views

better confussion matrix higher LogLoss ? Is that possible>

I have tried a 2 different versions of a gbm in a multinomial classification problem. The second model results in better confusion matrix but in worse Log Loss value (at the test sample). How is that ...
1
vote
0answers
12 views

What's the difference between these two custom sparse categorical accuracy functions?

I have a sequence classification model featuring CustomELMo Embeddings layer + BiLSTM + Fully Connected layer. I've found two custom metrics for sparse_categorical_accuracy, but can't wrap my head ...
0
votes
1answer
21 views

Classification problem using features with unequal sizes

I am relatively new to Machine Learning/ Deep Learning and currently I am working on a classification problem. I have many 2D images and each of them is a cross section of a specimen showing the ...
1
vote
1answer
23 views

What is “spatial feature encoding”? Can anyone give a concrete example?

This book "Deep Learning and Convolutional Neural Networks for Medical Image Computing" mentioned a term spatial feature encoding On the other hand, CNN models have been proved to have much higher ...
0
votes
1answer
14 views

what does `a factor of K-fold` mean in GPU-based training?

From the book "Deep Learning and Convolutional Neural Networks for Medical Image Computing" As we learned about the current state of research on deep learning, I was surprised to find that other ...
0
votes
0answers
7 views

Issue with using PCA on MLPClassifier

I'm trying to tune my MLPClassifier using GridSearchCV, but it takes ages, so I was wondering if using PCA data will decrease ...
0
votes
0answers
22 views

ML Ranking on multiple columns

I'm new to ML world: I have a dataset that has multiple numeric columns, and I'm looking for a process to rank the records based on these features. One non-ML way ...
0
votes
0answers
17 views

using dataset to classifying and labelling another unlabeded dataset

I collect a collection of posts from Facebook and I use a published sentiment datset to labeling my collected dataset. is this a right technique and what its name is this transfer-learning ?
0
votes
0answers
14 views

Is Attention-based Neural Machine Translation a generative model discriminative model?

Discriminative models, also referred to as conditional models, are a class of models used in statistical classification, especially in supervised machine learning. A discriminative classifier tries ...
0
votes
0answers
9 views

How to optimize MAPE in regression algorithms

I have a regression task where the label is varying from about 0.001 to 1000. One of the feature called group, for example, group A corresponding label from 0-0.1 and group G corresponding label from ...
0
votes
1answer
32 views

Machine Learning algorithm for detecting anomalies in large sets of events

Let's start with the following hypothetical preconditions: There is traffic: normal and anomaly. Each traffic sample contains a list of events (of variable size) Events happen in order, the possible ...
0
votes
2answers
50 views

Regression Algorithms in Production

I am interested in predicting if a doctor would prescribe a specific drug and have chosen Logistic Regression as a starting point. I have a few questions: Is feature selection the first step to take ...
0
votes
0answers
13 views

Validation error is slightly lower than training error, but only for some initial conditions

Fair warning, I'm new to this field, so my process may be odd. Any advice is appreciated. I am currently training a model to reproduce some DFT (density functional theory) data. I have been doing ...
-1
votes
1answer
21 views

Getting Dimension Mismatch when using dot product of two vectors (matrices) [on hold]

I have two vectors user_vecs and item_vecs I am trying to take the dot product of the two to build a recommendation engine: ...
0
votes
0answers
13 views

Is random forest a kind of spatial feature encoding?

From the book "Deep Learning and Convolutional Neural Networks for Medical Image Computing" On the other hand, CNN models have been proved to have much higher modeling capacity, compared to the ...
1
vote
0answers
12 views

Alternatives for MultiLabelBinarizer

There a lot of information on how to handle categorical variables when preprocessing data for ML classification. However, I cannot find any feedback on how to handle categorical variables, where each ...
0
votes
0answers
14 views

How to perform a 1-way ANOVA right after One-Hot-Encoding

I am at the phase of dimensionality reduction. I am trying to figure out which categorical columns I should keep for my model and which I should discard. Because some of my categorical columns have ...
0
votes
0answers
10 views

Which machine learning algorithms result in trained models with deterministic execution times?

Which machine learning algorithms result in trained models which have a deterministic execution time?
0
votes
1answer
34 views

Supervised Learning Quiz website?

What are some good websites which provide quiz questions on supervised learning and machine learning in general? I have a quiz coming up and I would like to be prepared for it.
0
votes
1answer
19 views

How to handle large number of categories in a dataset?

I have one dataset of "Books" which contains 8 columns initially and out of which 3 of them contains text values which can be categorized. The 3 columns contains "Language-code", "Author Name" and "...
1
vote
0answers
22 views

I have tried 5 different types of model but all returns really low training accuracy (~64%) and low testing accuracy (~14%). What should I do?

I am working with a typical regressor problem. There are $6$ features in the dataset that I am concerned with. There are about $800$ data points in my dataset. The features and the predicted values ...
2
votes
2answers
43 views

Two different cost functions for neural networks, how they can give the same result?

One is: $$J=-\frac{1}{m}\sum_{i=1}^{m}\sum_{k=1}^{K}\Big[y_{k}^{i}\log\big((h_{\theta}(x^{i}))_k\big)+(1-y_{k}^{i})\log\big(1-(h_{\theta}(x^{i}))_k\big)\Big]$$ The other one is: $$J=-\frac{1}{m}\sum_{...
0
votes
2answers
38 views

How to learn certain Maths to understand machine Learning papers?

I have done the deeplearning.ai course on deep learning. But I cannot Understand equations like minGmaxDV(D,G)=Ex∼pdata(x)[logD(x)]+Ez∼pz(z)[log(1−D(G(z)))] ...
1
vote
2answers
44 views

How to automate ANOVA in Python

I am at the dimensionality reduction phase of my model. I have a list of categorical columns and I want to find the correlation between each column and my continuous ...
3
votes
1answer
20 views

Multi-Head attention mechanism in transformer and need of feed forward neural network

After reading the paper, Attention is all you need, I have two questions: 1. What is the need of a multi-head attention mechanism? The paper says that: "Multi-head attention allows the model to ...
0
votes
0answers
7 views

Loss function for multi-class classifiction where output variable is a level i.e the various classes are dependent on each other

Let's say we are classifying Images of cat , fish and human. Classifying a cat as human is as wrong as classifying it as fish, so here the normal loss functions/ metrics like Confusion matrix is fine. ...
0
votes
0answers
22 views

Multi-Model Learning | Text and Image | Mutually Differentiable Models | Is it possible?

Problem : Document classification of scanned financial documents using Text (OCR on the images) and Images. The documents are both structural (forms, tables), unstructured (letters, descriptions, ...
1
vote
0answers
10 views

Predicting electricity consumption in a household

Please I need your help in brainstorming on a problem. I have a community, in this community, every household has a 'power device' that powers the household. Households need to buy power units from a ...