Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

Filter by
Sorted by
Tagged with
1
vote
1answer
8 views

Python XGBoost predict_proba returns very high or low probabilities

I trained my data with XGBoost in python with GridSearchCV as follows: ...
0
votes
1answer
12 views

A multivariate linear regression for explaining impacts of the predictors

I am trying to build a multivariate linear regression and the main goal is to understand how the various features impact the response by understanding the coefficients and their confidence intervals. ...
1
vote
1answer
8 views

How to train a spacy model for text classification?

Can i know the way or steps to train a spacy model for text classification. (binary classification in my case) Please help me with the process and way to approach.
0
votes
0answers
4 views

What are contexts where a perceptron model could be defined?

per this post, a perceptron could use the logit function as the activation function. per wiki In the context of neural networks, a perceptron is an artificial neuron using the Heaviside step ...
0
votes
1answer
24 views

Need guidance aboout which language to learn for Machine Learning

I am currently working in BigData with Spark-Scala framework. I want to learn Machine learning from scratch. Which language would be better to learn for machine learning, Scala or Python.?
0
votes
0answers
5 views

What's the difference between two kinds of deployment in sagemaker

I read the deployment model in stagemaker from sagemaker webistes: https://docs.aws.amazon.com/sagemaker/latest/dg/how-it-works-deployment.html It says there are two ways for deployment: 1. via AWS ...
2
votes
0answers
6 views

pros and cons of lexical vs machine learning methods for text mining

I wanted to know what are the pros and cons are of using lexical methods and machine learning methods for classifying texts based topic. I have used a simple method of mining documents related to a ...
0
votes
0answers
6 views

Suggestions about Anomaly detection in Timeseries data [on hold]

I want to build a Machine Learning model in Python for detecting anomalous transactions for gift card data. The data is all about store details, brand of gift card and gift card info. I have 2 date ...
0
votes
0answers
6 views

Prepping data for association rules mining

I have access to transactional data from an pharmacy claims database. I can easily create the data in the typical format that is a column for transaction id and a separate column for product i.e. <...
0
votes
1answer
22 views

Create tensor of a sequence with a defined shape using TensorFlow

Create a tensor Y of shape (2,3) having a sequence of numbers 12,15,18,...., 150 I tried using the below code ...
0
votes
0answers
6 views

How to determine best lagged value for feature engineering sales data forecasting

Am trying to predict daily sales of a retail product, as part of data setup have extracted sales day, dow, a year from sale date. I would like to apply XGBOOST algorithm on the sales pre-processed ...
1
vote
2answers
27 views

Data Entry Automation with ML

I am working on a data entry task with approximately 6000 entries to go over. The source comes in the form of a string and can look something like this: Air Canada B737 FFS From this I can ...
0
votes
1answer
14 views

Does gensim use Negative sampling in Word2vec?

When I train a word2vec model in Gensim on a huge amount of words/data (let's say hundreds of thousands of word vectors), is gensim using negative sampling automatically? Alternatively, is there a ...
0
votes
0answers
30 views

Timestamp sequence classification

I am trying to classify a series of timestamps using RNN with LSTM. The data consists of timing information extracted from the uplink packets recorded during a website fetch. The dataset contains 100 ...
3
votes
2answers
17 views

Why does Lasso behave “erratically” when the number of features is greater than the number of training instances?

From the book "Hands-on Machine Learning with Scikit-Learn and TensorFlow 2nd edition" chapter 4: In general, Elastic Net is preferred over Lasso since Lasso may behave erratically when the ...
0
votes
1answer
10 views

Dimension Mismatch Error during dot product in Python

I have two matrices user_vecs and item_vecs I am trying to take the dot product of the two to build a recommendation engine: ...
0
votes
0answers
18 views

What kind of model is this?

Can anyone help me identify what kind of Architecture is behind this Application? Is it a "simple" Classification Network? If so how are the heatmaps generated? https://www.youtube.com/watch?v=...
0
votes
2answers
16 views

Low prediction/classification accuracy due to imbalance in data feeding

I am building the neural network for image analysis to do Chest Xray classification (Abnormal/Pass). The classification accuracy for abnormal Xray is low, I guess it is due to the lack of abnormal ...
2
votes
2answers
16 views

Pre-trained models

I am starting off with machine learning so could someone tell if there is some site where one can find the current best performing trained models for any specific problem like sentiment analysis or ...
0
votes
0answers
19 views

How to detect anomalies (errors and exceptions) in log files?

Is this a good approach? So I'm working on a Root Cause Analysis system which should help find the cause/the root error of failed system builds (packaged in a tarball), through the analysis of log ...
0
votes
0answers
18 views

Handling different length string features and prediction of these based on other features

I am currently working on a problem where the dataset contains 200+ features (Let's call them the code features, e.g no.of.loops, memoryInst, loadInst, etc and Flags that are used to compile code ...
1
vote
0answers
9 views

Preparing new samples for ML classifier with the same encoders

I was wondering what's the best way to preprocess new samples for my ML classifier. I have a raw data with about 3000 samples. I'm preprocessing it with some LabelEncoders and TargetEncdoders for ...
0
votes
0answers
13 views

Why does BatchNorm on FC layers increase my error?

I am training a deep CNN for multivariate regression, with three fully connected layers on top of the convolutions. I am using Sigmoid activation for FC layers. When adding BatchNormalization (BN) I ...
0
votes
0answers
9 views

Comparing satellite data and ground data using RNN

I have extracted data from 4 satellites and ground data (for the past 10 years) of rainfall in excel files separately . Now i need to compare each satellite data with the ground data and find the ...
0
votes
0answers
9 views

How to shift predicted value to the next input value using neural network model

I have a dataset with three inputs: X1,X2,X3. I wrote a code to predict the next value of X1 in every 60 minute using lstm and I want to shift that value to the next input, then predict its next value ...
0
votes
0answers
9 views

Text extraction from drwaing files

I need some serious help . I have some mechanical drawing PDF files which are generated from Autocad and Soildwork. attached some images. All I need is I have to extract the text which all are inside ...
1
vote
0answers
21 views

How to classify product by specific category without machine learning?

I am working on a product classification problem which I have to identify product category. Say for the category, there are 5 levels (Big / medium / small / detail / double detail) 5 million ...
0
votes
0answers
21 views

Computing complexity for pair-wise distance in single linkage clustering [on hold]

Consider an algorithm to update pair-wise distance between clusters after a merge operation when using single linkage. If the number of points to cluster is n, then the complexity of such an algorithm ...
0
votes
1answer
21 views

How to normalize complex-valued data?

I'm taking the abs of all elements, compute the mean, subtract it off from the original values. I just feel that this is not correct and can change the vectors. I'm also dividing by the standard ...
1
vote
1answer
14 views

Sklearn train_test_split() error: Found input variables with inconsistent numbers of samples

I am fitting a regression model on randomly generated X1,x2 and Y be the sum of x1, x2 but I am getting this error ValueError: Found input variables with inconsistent numbers of samples: [2, ...
1
vote
0answers
29 views

Homomorphism in GloVe (Global Vectors)

Part of GloVe paper for word embeddings (https://nlp.stanford.edu/pubs/glove.pdf), there is a model derivation. It's not clear to me what's going on after Eqn. (3) Where may I find a detailed, easy, ...
1
vote
1answer
22 views

better confussion matrix higher LogLoss ? Is that possible>

I have tried a 2 different versions of a gbm in a multinomial classification problem. The second model results in better confusion matrix but in worse Log Loss value (at the test sample). How is that ...
1
vote
0answers
14 views

What's the difference between these two custom sparse categorical accuracy functions?

I have a sequence classification model featuring CustomELMo Embeddings layer + BiLSTM + Fully Connected layer. I've found two custom metrics for sparse_categorical_accuracy, but can't wrap my head ...
0
votes
1answer
21 views

Classification problem using features with unequal sizes

I am relatively new to Machine Learning/ Deep Learning and currently I am working on a classification problem. I have many 2D images and each of them is a cross section of a specimen showing the ...
1
vote
1answer
24 views

What is “spatial feature encoding”? Can anyone give a concrete example?

This book "Deep Learning and Convolutional Neural Networks for Medical Image Computing" mentioned a term spatial feature encoding On the other hand, CNN models have been proved to have much higher ...
0
votes
1answer
14 views

what does `a factor of K-fold` mean in GPU-based training?

From the book "Deep Learning and Convolutional Neural Networks for Medical Image Computing" As we learned about the current state of research on deep learning, I was surprised to find that other ...
0
votes
0answers
7 views

Issue with using PCA on MLPClassifier

I'm trying to tune my MLPClassifier using GridSearchCV, but it takes ages, so I was wondering if using PCA data will decrease ...
0
votes
0answers
23 views

ML Ranking on multiple columns

I'm new to ML world: I have a dataset that has multiple numeric columns, and I'm looking for a process to rank the records based on these features. One non-ML way ...
0
votes
0answers
17 views

using dataset to classifying and labelling another unlabeded dataset

I collect a collection of posts from Facebook and I use a published sentiment datset to labeling my collected dataset. is this a right technique and what its name is this transfer-learning ?
0
votes
0answers
14 views

Is Attention-based Neural Machine Translation a generative model discriminative model?

Discriminative models, also referred to as conditional models, are a class of models used in statistical classification, especially in supervised machine learning. A discriminative classifier tries ...
0
votes
0answers
9 views

How to optimize MAPE in regression algorithms

I have a regression task where the label is varying from about 0.001 to 1000. One of the feature called group, for example, group A corresponding label from 0-0.1 and group G corresponding label from ...
0
votes
1answer
33 views

Machine Learning algorithm for detecting anomalies in large sets of events

Let's start with the following hypothetical preconditions: There is traffic: normal and anomaly. Each traffic sample contains a list of events (of variable size) Events happen in order, the possible ...
0
votes
2answers
52 views

Regression Algorithms in Production

I am interested in predicting if a doctor would prescribe a specific drug and have chosen Logistic Regression as a starting point. I have a few questions: Is feature selection the first step to take ...
0
votes
0answers
13 views

Validation error is slightly lower than training error, but only for some initial conditions

Fair warning, I'm new to this field, so my process may be odd. Any advice is appreciated. I am currently training a model to reproduce some DFT (density functional theory) data. I have been doing ...
-1
votes
1answer
22 views

Getting Dimension Mismatch when using dot product of two vectors (matrices) [on hold]

I have two vectors user_vecs and item_vecs I am trying to take the dot product of the two to build a recommendation engine: ...
0
votes
0answers
13 views

Is random forest a kind of spatial feature encoding?

From the book "Deep Learning and Convolutional Neural Networks for Medical Image Computing" On the other hand, CNN models have been proved to have much higher modeling capacity, compared to the ...
1
vote
0answers
12 views

Alternatives for MultiLabelBinarizer

There a lot of information on how to handle categorical variables when preprocessing data for ML classification. However, I cannot find any feedback on how to handle categorical variables, where each ...
0
votes
0answers
14 views

How to perform a 1-way ANOVA right after One-Hot-Encoding

I am at the phase of dimensionality reduction. I am trying to figure out which categorical columns I should keep for my model and which I should discard. Because some of my categorical columns have ...