# Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

5,692 questions
Filter by
Sorted by
Tagged with
8 views

### Python XGBoost predict_proba returns very high or low probabilities

I trained my data with XGBoost in python with GridSearchCV as follows: ...
12 views

### A multivariate linear regression for explaining impacts of the predictors

I am trying to build a multivariate linear regression and the main goal is to understand how the various features impact the response by understanding the coefficients and their confidence intervals. ...
8 views

### How to train a spacy model for text classification?

Can i know the way or steps to train a spacy model for text classification. (binary classification in my case) Please help me with the process and way to approach.
4 views

### What are contexts where a perceptron model could be defined?

per this post, a perceptron could use the logit function as the activation function. per wiki In the context of neural networks, a perceptron is an artificial neuron using the Heaviside step ...
24 views

### Need guidance aboout which language to learn for Machine Learning

I am currently working in BigData with Spark-Scala framework. I want to learn Machine learning from scratch. Which language would be better to learn for machine learning, Scala or Python.?
5 views

...
5 views

### What's the difference between two kinds of deployment in sagemaker

I read the deployment model in stagemaker from sagemaker webistes: https://docs.aws.amazon.com/sagemaker/latest/dg/how-it-works-deployment.html It says there are two ways for deployment: 1. via AWS ...
6 views

### pros and cons of lexical vs machine learning methods for text mining

I wanted to know what are the pros and cons are of using lexical methods and machine learning methods for classifying texts based topic. I have used a simple method of mining documents related to a ...
6 views

### Suggestions about Anomaly detection in Timeseries data [on hold]

I want to build a Machine Learning model in Python for detecting anomalous transactions for gift card data. The data is all about store details, brand of gift card and gift card info. I have 2 date ...
6 views

### Prepping data for association rules mining

I have access to transactional data from an pharmacy claims database. I can easily create the data in the typical format that is a column for transaction id and a separate column for product i.e. <...
22 views

### Create tensor of a sequence with a defined shape using TensorFlow

Create a tensor Y of shape (2,3) having a sequence of numbers 12,15,18,...., 150 I tried using the below code ...
6 views

### How to determine best lagged value for feature engineering sales data forecasting

Am trying to predict daily sales of a retail product, as part of data setup have extracted sales day, dow, a year from sale date. I would like to apply XGBOOST algorithm on the sales pre-processed ...
27 views

### Data Entry Automation with ML

I am working on a data entry task with approximately 6000 entries to go over. The source comes in the form of a string and can look something like this: Air Canada B737 FFS From this I can ...
14 views

### Does gensim use Negative sampling in Word2vec?

When I train a word2vec model in Gensim on a huge amount of words/data (let's say hundreds of thousands of word vectors), is gensim using negative sampling automatically? Alternatively, is there a ...
30 views

### Timestamp sequence classification

I am trying to classify a series of timestamps using RNN with LSTM. The data consists of timing information extracted from the uplink packets recorded during a website fetch. The dataset contains 100 ...
17 views

### Why does Lasso behave “erratically” when the number of features is greater than the number of training instances?

From the book "Hands-on Machine Learning with Scikit-Learn and TensorFlow 2nd edition" chapter 4: In general, Elastic Net is preferred over Lasso since Lasso may behave erratically when the ...
10 views

### Dimension Mismatch Error during dot product in Python

I have two matrices user_vecs and item_vecs I am trying to take the dot product of the two to build a recommendation engine: ...
18 views

### What kind of model is this?

Can anyone help me identify what kind of Architecture is behind this Application? Is it a "simple" Classification Network? If so how are the heatmaps generated? https://www.youtube.com/watch?v=...
16 views

### Low prediction/classification accuracy due to imbalance in data feeding

I am building the neural network for image analysis to do Chest Xray classification (Abnormal/Pass). The classification accuracy for abnormal Xray is low, I guess it is due to the lack of abnormal ...
16 views

### Pre-trained models

I am starting off with machine learning so could someone tell if there is some site where one can find the current best performing trained models for any specific problem like sentiment analysis or ...
19 views

### How to detect anomalies (errors and exceptions) in log files?

Is this a good approach? So I'm working on a Root Cause Analysis system which should help find the cause/the root error of failed system builds (packaged in a tarball), through the analysis of log ...
18 views

### Handling different length string features and prediction of these based on other features

I am currently working on a problem where the dataset contains 200+ features (Let's call them the code features, e.g no.of.loops, memoryInst, loadInst, etc and Flags that are used to compile code ...
9 views

### Preparing new samples for ML classifier with the same encoders

I was wondering what's the best way to preprocess new samples for my ML classifier. I have a raw data with about 3000 samples. I'm preprocessing it with some LabelEncoders and TargetEncdoders for ...
13 views

### Why does BatchNorm on FC layers increase my error?

I am training a deep CNN for multivariate regression, with three fully connected layers on top of the convolutions. I am using Sigmoid activation for FC layers. When adding BatchNormalization (BN) I ...
9 views

### Comparing satellite data and ground data using RNN

I have extracted data from 4 satellites and ground data (for the past 10 years) of rainfall in excel files separately . Now i need to compare each satellite data with the ground data and find the ...
9 views

### How to shift predicted value to the next input value using neural network model

I have a dataset with three inputs: X1,X2,X3. I wrote a code to predict the next value of X1 in every 60 minute using lstm and I want to shift that value to the next input, then predict its next value ...
9 views

### Text extraction from drwaing files

I need some serious help . I have some mechanical drawing PDF files which are generated from Autocad and Soildwork. attached some images. All I need is I have to extract the text which all are inside ...
21 views

### How to classify product by specific category without machine learning?

I am working on a product classification problem which I have to identify product category. Say for the category, there are 5 levels (Big / medium / small / detail / double detail) 5 million ...
21 views

### Computing complexity for pair-wise distance in single linkage clustering [on hold]

Consider an algorithm to update pair-wise distance between clusters after a merge operation when using single linkage. If the number of points to cluster is n, then the complexity of such an algorithm ...
21 views

### How to normalize complex-valued data?

I'm taking the abs of all elements, compute the mean, subtract it off from the original values. I just feel that this is not correct and can change the vectors. I'm also dividing by the standard ...
14 views

### Sklearn train_test_split() error: Found input variables with inconsistent numbers of samples

I am fitting a regression model on randomly generated X1,x2 and Y be the sum of x1, x2 but I am getting this error ValueError: Found input variables with inconsistent numbers of samples: [2, ...
29 views

### Homomorphism in GloVe (Global Vectors)

Part of GloVe paper for word embeddings (https://nlp.stanford.edu/pubs/glove.pdf), there is a model derivation. It's not clear to me what's going on after Eqn. (3) Where may I find a detailed, easy, ...
22 views

### better confussion matrix higher LogLoss ? Is that possible>

I have tried a 2 different versions of a gbm in a multinomial classification problem. The second model results in better confusion matrix but in worse Log Loss value (at the test sample). How is that ...
14 views

### What's the difference between these two custom sparse categorical accuracy functions?

I have a sequence classification model featuring CustomELMo Embeddings layer + BiLSTM + Fully Connected layer. I've found two custom metrics for sparse_categorical_accuracy, but can't wrap my head ...
21 views

### Classification problem using features with unequal sizes

I am relatively new to Machine Learning/ Deep Learning and currently I am working on a classification problem. I have many 2D images and each of them is a cross section of a specimen showing the ...
24 views

### What is “spatial feature encoding”? Can anyone give a concrete example?

This book "Deep Learning and Convolutional Neural Networks for Medical Image Computing" mentioned a term spatial feature encoding On the other hand, CNN models have been proved to have much higher ...
14 views

### what does a factor of K-fold mean in GPU-based training?

From the book "Deep Learning and Convolutional Neural Networks for Medical Image Computing" As we learned about the current state of research on deep learning, I was surprised to find that other ...
7 views

### Issue with using PCA on MLPClassifier

I'm trying to tune my MLPClassifier using GridSearchCV, but it takes ages, so I was wondering if using PCA data will decrease ...
23 views

### ML Ranking on multiple columns

I'm new to ML world: I have a dataset that has multiple numeric columns, and I'm looking for a process to rank the records based on these features. One non-ML way ...
17 views

### using dataset to classifying and labelling another unlabeded dataset

I collect a collection of posts from Facebook and I use a published sentiment datset to labeling my collected dataset. is this a right technique and what its name is this transfer-learning ?
14 views

### Is Attention-based Neural Machine Translation a generative model discriminative model?

Discriminative models, also referred to as conditional models, are a class of models used in statistical classification, especially in supervised machine learning. A discriminative classifier tries ...
9 views

### How to optimize MAPE in regression algorithms

I have a regression task where the label is varying from about 0.001 to 1000. One of the feature called group, for example, group A corresponding label from 0-0.1 and group G corresponding label from ...
33 views

### Machine Learning algorithm for detecting anomalies in large sets of events

Let's start with the following hypothetical preconditions: There is traffic: normal and anomaly. Each traffic sample contains a list of events (of variable size) Events happen in order, the possible ...
16 views

My code: ...
52 views

### Regression Algorithms in Production

I am interested in predicting if a doctor would prescribe a specific drug and have chosen Logistic Regression as a starting point. I have a few questions: Is feature selection the first step to take ...
13 views

### Validation error is slightly lower than training error, but only for some initial conditions

Fair warning, I'm new to this field, so my process may be odd. Any advice is appreciated. I am currently training a model to reproduce some DFT (density functional theory) data. I have been doing ...
22 views

### Getting Dimension Mismatch when using dot product of two vectors (matrices) [on hold]

I have two vectors user_vecs and item_vecs I am trying to take the dot product of the two to build a recommendation engine: ...
13 views

### Is random forest a kind of spatial feature encoding?

From the book "Deep Learning and Convolutional Neural Networks for Medical Image Computing" On the other hand, CNN models have been proved to have much higher modeling capacity, compared to the ...