The Stack Overflow podcast is back! Listen to an interview with our new CEO.

# Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

6,330 questions
Filter by
Sorted by
Tagged with
77 views

### Suggestion for stacked modelling in machine learning

I have built several models on the training dataset and i am not happy with the results and I wish to club them all together and generate a new model, so here is my idea as i already have the results ...
10 views

### Image deblurring network (not a GAN)?

GANs take a long time to train. I have to train and use a machine learning algorithm (not necessarily a deep learning algorithm) that is able to deblur any image (after training it in about 10 hours: ...
4 views

### Dataset for Title Detection and Hierarchization

I am working on a project which deals with detecting Headings in a PDF and developing a hierarchy out of documents(similar to Table Of Contents Generation).I have read some related papers(1,2).But ...
8 views

I have a question about Lemma 26.6 of the book, "Understanding machine learning," by Shalev-Shwartz and Ben-David, (online version: https://www.cs.huji.ac.il/~shais/UnderstandingMachineLearning/copy....
15 views

...
21 views

### LightGBM vs Sklearn LightGBM- Mistake in Implementation- Exact same parameters giving different results

While passing the exact same parameters to LightGBM and sklearn's implementation of LightGBM, I am getting different results. Initially, I was getting the exact same results on doing this, however, I ...
7 views

### Cross Sell, Up-Sell, Recommendation in Insurance Domain via Machine Learning

I have recently started practising machine learning in Insurance Domain. I have been with a use case to develop models to cross-sell, up-sell insurance to existing customers and recommend to new ...
8 views

### How to quickly find min, max and mean distance between samples fitted in Nearest Neighbors?

I am familiar only with SciKit Learn implementation of Nearest Neighbors model where one can fit data and execute K-neighbors or radius queries. This model does not provide any statistical information ...
20 views

### Random forest vs majority voting

I'm using spark with scala to implement majority voting of decision trees and random forest (both are configured in the same way - same depth, same amount of base classifiers etc.). Dataset is split ...
13 views

### Cross-fold validation done on whole dataset or training set?

I have a dataset of 77 samples with 302 features with two labels (0,1). I trained an SVM with gridsearch (cv=5) to perform binary classification. In one run of my script, I do a test-train split, ...
80 views

### How prevalent is C/C++ in machine learning development?

I am currently a data scientist mostly doing NLP, and I do most of my work inPython. Since I didn't get a CS degree in undergrad, I've been limited to very high ...
14 views

### How to form and minimise custom features for classification in supervised learning

I am having an issue in understanding how to form the features based on particular math formula, and how to adjust the weights with. The aim is to draw ellipses for each unique category of points. ...
12 views

### Transfer learning VGG16 does not work as expected. (Detect tacos as hamburgers)

I am new in this field of machine learning, to test I wanted to do a simple project. Create a cnn capable of recognizing hamburger images. As I do not have the ability to collect more than 10,000 ...
35 views

### Finding Criminal Name in news?

We have news URLS, which we want to classify into crimes or non-crimes and further identify criminals by using NERs. For creating a model that identifies criminals, we tried SPacy which gave all the ...
16 views

### Rescale prediction to correct dispersion due to correlation between response and residuals in Random Forrest Regression

I am using Random Forest Regression and I observe a strong positive correlation between the residuals ($\hat{u}$) and the response variable ($y$) which lead to a dispersion : predictions are ...
10 views

### High Level Discussion: Generate synthetic sensor data using data from surrounding sensors

Let's assume I have readings coming from sensors. For every sensor, I have the following information: all the data it reads its location Now, given an arbitrary sensor at an arbitrary location ...
21 views

### Classifying dates in sentences

Let's say I have a sentences that goes like this: Hi, how are the kids. I will be going to Los Angeles next Friday and will come back the following Monday. If the date today is October 16 (...
5 views

### Accelerometer and Gyroscope features

I am having accelerometer and gyroscope reading along x,y,z axis and want to get motion direction info at each time step. What all feature extraction would be best suited for this type of requirement. ...
9 views

### Baldwin Effect in the context of Genetic Algorithms [on hold]

Please explain the concept of Baldwin Effect in the context of Genetic Algorithms, proposed by J. M. Baldwin (1896). I am following the textbook Machine Learning, Indian Edition, Tom. M. Mitchell, pp....
13 views

### How to fix TypeError in spyder?

How to fix TypeError: ufunc 'isnan' not supported for the input types, and the inputs could not be safely coerced to any supported types according to the casting rule ''safe''? ...
30 views

### can we learn a model to pre-process text? [on hold]

I'm in a very dire situation where I have to preprocess the text but the text in the documents is very random. It is in the form of numerical points. I want to remove a certain class of points (...
15 views

### What is the meaning of an empty SHAP graph in Explainable AI?

Using Python, I created a neural network to perform predictions on a binary class dataset (e.g. will a passenger survive the Titanic?). I am using the SHAP package to explain individual predictions. ...
14 views

### Combining text (NLP), numeric and categorical data for a regression problem

I have a dataset ...
10 views

### Optimal practices to group data by Customer ID for churn prediction

Here's a quite common problem and I read a couple of questions/answers on it, however I still having my doubts about what are the best practices for grouping data by Customer ID for churn prediction. ...
27 views

### Multilabel Classification; which network design?

I have a hard time thinking about how I can build this network with the following problem: I want to build a CNN to classify notes from sheet music. I have tried several models with and without ...
6 views

### How to predict the appropriate bidding price for a keyword ad using machine learning? [on hold]

This is just to brainstorm how to design a ML algorithm that helps a company to decide how much to bid for a keyword. How to predict the appropriate bidding price for a keyword ad? What are the ...
24 views

### When using Absolute Error in Gradient Descent, how to calculate the derivative?

What is the derivative of the Loss Function (Absolute Error) with respect to the feature weights that is used to update the weights? Couldn't find anything specific about it anywhere.
7 views

### Tesseract training- JTessBoxEditor issue

I am trying to train my tesseract by making box characters in the images but the JTessBoxEditor is not recognising any characters. When running the command --> tesseract eng.arial.exp1.tiff eng.arial....
16 views

### Rescaling simulations by machine learning

I am working in the field of astrophysics. A problem that I consistently find in my projects is that I am always limited by the size of the sky simulations available for a specific observable that I ...
35 views

### Class Imbalance and Cost-Sensitive Learning XGBoost

I'm fairly new to data science and machine learning and have been trying to read a bit more on methods like boosting for one of the projects I am working on. The investigator on this project is ...
7 views

### Error in the train function

I'm building a model and i want to re preocess the data using PCA but i have an error in the train function : ...
12 views

### Error rate of AdaBoost weak learner always bigger than 0.5?

As far as i understand, weak learners of AdaBoost should never yield a error rate > 0.5 After training one, i only receive error rates above 0.5. How is that even possible? The AdaBoost Tree still ...
9 views

### How to analyzes seaborn's regplot of features from kaggle's houses prices and decide to remove a specific feature?

As a machine learning beginner, I am trying my best to, to solve kaggle's houses prices competition. I am doing pretty well. Some of the fields are confusing. The data set contains about 80 features,...
9 views

### Which ML method for multiclass (non-binary) text classification should I choose (from SparkML)?

I am working on a quite big dataset that will be processed on the cluster, so this is why I am using PySpark for that purpose. The presentable records of this dataset have a such structure: ...
10 views

### evaluate pretrained model on a new class and previously learned classes

I am trying to write a model to demonstrate catastrophic forgetting. I am using cifar10 image dataset that has got images from 10 different classes. Firstly, I trained the model on 8 classes (except <...
9 views

### VAE latent space dimension with Weibull PDFs as input data

I am currently using a Variational Autoencoder to reconstruct PDFs of Weibull distributions with varying parameters (sampled uniformly from a given parameter span). The PDFs are generated by sampling ...
46 views

### How to cluster n-grams?

I just wanted to know how to cluster n-grams based on their semantics. Like clustering together n-grams that are semantically similar by leveraging the distributional hypothesis suggesting that ...
21 views

### How to find whether a dataset is blanced or imbalanced?

I have few dataset to experiment classification(Multi-class). These datasets are about 400GB. I wanted to know whether the dataset is balanced or imbalanced. How to know that dataset is balance or ...
26 views

### Is there room to improve the model? if the train data accuracy is 99.8% but test data accuracy is 90%?

I understand this is a wide question. But there can be some suggestions. I can try some methods which I do not know. I think the model is already prefect on train data. But the test accuracy is a ...
10 views

### Best approach/model to match keywords to sentences [on hold]

I'm very new to machine learning and AI stuff. I have the following problem I want to tackle and would like some advice as to how I should approach it: Basically, I want to take some keywords and ...
33 views

### Hyperparameter tuning and cross validation

I have some confusion about proper usage of cross-validation to tune hyperparameters and evaluate estimator performance and generalizeability. As I understand it, this would be the process you ...
23 views

### Feature Engineering Time Lagged Features

Suppose that you are trying to model the following situation - each of your features is a separate time series, as is the target variable. However, the feature time series occur before the target time ...
26 views

### How exactly do probability distributions help modeling/making decisions?

I am an elementary/wanna-be statistician/data scientist from South Korea. I have been studying a variety of theories of mathematical statistics and different probability distributions. (I apologize ...
14 views

### Training data requirements for NLP models

Are there general guidelines for how much data is required for natural language processing (NLP) classification models? I understand this may depend on the text quality, text length, how accurate the ...
28 views

### Process of solving a problem using ML [on hold]

newbie here. I finished a couple of online courses and read Intro to Statistical Learning, thinking of working on a personal project and would appreciate it if you can clarify some issues: What does "...
28 views

### How to choose solution - Neural Neworks or Scikit-Learn/Numpy/Pandas?

I am trying to solve a problem - categorising and routing service desk emails to concerned teams for resolution. Created and tested a model using Scikit-Learn, Numpy and Pandas. - Tokenized the email ...
10 views

### Data Analysis on Data From Analytical Techniques

We have a set of data that are generated from analytical methods. In other words, data regarding the behavior of a system from different aeronautics and aerodynamics equations. We want to perform data ...
13 views

### MobileNet and MobileNetV2: Bad Inference Results

unfortunately I am having subjectively bad results in inference with pre-trained models of both MobileNet v1 and v2: ...