The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

Filter by
Sorted by
Tagged with
3
votes
2answers
77 views

Suggestion for stacked modelling in machine learning

I have built several models on the training dataset and i am not happy with the results and I wish to club them all together and generate a new model, so here is my idea as i already have the results ...
0
votes
0answers
10 views

Image deblurring network (not a GAN)?

GANs take a long time to train. I have to train and use a machine learning algorithm (not necessarily a deep learning algorithm) that is able to deblur any image (after training it in about 10 hours: ...
0
votes
0answers
4 views

Dataset for Title Detection and Hierarchization

I am working on a project which deals with detecting Headings in a PDF and developing a hierarchy out of documents(similar to Table Of Contents Generation).I have read some related papers(1,2).But ...
0
votes
0answers
8 views

linearity of Rademacher complexity

I have a question about Lemma 26.6 of the book, "Understanding machine learning," by Shalev-Shwartz and Ben-David, (online version: https://www.cs.huji.ac.il/~shais/UnderstandingMachineLearning/copy....
1
vote
1answer
21 views

LightGBM vs Sklearn LightGBM- Mistake in Implementation- Exact same parameters giving different results

While passing the exact same parameters to LightGBM and sklearn's implementation of LightGBM, I am getting different results. Initially, I was getting the exact same results on doing this, however, I ...
0
votes
0answers
7 views

Cross Sell, Up-Sell, Recommendation in Insurance Domain via Machine Learning

I have recently started practising machine learning in Insurance Domain. I have been with a use case to develop models to cross-sell, up-sell insurance to existing customers and recommend to new ...
0
votes
0answers
8 views

How to quickly find min, max and mean distance between samples fitted in Nearest Neighbors?

I am familiar only with SciKit Learn implementation of Nearest Neighbors model where one can fit data and execute K-neighbors or radius queries. This model does not provide any statistical information ...
1
vote
2answers
20 views

Random forest vs majority voting

I'm using spark with scala to implement majority voting of decision trees and random forest (both are configured in the same way - same depth, same amount of base classifiers etc.). Dataset is split ...
0
votes
1answer
13 views

Cross-fold validation done on whole dataset or training set?

I have a dataset of 77 samples with 302 features with two labels (0,1). I trained an SVM with gridsearch (cv=5) to perform binary classification. In one run of my script, I do a test-train split, ...
4
votes
2answers
80 views

How prevalent is `C/C++` in machine learning development?

I am currently a data scientist mostly doing NLP, and I do most of my work inPython. Since I didn't get a CS degree in undergrad, I've been limited to very high ...
0
votes
1answer
14 views

How to form and minimise custom features for classification in supervised learning

I am having an issue in understanding how to form the features based on particular math formula, and how to adjust the weights with. The aim is to draw ellipses for each unique category of points. ...
0
votes
1answer
12 views

Transfer learning VGG16 does not work as expected. (Detect tacos as hamburgers)

I am new in this field of machine learning, to test I wanted to do a simple project. Create a cnn capable of recognizing hamburger images. As I do not have the ability to collect more than 10,000 ...
0
votes
2answers
35 views

Finding Criminal Name in news?

We have news URLS, which we want to classify into crimes or non-crimes and further identify criminals by using NERs. For creating a model that identifies criminals, we tried SPacy which gave all the ...
1
vote
0answers
16 views

Rescale prediction to correct dispersion due to correlation between response and residuals in Random Forrest Regression

I am using Random Forest Regression and I observe a strong positive correlation between the residuals ($\hat{u}$) and the response variable ($y$) which lead to a dispersion : predictions are ...
0
votes
0answers
10 views

High Level Discussion: Generate synthetic sensor data using data from surrounding sensors

Let's assume I have readings coming from sensors. For every sensor, I have the following information: all the data it reads its location Now, given an arbitrary sensor at an arbitrary location ...
2
votes
1answer
21 views

Classifying dates in sentences

Let's say I have a sentences that goes like this: Hi, how are the kids. I will be going to Los Angeles next Friday and will come back the following Monday. If the date today is October 16 (...
0
votes
0answers
5 views

Accelerometer and Gyroscope features

I am having accelerometer and gyroscope reading along x,y,z axis and want to get motion direction info at each time step. What all feature extraction would be best suited for this type of requirement. ...
0
votes
0answers
9 views

Baldwin Effect in the context of Genetic Algorithms [on hold]

Please explain the concept of Baldwin Effect in the context of Genetic Algorithms, proposed by J. M. Baldwin (1896). I am following the textbook Machine Learning, Indian Edition, Tom. M. Mitchell, pp....
0
votes
1answer
13 views

How to fix TypeError in spyder?

How to fix TypeError: ufunc 'isnan' not supported for the input types, and the inputs could not be safely coerced to any supported types according to the casting rule ''safe''? ...
0
votes
1answer
30 views

can we learn a model to pre-process text? [on hold]

I'm in a very dire situation where I have to preprocess the text but the text in the documents is very random. It is in the form of numerical points. I want to remove a certain class of points (...
1
vote
0answers
15 views

What is the meaning of an empty SHAP graph in Explainable AI?

Using Python, I created a neural network to perform predictions on a binary class dataset (e.g. will a passenger survive the Titanic?). I am using the SHAP package to explain individual predictions. ...
0
votes
2answers
14 views
0
votes
0answers
10 views

Optimal practices to group data by Customer ID for churn prediction

Here's a quite common problem and I read a couple of questions/answers on it, however I still having my doubts about what are the best practices for grouping data by Customer ID for churn prediction. ...
1
vote
0answers
27 views

Multilabel Classification; which network design?

I have a hard time thinking about how I can build this network with the following problem: I want to build a CNN to classify notes from sheet music. I have tried several models with and without ...
0
votes
0answers
6 views

How to predict the appropriate bidding price for a keyword ad using machine learning? [on hold]

This is just to brainstorm how to design a ML algorithm that helps a company to decide how much to bid for a keyword. How to predict the appropriate bidding price for a keyword ad? What are the ...
0
votes
1answer
24 views

When using Absolute Error in Gradient Descent, how to calculate the derivative?

What is the derivative of the Loss Function (Absolute Error) with respect to the feature weights that is used to update the weights? Couldn't find anything specific about it anywhere.
0
votes
0answers
7 views

Tesseract training- JTessBoxEditor issue

I am trying to train my tesseract by making box characters in the images but the JTessBoxEditor is not recognising any characters. When running the command --> tesseract eng.arial.exp1.tiff eng.arial....
2
votes
0answers
16 views

Rescaling simulations by machine learning

I am working in the field of astrophysics. A problem that I consistently find in my projects is that I am always limited by the size of the sky simulations available for a specific observable that I ...
0
votes
2answers
35 views

Class Imbalance and Cost-Sensitive Learning XGBoost

I'm fairly new to data science and machine learning and have been trying to read a bit more on methods like boosting for one of the projects I am working on. The investigator on this project is ...
0
votes
0answers
7 views

Error in the train function

I'm building a model and i want to re preocess the data using PCA but i have an error in the train function : ...
1
vote
1answer
12 views

Error rate of AdaBoost weak learner always bigger than 0.5?

As far as i understand, weak learners of AdaBoost should never yield a error rate > 0.5 After training one, i only receive error rates above 0.5. How is that even possible? The AdaBoost Tree still ...
0
votes
0answers
9 views

How to analyzes seaborn's regplot of features from kaggle's houses prices and decide to remove a specific feature?

As a machine learning beginner, I am trying my best to, to solve kaggle's houses prices competition. I am doing pretty well. Some of the fields are confusing. The data set contains about 80 features,...
0
votes
1answer
9 views

Which ML method for multiclass (non-binary) text classification should I choose (from SparkML)?

I am working on a quite big dataset that will be processed on the cluster, so this is why I am using PySpark for that purpose. The presentable records of this dataset have a such structure: ...
0
votes
0answers
10 views

evaluate pretrained model on a new class and previously learned classes

I am trying to write a model to demonstrate catastrophic forgetting. I am using cifar10 image dataset that has got images from 10 different classes. Firstly, I trained the model on 8 classes (except <...
0
votes
0answers
9 views

VAE latent space dimension with Weibull PDFs as input data

I am currently using a Variational Autoencoder to reconstruct PDFs of Weibull distributions with varying parameters (sampled uniformly from a given parameter span). The PDFs are generated by sampling ...
3
votes
1answer
46 views

How to cluster n-grams?

I just wanted to know how to cluster n-grams based on their semantics. Like clustering together n-grams that are semantically similar by leveraging the distributional hypothesis suggesting that ...
0
votes
2answers
21 views

How to find whether a dataset is blanced or imbalanced?

I have few dataset to experiment classification(Multi-class). These datasets are about 400GB. I wanted to know whether the dataset is balanced or imbalanced. How to know that dataset is balance or ...
0
votes
1answer
26 views

Is there room to improve the model? if the train data accuracy is 99.8% but test data accuracy is 90%?

I understand this is a wide question. But there can be some suggestions. I can try some methods which I do not know. I think the model is already prefect on train data. But the test accuracy is a ...
1
vote
0answers
10 views

Best approach/model to match keywords to sentences [on hold]

I'm very new to machine learning and AI stuff. I have the following problem I want to tackle and would like some advice as to how I should approach it: Basically, I want to take some keywords and ...
1
vote
1answer
33 views

Hyperparameter tuning and cross validation

I have some confusion about proper usage of cross-validation to tune hyperparameters and evaluate estimator performance and generalizeability. As I understand it, this would be the process you ...
0
votes
0answers
23 views

Feature Engineering Time Lagged Features

Suppose that you are trying to model the following situation - each of your features is a separate time series, as is the target variable. However, the feature time series occur before the target time ...
2
votes
0answers
26 views

How exactly do probability distributions help modeling/making decisions?

I am an elementary/wanna-be statistician/data scientist from South Korea. I have been studying a variety of theories of mathematical statistics and different probability distributions. (I apologize ...
1
vote
0answers
14 views

Training data requirements for NLP models

Are there general guidelines for how much data is required for natural language processing (NLP) classification models? I understand this may depend on the text quality, text length, how accurate the ...
0
votes
1answer
28 views

Process of solving a problem using ML [on hold]

newbie here. I finished a couple of online courses and read Intro to Statistical Learning, thinking of working on a personal project and would appreciate it if you can clarify some issues: What does "...
1
vote
1answer
28 views

How to choose solution - Neural Neworks or Scikit-Learn/Numpy/Pandas?

I am trying to solve a problem - categorising and routing service desk emails to concerned teams for resolution. Created and tested a model using Scikit-Learn, Numpy and Pandas. - Tokenized the email ...
0
votes
0answers
10 views

Data Analysis on Data From Analytical Techniques

We have a set of data that are generated from analytical methods. In other words, data regarding the behavior of a system from different aeronautics and aerodynamics equations. We want to perform data ...
0
votes
1answer
13 views

MobileNet and MobileNetV2: Bad Inference Results

unfortunately I am having subjectively bad results in inference with pre-trained models of both MobileNet v1 and v2: ...
0
votes
1answer
17 views

Classification Model based on Ordered Features

I am trying to build a classifier for a specific card dataset let's say cards or no cards. I am using Mobilenet trained on Imagenet dataset as my classifier and further training it on my dataset. I am ...
1
vote
1answer
32 views

Deep reinforcement learning on changing data sizes

I have a game that I want to build a model that will learn to play the game. Yet, the environment output is two lists that represent the location and number of soldiers of the user and Opponent. The ...