Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

Filter by
Sorted by
Tagged with
0
votes
1answer
16 views

Dynamic Regression Prediction with Flask(or sth. similar)

as a self learner Data Scientist I am working on deploying my model in order to get regular predictions. And I need your guidance about deployment section, in which I know nothing about and there is ...
0
votes
0answers
34 views

Random Forest Regressor over-estimating near a certain range of actual values [closed]

Below is my plot after finding predictions with Random Forest Regressor. The X-axis actually $log(Sales Price)$. I would like to know why the model is not estimating well near the mean of the plot. ...
0
votes
0answers
4 views

Why NARX neural network and Hammerstein-Wiener model perform worse than simple sigmoid network nonlinearity estimator on any predictions?

I am currently working on dynamic modeling and exploring different techniques and algorithms to deploy a dynamic time-series black-box model. My data looks like the following: I have 7 inputs and 1 ...
1
vote
1answer
21 views

What is better: Cross validation or a validation set for hyperparameter optimization?

For hyperparameter optimization I see two approaches: Splitting the dataset into train, validation and test, and optimize the hyperparameters based on the results of training on the train dataset and ...
0
votes
0answers
10 views

Machine Learning on Android Studio [closed]

I deployed decision tree in RStudio, I converted it in pmml and I tried to import it in Android. Now, I need to convert it in .ser file, but I have some errors. I had already write the pom.xml files, ...
0
votes
1answer
11 views

Alternating Least Squares

can anyone explain difference between Alternating Least Squares(ALS) and the recommendation systems? it will be helpful if you give me an example.
1
vote
1answer
19 views

Why is Regularization after PCA or Factor Analysis a bad idea?

I have done Factor Analysis on my data and applied various machine learning models on it. I particularly find it giving high MSE value for Ridge and Lasso Regression compared to other models. I want ...
0
votes
0answers
8 views

Self-learning NN that finds unusual patterns in pictures

For a defect detection project, I'm trying to find a way for a neural net to be able to detect unusual patterns in images. Most of the images are very identical (95-99% of them) and sometimes a defect ...
3
votes
2answers
267 views

What are bias and variance in machine learning?

I am studying machine learning, and I have encountered the concept of bias and variance. I am a university student and in the slides of my professor, the bias is defined as: $bias = E[error_s(h)]-...
-1
votes
0answers
21 views

Can the trained model for AI in sentiment prediction can be used on all datasets to predict? [closed]

I am new to AI I am using AI for sentiment analysis to predict sentiment using NLP libraries in order to pre-processing text existing in datasets. For this, I trained a dataset and create a model ...
0
votes
0answers
15 views

Some Confusions Regarding Variable Importance Extraction of Several Machine Learning Models

I'm trying to apply several machine learning algorithms in R using caret (decision trees, ensemble methods (bagging, boosting, ...
0
votes
0answers
11 views

Extract locations from text - NER with Gazetteer, compare n-grams?

I have a (relatively) simple problem to solve, but don't know about the best practice how to solve it. Given a list of several locations/places/point of interests ("Super Beer Bar", "...
1
vote
0answers
18 views

Multiple Time Series Forecasting with limited data

I'm doing time series forecasting for the sales of an assortment of items. The data set I have contains two years of sales record of items that are may or may not still be selling. The challenging ...
0
votes
1answer
27 views

Identifying potential customers based on their Rank and Value

I have a dataset which has demographic data available for a list of new customers. the data does'nt include transaction data of the customers. I want to identify the top 100 potential customers among ...
-1
votes
0answers
12 views

Text Clustering

I have a list of job titles ( a small snippet is shown below): AMB Analyst AC Technician Account Technician Acting Principal Banker Supervisor Bartender Boat operator Cargo supervisor Chef I would ...
-1
votes
1answer
26 views

Data model with more outputs than inputs?

I am working on parametric studies in physics simulations, i.e. I vary some real input parameters (e.g. x0,x1,x2,x3) and get an output with a larger size (e.g. y0,y1 ... y100). Assuming that I have a ...
0
votes
0answers
21 views

Can Shapley/Lime values be used for unsupervised learning?

One thing that is really useful when getting local explanations are Shapley Values and Lime. But can they be used with unsupervised learning? Let's say we are doing anomaly detection with tabular data ...
0
votes
0answers
14 views

Feature-Target correlation graphs [closed]

I have a set of features and labels with the following dimensions: where axis=0 corresponds to the number of pixels and axis=1 corresponds to the features and time, for example, 17=117 where 17 is the ...
0
votes
1answer
23 views

Problem with PCA [closed]

I am getting the message Input contains NaN, infinity or a value too large for dtype('float64') when I run the pca.fit(X_train) ...
0
votes
0answers
25 views

Deep Reinforcement Learning with Space Invaders

I want to better understand Deep Reinforcement Learning so I developed the Space Invaders game from scratch with Pygame. I have a fixed number of enemies (10). Instead of defining the states as a ...
1
vote
1answer
29 views

Is it possible to forecast the evolution of cars?

Let's say for example that I have a dataset about the cars that a company (e.g. Toyota) produced, over the course of the years 1990 - 2016. Considering that I have already completed the feature ...
0
votes
1answer
18 views

How to distinguish between different values of a hyperparameter in communication?

From Wikipedia: In machine learning, a hyperparameter is a parameter whose value is used to control the learning process. If we go by the definition of parameter in What's the difference between an ...
0
votes
0answers
18 views

Datacamp is worth for learn data science and machine learning for beginner? [closed]

I am visiting Datacamp's website because I would like to learn about data science and machine learning. They have two subscriptions: Standard and Premium. Do you have any knowledge about this ...
0
votes
0answers
13 views

if gbm overfit, will variable importance calculation be accurate

If we are building GBM and we have too many trees that leads to overfitting, will the variable importance be affected?
0
votes
1answer
23 views

Unable to transform the variable to normal distribution

I have a variable called 'list_price' in my data ,which is not normally distributed. Here is the screenshot of how the distribution looks like before transformation Tried transforming it with the ...
0
votes
0answers
14 views

How to apply an algorithm for text classification?

I would like to know more about algorithms to apply for text classifications. I know that steps include also remove of punctuation and stop words and tokenisation to clean the text. If I already ...
0
votes
0answers
14 views

smote for imbalance data

I am dealing with data which has only categorical features, whose values are just 0 or 1 and it is imbalance data. So, is it good to try smote because it will try to generate new data points. but, how ...
1
vote
1answer
26 views

Imputing features with NA values in classification task

I currently have a dataset where each observation is a person's traffic ticket history over districts. For each column, which represents a district: 1 represents that a person has received 1+ traffic ...
0
votes
0answers
14 views

Building a content-based recommendation system using products' metadata as features?

I am currently working on an apparel recommendation system, where I have tabulated data containing a list of products with their respective metadata (brand, category, color etc.) I have an additional ...
0
votes
0answers
17 views

Can previous successful actions be used as input to policy model in contextual bandits?

In a recommender application, I apply contextual bandits using logged propensity scores similar to this. The model is retrained daily. The application recommends images on an e-commerce website. Each ...
0
votes
0answers
8 views

Trouble with loading pre-trained CNN weights without classification layers for different input dimension

I am trying to load pre-trained CNN weights but without classification (i.e. top) layers. Basically, I want to do exactly what tf.keras.applications.ResNet50 class ...
0
votes
1answer
31 views

activation function for binarized neural networks

I am trying to implement a binarized neural network using keras and tensorflow. Here is my current code: ...
0
votes
1answer
17 views

How and where to set weights in case of imbalanced cost sensitive learning in machine learning?

I confront with a binary classification machine learning task which is both slightly imbalanced and cost sensitive. I wonder what (and where in the modeling pipeline, say, in sklearn) is the best way ...
0
votes
1answer
20 views

Prediction using words which were not in training in a CNN with pre-trained word embeddings

In sentence classification using pre-trained embeddings(fasttext) in a CNN, how does the CNN predict the category of a sentence when the words were not in the training set? I think the trained model ...
0
votes
0answers
16 views

How to construct pipeline with different alternative transformations for different kind of features in Scikit-learn?

I try to construct a pipeline in sklearn where I do different (in some cases multiple) transformations on different kind (numeric/ordinal/binary nominal/non-binary non-ordinal nominal) features. An ...
0
votes
0answers
8 views

Adaptive Resampling in Caret with Pre-specified Validation Set

I was wondering if this is the correct way to get adaptive sampling in caret working with a pre-specified validation set using index. I can get this to work using the 'cv' method in caret like so <...
0
votes
0answers
17 views

How do I measure the magnitude of change of probabilities and also what exactly do these probabilities represent?

I am trying to optimize the strategy to choose while taking a penalty kick. I have identified two strategies- keeper independent and keeper dependent and I am trying to find the best one using a ...
0
votes
0answers
25 views

Should I use a different ML model for feature sets with missing values while drawing inferences?

I have trained a model with 5 features. While training, I had no missing values, and the models were perfectly trained. However, when I'm using this model to draw inferences, sometimes I'm missing one ...
0
votes
1answer
15 views

Population stability Index vs Population Accuracy Index

Can anyone explain to me the difference between Population Stability Index(PSI) and Population Accuracy Index(PAI)?
1
vote
1answer
27 views

How can be proved that the softmax output forms a probability distribution and the sigmoid output does not?

I was reading Nielsen's book and in this part of chapter 3 about the softmax function, he says, just before the following Excercise, that the output of a neural network with a output softmax layers ...
0
votes
1answer
18 views

Model with 2 datasets: combine time series data and statistics

I am new to data science modelling so apologies if using wrong terminology in advance. I have a standard time series dataset of historical prices which is used to train/test a simple Random Forest ...
0
votes
0answers
8 views

Error and odd behaviour using Mahalanobis distance in multi-dimensional risk calculations

I am trying to use an approach detailed in a 2015 paper by NASA (https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20150018915.pdf) on using the Mahalanobis distance to aggregate a number of ...
-1
votes
0answers
20 views

how to calculate class_weight for Multi-class classification problem [closed]

I have a multi-class dataset with below class ratios Class A: 61% Class B: 34% Class C: 3% I am using a catboost model which takes class_weight as the parameter. ...
0
votes
1answer
12 views

How to run two different models in single frame?

I have mask_detector.model and yolov3 social distancing weights. I want to run them simultaneously with a single webcam stream. how can I run them both i.e. detecting mask and social distancing model ...
0
votes
0answers
9 views

Generalise a CNN model for Question vs Spam . Techniques to generalise the model apart from more data

For my problem, every image which is not a picture of a question on a paper (either from text book or handwritten), is a spam. It means that each and every image in this world is a spam for my case ...
-2
votes
0answers
23 views

information theory of deep learning , machine learning [closed]

I'm going to talk to a podcast person who works in the following areas:information theory of deep learning What questions do you suggest I ask or recommend to be asked?
0
votes
0answers
17 views

Predict how many days until New Purchase

I am trying to introduce myself into predicting with dates and I am having big troubles understanding how to do it. I have a dataset with customer orders from an e-commerce platform with the usual ...
-2
votes
0answers
25 views

best course about machine learning andrew ng , udacity [closed]

The following lectures are the best training for learning machine learning for beginners to advanced. https://www.udacity.com/course/machine-learning-engineer-nanodegree--nd009t https://www.youtube....
-1
votes
0answers
45 views

Good ideas for choosing the name of the podcast in the field of artificial intelligence [closed]

I am going to make a podcast that aims to interview people in the field of artificial intelligence, including machine learning, machine vision, deep learning, NLP , etc. So I am looking for a good ...
0
votes
0answers
7 views

Apyori module installation

I am currently trying to import the apyori module in PyCharm. However, I am getting the ModuleNotFound Error. i have installed the module by typing pip install apyori on my terminal but I am still ...

1
2 3 4 5
162