Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

Filter by
Sorted by
Tagged with
0
votes
0answers
1 view

Implicit feature selection

I have heard that Random Forest and other tree based machines apply some kind of implicit feature selection. My Question is: Does this also apply for machines like the SVM? As far as I understand is ...
0
votes
1answer
5 views

A Question: is it possible for me to create an AI that learns to play games which I did not create?

Mainly, I have a question which I could not find an answer for anywhere, about an AI machine learning game. Is it possible for me to create an AI which can learn a game that I did not myself create, ...
0
votes
1answer
16 views

ML/Data Science Jobs in Europe

First of all I don't know if this kind of questions are allowed in this forum (if not where to ask?) but since many of you are working as Data Scientists or ML Engineers I would like to ask you ...
0
votes
1answer
14 views

Is it possible to have a default class in multi class classification?

In the general text classification problem, training a machine learning model to detect if a text belongs to one of N number of classes always yields a value in N. Even if the text that was passed to ...
0
votes
1answer
16 views

SKLEARN Logistic regression - Value error -inconsistent numbers of samples: [on hold]

I have a question. I am using jupyter. I am getting the value error below when I try to split the data using sklearn. ...
0
votes
1answer
17 views

How to validate a clustering model without a ground truth?

Im dealing with a dataset (text messages about source code comments) that are not labeled. I don't have a assumption about the implicits classes in this dataset. I want to discovery (by clustering) ...
0
votes
0answers
7 views

Calculating Coefficients for a LR Model

quiet simple problem I would assume but I try it for the first time and no Version I find online works for me. I have a working Model and now I want to get the Coefficients for it. Which doesnt work. ...
0
votes
1answer
8 views

shapes (127,1) and (13,) not aligned: 1 (dim 1) != 13 (dim 0) [on hold]

i am try to find score of linear regression it gives me this type error my code is below ...
0
votes
2answers
16 views

How to deal with a feature that has lot of categorical values?

I know this question has been asked before and I have tried a few things but those things are not working as expected for my usecase. I have a 500 length feature vector. One of these features is a ...
0
votes
1answer
9 views

How to save/load a Model (Pickle) with a specific path/directory

I seems like a very basic think but I couldnt find an answer to it. I want to save my model to a specific directory using pickle. The two algorithms below work fine for saving it in the same ...
0
votes
1answer
5 views

Using a trained Model from Pickle

I trained and saved a model that should predict a sons hight based on his fathers height. I then saved the model to Pickle. I can now load the model and want to use it but unfortunately a second ...
0
votes
0answers
12 views

How does Neural Network denoise an image?

I understand the mathematical formalism behind how neural networks work as a classifier or perform regression analysis. But I face difficulty to realize how they are such a great denoising instrument. ...
-1
votes
1answer
19 views

Supervised Learning: time estimation of bike repair

I would like to train a model that estimate the time a given shop would take to repair for a bike using the data below: shops.csv ...
0
votes
1answer
33 views

How to restructure my dataset for interpretability without losing performance?

What I am doing: I am predicting product ratings using boosted trees (XGBoost) with a dataset in this format: What I want to do: I want to use SHAP TreeExplainer to interpret each prediction my ...
0
votes
0answers
9 views

How to build a bloom filter based on p-stable locality sensitive hashing functions?

p-stable locality sensitive hashing function:$$h_{a,b}(v)=\lfloor{\frac{a\cdot v+b}{w}\rfloor}$$ a is a vector random choosed from normal distribution, a is uniformly choosed from $[0,w]$, v is a ...
0
votes
0answers
14 views

Difference between binary cross_entropy and mse

model = Sequential() model.add(Dense(16, activation="selu")) model.add(Dense(1, activation="sigmoid")) I am using Keras to create a binary classifier. My data ...
0
votes
0answers
9 views

Use sequential pattern mining rules to predict next window of a dataset

Suppose that I am performing Sequential Pattern Mining (maxgap = 1, i.e. rules for consecutive windows) and I ran the following code from arulesSequences in R Studio to determine significant rules ...
2
votes
2answers
32 views

Dealing with NaN for predictive models

I have data set that has data for patients: Arrival_Date : is when the patient has arrived Seen_By_Nurse : is number of minutes patient take to be seen by nurse since arrival when value is NaN it ...
0
votes
0answers
12 views

Linear Regression Error in feature matrix step

I'm trying to code the design function used in linear regression using numpy and I get this error: Traceback (most recent call last): File "C:\Users\visha\AppData\Local\Continuum\anaconda3\lib\...
0
votes
0answers
9 views

How to generate several elements on image with input parameters

For example, i need to generate circles. I have dataset of images with non-intersecting circles and can generate random circles with DCGAN, but each circle has a different diameter. So I need to ...
5
votes
1answer
49 views
+100

Understanding the softmax output in Youtube's recommender

This question has been asked before, but never (that I can see) satisfactorily answered. I'm reading Youtube's paper on their recommender system. The system has two elements, the first of which is a ...
1
vote
0answers
20 views

Sentiment Analysis: using a dataset (IMDB reviews) to train a neural-net and using it to predict entirely different datasets (Political articles)

We need to analyse a lot of articles relevant to political instability in a given country (things like the possibility of a coalition / a snap election etc). The problem is that I could not find any ...
1
vote
0answers
18 views

Tensorflow and Keras model having same parameters, hyperparameters, weight and bias initialization give different accuracy?

I have made sure that layers,parameters, hyperparameters,kernel_initialization, bias_initialization, seed and dataset are all equal. But still the output for both the models are different. ...
2
votes
0answers
23 views

Linear Regression in Python using gradient descent

I am trying to implement a simple multivariate linear regression model without using any inbuilt machine libraries. So far, I have been able to get a root mean squared error for training about $2.93$ ...
-2
votes
1answer
14 views

Projects for final year students [on hold]

I'm interested in making a final year project based on machine learning.Can you please suggest some topics
0
votes
1answer
13 views

Will the performance of my NER model improve?

I am training a spacy model from scratch by creating a dataset of my own with format spacy needs it to be in, the model is an NER model and the entity i am trying to recognize is Food items. I have ...
-1
votes
0answers
19 views

Time Series forecasting with machine learning

I have collected some data which basically encapsulates some internet traffic behaviour like average packet delivery time between two sensors, queue lengths, etc. at different times of the day and ...
1
vote
3answers
33 views

The effect of imbalanced distribution of data

I read on Google's ML website if I have classification dataset with a ratio of 90% for one classification and 10% of the data for another classification. In that case, should I use the exact same ...
1
vote
1answer
23 views

Binary classification algorithm

I have a retail customer transactional data set with features such as customer ID, product, date, number of products bought, ZIP code of customers, amount of the transaction. There already exists a ...
0
votes
1answer
24 views

Gradient Descent or Normal Equation?

Hi guys I am really struggling with this question. I need to pick the correct choice: Suppose you have a dataset with m = 50 examples and n = 15 features for each example. You want to use ...
0
votes
1answer
22 views

Intuition behind the PCA algorithm

I am trying to understand PCA intuitively. Here it goes: After finding the eigenvectors and eigenvalues of the covariance matrix of the dataset, the eigenvalues will represent how spread out the ...
0
votes
0answers
14 views

How to implement AdamW?

I have implemented AdamW but I am not getting good results, is there some mistake in my implementation? ...
0
votes
0answers
27 views

SRGAN: How to adapt the model to the input image?

I wrote and trained my own SRGAN: so I obtained a generator's model that takes 32x32 images as input and gives their improved 128x128 version as output... However, the end users of my Android app ...
0
votes
1answer
28 views

Please help me find the mistake

I'm trying to use Tensorlow on İris dataset using sublime as the text editor. I got this error "TypeError: float() argument must be a string or a number, not 'generator'"when running the session, but ...
1
vote
1answer
13 views

How to approach this multi label classification problem and what will be its accuracy metric?

I have a dataset for people doing trade in various segments (classes) .I am trying to build a multi-label classifier to predict people trading in various segments (classes). My dataset : ...
0
votes
1answer
14 views

Classification of Orientation

I am using inertial sensors to capture motion from the wrist/ ankles of subjects and synthesising this data into a feature set to be able to classify the activity performed by the subject (i.e. ...
-1
votes
0answers
8 views

How to make image classification using weka?

I have two hundred and fifty images, and extracted the features from them and put them in an Excel file, how to use the weka program so that the first 200 images for training and the remaining fifty ...
2
votes
3answers
64 views
+50

References for longitudinal data analysis

So my goal is to study longitudinal data (data in time series) by applying some data mining techniques. Ultimately I want to be able to "predict" outcomes. For example, a study of patients along the ...
2
votes
2answers
15 views

What is the best option to test the data set of images using weka?

I have two hundred and fifty images, and extracted the features from them and put them in an Excel file, how to use the weka program so that the first 200 images for training and the remaining fifty ...
0
votes
1answer
28 views

Which Technique should we use for predicting an integer output?

I'm working on a problem where my target feature of type integer. i.e (n_clicks). In general, if we want to predict categorical target feature then we use classification algorithms and on the other ...
-3
votes
0answers
20 views

Java or Python for training and implementing Predictive ANN models in production? [on hold]

What are your opinions? Should I use python since I'm comfortable with it and it is the superior language for machine learning, or should I use Java since it's what my company uses for all our ...
0
votes
0answers
18 views

How to handle a data set with large number (about 75%) of binary variables?

I am doing a research right now and want to classify (predict) churns of costumers using machine learning. My data set consists of about 500,000 observations with 20 variables: 15 are binary, 2 ...
1
vote
0answers
14 views

Character recognition ML models

I hope I can make my question clear. So I'm working on a machine learning project just for the sake of it (3rd year undergrad in CS) over our summer vacation. So I'd like to recognize letters from ...
0
votes
1answer
17 views

How to implement HashingVectorizer in multinomial naive bayes algorithim

I had used TfidfVectorizer and passed it through MultinomialNB for document classification, It was working fine. But now I need to pass huge set of documents for ex above 1 Lakh and when I am trying ...
1
vote
2answers
8 views

Scaling of the Streaming Data

I have to make prediction on streaming data for which I have trained the model offline. Is it a common practice to use scaling when we have to train the model offline and have to predict the on ...
1
vote
1answer
24 views

Pyspark Matrix Transformation

Let's assume I have the following dataframe in PySpark: ...
0
votes
1answer
29 views

SVM hyperplane margin

so that $H_0$ is equidistant from $H_1$ and $H_2$. However, here the variable $\delta$ is not necessary. So we can set $\delta=1$ to simplify the problem. $$w\cdot x+b=1 $$ and $$w\...
-3
votes
0answers
13 views

Is Data Mining easier then Theoretical Machine Learning ad Deep Learning [on hold]

Is data mining (text mining for example...) easier than theoretical machine learning and deep learning?
0
votes
0answers
6 views

How to assign optimal min_sup value in apriori algorithm

Have processed product sales data after data transformation(map 0&1's respective product and transaction) through Apriori alogorithm.Output associatiob rules have some product mapings between ...