All Questions

15,262 questions
5 views

K-Nearest Neighbours algorithm explanation needed

I need some explanation for K-Nearest Neighbours algorithm. Why is the training process needed in KNN algorithm? In regression model the training process means to find optimum parameters for a ...
8 views

Need help with entity tagging

I need to design a system which can identify movie and production company names in a sentence. The approach that comes to my ...
9 views

Metric (rather than RMSE, MSE, etc.) to choose the best model in terms of the ability to detect peaks better

I have created multiple regression models and wanted to choose the best one. One common metric would be RMSE, as you know. When I looked at the results, second model (RMSE = 0.15) was better able to ...
10 views

How to load pre-processed .txt data and use it for training convolutional networks?

I have a lot of '.txt' (pre-processed) files related to C3D and I need to use this to train and test while using CNN model. How does one go about this? Most of data in each .txt files are formatted ...
11 views

How can I categoriese / classify a cluster of words?

I am just wondering if it is possible to classify word clusters? For example if I provide you an array of words [bird,chicken,dock,park,apple,grapes,furits,juice] ...
9 views

Bayesian models

Can someone tell me more about Bayesian models and how Bayesian networks used in Machine learning. Also some good references to help me learn more about the same would be great. Thanks in advance.
12 views

One hot encoding as input to recurrent neural networks

I'm trying to predict next label in a pattern based on previous labels using recurrent neural network. In total I have 100 labels Example of input pattern: ...
10 views

A bit confused regarding clustering of users in a dataset

I have a dataset of book reviews: ...
3 views

keras-rl DDPG implementation for Pendulum-v0 uses a linear activation in the final layer?

I just cloned and ran this: https://github.com/keras-rl/keras-rl/blob/master/examples/ddpg_pendulum.py I cannot understand how it works so well with a linear activation in the final layers of both ...
16 views

How to Predict the future values of weather

I just built this with random forest. ...
9 views

Accuracy doesn't increase in Binary Classification with 3D coordinates as data

I have 4000 catalogues of galaxies, in each there are 34700 objects, for each of it I have x,y,z coordinates. I want to do a binary classification creating a model which should be able to determine ...
4 views

Automated Spatial data mining tools in python

How can spatial data raster be processed in order to apply random forest prediction algorithm on it using python programming language?
19 views

Predicting yearly income with linear regression using Python

How to predict the per capita income of Pakistan in 2020 by using linear regression model in Python. The training data is: ...
3 views

Weighted MMD for InfoVAE?

I'm trying to figure out how can weighted MMD from Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptation (chapter 3. Weighted Maximum Mean Discrepancy) be adapted for InfoVAE: A ...
7 views

Plotting two PCA using same Principal Components to compare data

Background: I have been given a task to replicate functionalities of an old data analytics tool on Python. This tool has set of examples, one of which has a data of a chemical process end of which, ...
11 views

Keras Binary Classification val_acc won't go past ~67; Full data and code included

I'm working on a binary classification in Keras with a Tensorflow backend. No matter how much I tweak, I can't seem to get my model past a val_acc of 67%. Is there something I'm missing, or is this ...
9 views

From most frequent words how to extract technical skill words

I've scrape 30 job description web and stored them into a list called job_desc where each item is a job description. ...
4 views

UnderBagging Testing in Matlab

I used UnderBagging for an imbalanced dataset with 45700 observation with 20 fetures. 45000 observations are 1 and 700 are 0. I used UnderBagging for classifier C ( for example for Decision Tree). I ...
8 views

openai gym, bound actions to range for continuous action spaces

I have a DDPG implementation that is workable for MountainCarContinuous-v0 where the continuous action range is -1. to 1.. I am using a tanh activation in the final layer of the Actor network as seen ...
34 views

Approaching a multi-class classification problem but without labels

I am working on a business problem where I have a movie description dataset. In this dataset I've columns as - Movie title, Movie plot summary, Date of Release. Now based on this information and using ...
6 views

comparing data from first quarter in two years

How can I compare data from two quarters? What software can I use to do it parallelly side by side so I can compare them. What kind of factors can I take into consideration, I'm posting a sample data ...
7 views

Any efficient way to build non-linear regression model for polynomial features?

I am trying to understand how crime frequency affect house price in certain area. To do so, I started with Chicago crime data and zillow real estate data. I want to understand the relation between ...
25 views

What is data lake?

I am familiar with the concept of Big data but how data lake is different from Big data.or is it derived from big data.Please explain.
5 views

How to combine features with different temporal scale in machine learning

We have various types of data features with different temporal scale. For example, some of them describe the state per second while others may describe the state per day or per month from another ...
7 views

How to deal with a situation that the number of features in training dataset is larger than the number of training examples

I am playing a Kaggle competition, Don't Overfit Ⅱ And I am dealing with a situation that the number of features in training dataset is larger than the number of training examples, which has 250 ...
8 views

...
10 views

How can NN be thought of as p(x|z) in VAEs?

So, you can feed random input (z) to a NN and make the output random, but that will be just f(p(z)), where f(.) is the deterministic NN. The other way is to think of the NN output as parameteres of a ...
8 views

What's the correct form of use the real coded genetic algorithm?

i'm new with the ga and i can't found specific info about the real coded ga, i want to do an antennas array optimization by using the real values of antennas position , phase and amplitude, but in my ...
10 views

Training accuracy decreases

I have a program in which I use sequence to sequence approach as a prediction model with attention. The problem is, while training, the accuracy is always decreasing at each epoch, like shown in the ...
7 views

How delete duplicated row and with cell value ='0' [on hold]

Hi, I want delete all rows from my .csv file where: 1) row[patient_id] are duplicated 2) row[Target] == 1 So I want delete last row in my example.
21 views

How to find which features have been selected by PCA algorithm?

I used PCA function in MATLAB to decrease features on my data set. By this code I can reduce features from 12 to 8(as an example). It works good but my question is that how can I found with feature ...
23 views

Deep learning not classify some classes

I want to classify 13 classes, but 2 classes is not classified. This is the test result. As you can see in the image, class 3 and class 11 is not detected. It's simple vector to class classification. ...
18 views

Machine learning internship interview in 2 days! What to prioritize? [on hold]

I have a technical interview for a machine learning / data science internship for supervised learning--no neural networks or deep learning--in a couple days at a small startup. This will be my first ...
8 views

Finding optimal parameter values under higher-order effects

I have a series of computer experiments. In each experiment, I run one of two programs, each with about 6 parameters (4 of which are common to both programs; some parameters are continuous, others ...
11 views

I am trying to understand Policy Gradient with baseline algorithm. $$L_{\tau} = -\sum_{t=T}^{1} log\ \pi(a_t|s_t) * G_t$$ and I do not undersdant a 'baseline' part. I can use any function as a ...
14 views

One hot dimension vs features dimension [on hold]

I have time series data with 5 possible 7 features while labels number is 6. Is it a realistic scenario? Would it work well with RNN - 5 + 6 vector for each time step?
19 views

CNN for binary classification problem

I am trying to make a convolutional neural network that classify images in two categories: with cats and without cats. It's the first time I am doing something like this and it seems I am having a ...
21 views

adding constraints in PuLP optimization problems in python

I want to create an optimal meal plan with minimum sugar intake for 7 days but the everyday diet plan should include food from 3 different categories. How do I add constraint that I could get food ...
27 views

Does PCA decrease the feature on my Data set or just decrease the dimension?

I'm new in AI and sorry if my question is simple. I have a data set and want to use PCA to decrease the feature but after some research on the internet I'm confused about decreasing dimensions and ...
21 views

Whats the best ML model to fit my needs comparing binary samples using python [on hold]

im completely newbie in ML but have some experience in coding, i need some advice for the best model to start with in my application. imagine a table, that contains 2.646.000 lines, and 2 columns, ...
37 views

Making sense out of a scatter plot [on hold]

I have a set of (~1 million) data-points extracted from a material. The points look like this: ...
108 views

What's the difference between multi label classification and fuzzy classification?

Is it just the between academics and practitioners in term usage? Or is theoretical difference of how we consider each sample: as belonging to multiple classes at once or to one fuzzy class? Or ...
14 views

What could cause training CNN accuracy to drop after 7th epoch?

I am training a CNN on some new dataset. Usually, the accuracy steadily improves over 10-20 epochs. I have created a new but similar dataset (using same methods) but now I see a sharp drop after 7th ...
17 views

Matrix shrinking to compute matrix inverse

I have to compute the inverse of a very large matrix (N x N) and save the diagonal values of the computed inverse matrix (N x 1). But since the matrix is very large $(10^6 X 10^6)$, it does not fit in ...
10 views

sklearn stratifying dataset with more than one label

I have come across sklearn.model_selection.train_test_split as a method to split up the train and testing dataset. Furthermore they have a ...
19 views

How to normalize data from multiple sources?

I am trying to model an individuals' purchasing behavior using different data sources (ex: Zalando, Otto, etc.,). When I combine data sources, I see that the data across these channels is very ...
5 views

Why the loss is nan by using linear activation function in the last layer?

I want to use neural network to solve a simple regression problem, and I try to program by myself accroding to lecture Backpropagation and Neural Networks . However, I meet loss divergence problem. ...
14 views

How to perform Tensor decomposition on a matrix?

I have a dataset that contains 500 rows of songs each of them is having 4 features viz. Singer rating, Music Director rating, Genre (there are 3 genres - Rock, Sentimental, Rap) and Music Company ...