All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
12 views

How to resize image along with their mask?

I have original images of the size 1935x1481. I am using labelme to annotate the images. I am creating polygons on the original image. Is there a way to resize the image along with their mask? I am ...
1
vote
0answers
11 views

A simple attention based text prediction model from scratch using pytorch

I first asked this question in codereview SE but a user recommended to post this here instead. I have created a simple self attention based text prediction model using pytorch. The attention formula ...
1
vote
0answers
21 views

How can I apply K means algorithm to detect a pattern?

I have a dataset: How can I apply kmeans algorithm to find clusters based on "date" column . So that I can retrieve tweeting/retweeting activity every hour and generate a pattern. It would ...
0
votes
0answers
10 views

Grape dataset for smart viticulture

I'm involved in a smart viticulture project. I need some datasets for machine learning models. Datasets about grape disease or ripeness related to climate variables or grape.
1
vote
0answers
13 views

Framework for Genetic Algorithms on python

I'm trying to use a framework implemented in python to use GA (Genetic algorithms) and other related algorithms . But I'm not sure about what framework to use, I've found two interesting options Pymoo ...
2
votes
0answers
8 views

Best Method for Using Experts to Score Qualitative Data

TL;DR: Looking for recommendations or resources on the best method to have subject matter experts score qualitative data to train ML model. Problem: I am working on a problem in the biochemistry ...
0
votes
0answers
25 views

confusion about PCA algorithm matlab

I am given a data set with 500 features and I am told to apply PCA and find most important 2 features. I wrote some MATLAB code but I am very confused with all this PCA thing. ...
1
vote
0answers
14 views

Genetic algorithm (GA) for training a generalized linear discriminate classifier

How can genetic algorithms (GA) be used for training a generalized linear discriminate classifier? What would the genes/chromosomes and fitness function be? How can genetic programming (GP) be used ...
0
votes
0answers
26 views

CNN Color Invariance

For the task of detecting an object of any color, if we train our CNN only with images that only contain that object in one or two colors, will the accuracy of our model's predictions be affected for ...
0
votes
0answers
6 views

High resolution satellite data for climate analysis

i'm into a smart agriculture project. I need to get past info about climate in a specific region. Could you recommend satellite climate data with highest resolution?
0
votes
0answers
17 views

Count repeating “objects” in a picture

This is my first data-science project and I would love to get some guidance to know how to get started. My problem is the following: I want to count objects that are in a picture. This picture has a ...
2
votes
0answers
11 views

what is the meaning of independent and identically distribution of samples in a dataset for neuralnetworks

random variables like heads or tail that generated by flipping a coin is independent because each time we tossing the result isn't depend on previous toss( in other ...
1
vote
1answer
21 views

Optimal points of $f(x,y)=x^2 + y^2 + \beta xy + x + 2y$

I am self-learning basic optimization theory and algorithms from "An Introduction to Optimization" by Chong and Zak. I would like someone to verify my solution to this problem, on finding ...
0
votes
1answer
17 views

Currency Normalization for Salary Prediction

I have a dataset (350k data points) with data of employees across different regions over the last 10 years. The dataset consists of their skills, the region they are in, the industry, their current ...
0
votes
0answers
17 views

Why do we still hear Data Scientists talking about “rewriting a model in a production language” when in reality this is now extremely rare? [closed]

Data Scientists tend to add the line "and then the model might be rewritten in another language for deployment" when discussing model productionizing concepts. But I suspect this is rarely ...
1
vote
0answers
11 views

What is the appropriate statistical test to compare the MAUC scores from two machine learning classifiers?

I would like to compare the scores of two multi-class classifiers. I have calculated the MAUC score for each of the algorithms, and now I want to see whether there is a statistical difference between ...
2
votes
1answer
30 views

How to generate training instances from multivariate normal distribution?

I would like to generate a training and test set for the binary classification problem. I want the instances to be generated from a multivariate normal distribution and have 5 features. Can someone ...
1
vote
0answers
19 views

how to improve baseline logistic regression in high dimensional binary classification problem?

info about dataset: df.shape = (10000, 100) all feature are numerical values. few outliers in each column, column with most outlier have 0.7% of data as outlier. I am trying to improve on my ...
0
votes
0answers
8 views

How to model and predict 3d sensor data

I have an interesting problem where we have sensor readings in a 3D space (X,Y,Z) and sensor reading value V, I would like to model and machine learn to try and predict the next lag on sensor reading ...
0
votes
0answers
5 views

Input pipeline with an autoencoder and tf.data

I am using an autoencoder to detect anomalies in dataset of network traffic. The dataset is a csv file, and is loaded and preprocessed with pandas (encoded categorical features with pandas.get_dummies(...
1
vote
0answers
16 views

How to use keras custom data generator to build a model

I have the following data generator: ...
1
vote
2answers
28 views

Low scale ML/statistical techniques for data poor settings

I have two separate problems. One is logistic regression and other is time series prediction. But both suffer from paucity of data problems a) For logistic regression, I have tiny dataset with 10 ...
1
vote
1answer
19 views

What if irrelevant features impact the outputs?

We know that weather conditions in China is not very useful to predict price of a house in Spain (as life experience). However, when we drop that China's weather condition, the accuracy is reduced ...
0
votes
0answers
10 views

Are Multi-Input models better than ensembling different models?

Suppose I have a classification task, with images and lots of useful metadata. I want to utilize both the datasets even though I can't unify them. In this case, is it much more beneficial to run and ...
0
votes
0answers
10 views

DQL for detecting next move in games

I am trying to understand using DQL for playing board games and how we can do function approximation of the q-learning Bellman equation in order to detect the best next move , if anyone can give the ...
0
votes
0answers
9 views

Getting gradient for gradCam in pytorch

I am using forward and backward hook in my pytorch densenet121 model. I set requires_grad to False at the time of training. ...
0
votes
0answers
10 views

Tensorflow process killed

I need to train 5 models each for 10 times using tensorflow and keras for a homework. 2 of the models are multilayer perceptron models and remaining 3 of them are CNN models. I am training using my ...
0
votes
0answers
8 views

How to ensure diversity in my recommended ranking?

I have generated a ranked list of items but I want to ensure that the ranking takes care of diversity basis some item metadata. Most of the way I can think of seems computationally expensive. Is there ...
0
votes
0answers
9 views

If we only have the rating scores of items provided by the users, how do we use matrix factorization to build a recommender system model?

If we only have the rating scores of items provided by the users, how do we use matrix factorization (MF), factorization machine (FM), and deep learning (DL) to build a recommender system model?
0
votes
1answer
37 views

Error is occurring setting an array element with a sequence

I have the columns in my Data Frame as shown below: ...
0
votes
0answers
9 views

using regression method for payroll monthly controls

I serve as internal auditor in few clients ,one of my client has thousands of employees in different location, most of them in the head office, the client looks for corporate control for the salary ...
0
votes
0answers
21 views

Describe fundamental concepts of convolutional neural network (CNN) in the problems of computer vision, and describes how CNN realizes these concepts [closed]

Describe the fundamental concepts of convolutional neural network (CNN) in the problems of computer vision, and describes how CNN realizes these concepts
0
votes
0answers
21 views

Which is the best Machine Learning appoach/model when all features are not available for prediction?

I have 50 Features in a Dataset to predict 1 Variable "Units Sold". I am currently using XGBoost model (Supervised Learning) to train all these 50 Features and the accuracy of the model on ...
1
vote
1answer
11 views

Keras: apply multiple filters to each feature map in CNN

I am new to Keras, and I want to do the following: take a 2D image, and apply four 2D convolution kernels to it, giving four 2D feature maps. I could accomplish this. But then I want to apply two ...
0
votes
0answers
6 views

LSTM input layer shape in Keras using functional API

0 I am trying to implement LSTMs on drug data the shape of the data is given below also the model but it throws an error which is "Input 0 is incompatible with layer lstm_1: expected ndim=3, ...
0
votes
0answers
8 views

multivariate biLSTM text classification

I have made a model that takes vacancy data and classifies it with (bi)LSTM. The variables of the initial dataset are: positiontitle ...
0
votes
0answers
25 views

I need help to write an essay about: probabilistic method || Occam's razor || mathematics in the 21st

I am interested in one of the master's programs in Data Science. In the application process I need to submit an essay of 1,000 words about one of the following topics: Drawbacks of the probabilistic ...
0
votes
2answers
38 views

ideal algorithms to demonstrate overfitting or underfitting

When one tries to look up concepts such as overfitting and underfitting, the most common thing that pops up is polynomial regression. Why is polynomial regression often used to demonstrate these ...
-1
votes
0answers
16 views

Deep q learning from scratch weights diverge to NaN

I'm trying to make a deep q learning algorithm with neural network from scratch, minbatch gradient descent, replay memory, and target network. But weights diverge to NaN after a around 40 episodes ...
0
votes
0answers
12 views

Looking for classifcation model that optimises weighted accuracy. 'Modified decision tree classifier' or something else?

I have a large list of items that represent products sold by some company. For each of these items, I have their revenue and a number of (numerical) features. I have fitted a number of demand ...
0
votes
0answers
10 views

Finding the wiggles pattern in the original dataset. (Wiggles appear after performing division by another dataset)

I have multiple measurements regarding scientific observations. The problem is that there is a subtle noise pattern caused by the instrument - the wiggles. These wiggles are invisible when looking at ...
0
votes
1answer
32 views

Is probabilistic machine learning just the mathematical background of machine learning?

I wanted to begin with machine learning, I went through the contents of the course on ML by Andrew Ng and found that though the course was based on mathematics, but wasn't too much on the probability ...
0
votes
2answers
32 views

Jupyter, Python: the kernel appears to have died while training a model on a big amount of data

I am training my model on almost 200 000 images, i'm using Jupyter and now after 3 days of training ( i used 800 epochs and batch-size = 600) I have this " the kernel appears to have died. It ...
0
votes
0answers
23 views

Examples of Open source huge business intelligence datasets

I've observed that many of the datasets available for traditional ML and data science algorithms seem to be in the order of MB. I assumed these may be because earlier computers were not that ...
0
votes
0answers
8 views

Training on a single, random domain, per batch vs multiple domains per batch on a common task

Say I have multiple domains such that d_i is drawn from D=[d_1, d_2, ... d_K]. We have two options to train a CNN which equally ...
1
vote
1answer
21 views

In DQN, why not use target network to predict current state Q values?

In DQN, why not use target network to predict current state Q values, and not only next state q values? In doing a basic dq learning algorithm with nn from scratch, with replay memory, and minibatch ...
0
votes
0answers
6 views

Forecasting mon missing time timeseries data

I have time series data for minutes interval. But due to some noise i have to remove some rows from data. Now, I have data with some missing time stamp. What should i do for forecasting in this case?
0
votes
2answers
19 views

Zero Padding in Convolutional neural network

We use Convolutional neural network because it by design learns features that generalize over spatial location , so when using conv operation it reduce image size and that what we hope to have so we ...
0
votes
1answer
16 views

Best setup for Windows and Ubuntu on same machine? [closed]

I have been using Windows 10 on my machine. However, for many deep learning applications Linux is recommended if not required. For this reason, I want to keep my Windows 10 installation but also have ...
0
votes
0answers
6 views

Is it okay to train Triplet Loss where the anchor and the positive are the same?

Triplet loss roughly defined as total of$$ max (- distance(Anchor,Negative) + distance(Anchor,Positive) +margin,0)$$ I'm working with triplets data, and it turns out that some triplets(just small ...

15 30 50 per page