Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [machine-learning]

Machine Learning is a subfield of computer science that draws on elements from algorithmic analysis, computational statistics, mathematics, optimization, etc. It is mainly concerned with the use of data to construct models that have high predictive/forecasting ability. Topics include modeling building, applications, theory, etc.

Filter by
Sorted by
Tagged with
0 votes
0 answers
4 views

Multi-class Classification with Categorical and Time-series Features

I have a problem where I want to classify certain entries into clusters, based on their categorical features (such as Country, Category, as dataframe columns), and also their selling pattern (time ...
Leandro's user avatar
0 votes
1 answer
15 views

Fixing class imbalance vs Over-detecting in test data

In my experiences, binary classifiers tend do better in terms of F1 scores when the class imbalance is at least reduced. However, this leads to over-predicting in the test data. (Thought) Example: If ...
yurnero's user avatar
  • 121
0 votes
0 answers
5 views

How to build a recommendation system Based on user infos and without ratings?

I would like to build a recommendation system based only on user informations(age,sex,zipcode,and some quiz answers),based on those features i want to recommend assurance products, but i am confused ...
khadija's user avatar
0 votes
0 answers
12 views

Invalid Input shape for input tensor on Multimodal CNN

Im trying to build an image classification model with multimodality, it takes SAR and optical images, both types of images have FITS format. The optical images have shape (None, 512, 512, 3), while ...
Belat's user avatar
  • 1
2 votes
2 answers
359 views

How to fit sklearn.svm.SVC with three features, given that the features are actually arrays of lengths 128, 12 and 40?

To clarify, each instance of feature_1 is a 128 item long array, each instance of feature_2 is a 12 item long array, and each instance of feature_3 is a 40 item long array. I am currently simply doing ...
Karn Varshneya's user avatar
0 votes
0 answers
9 views

the features in cora dataset

Cora dataset contains a citation gragh which also contains feature vectors for each paper. The size of the feature vectors is 1433 (corresponding to unique words). Feature vectors contain binary ...
Sanyo Mn's user avatar
  • 123
0 votes
0 answers
6 views

Dears i run it to ValueError: Found input variables with inconsistent numbers of samples: [372478, 18583]

rs i run it to Value Error: Found input variables with inconsistent numbers of samples: [372478, 18583] i test my model(X1), which is differetnt CSV file than i used on training trained my model(X) ...
jemilj's user avatar
  • 1
1 vote
0 answers
23 views

Linear Discriminant Analysis (LDA) determining the class for test data after transforming with eigenvectors

Suppose we are given two classes class-1 and class-2 and the mean of the two classes are $μ_1$ and $μ_2$ respectively before projection. Both of their variance-covariance matrix is also provided ...
Suman Debnath's user avatar
2 votes
1 answer
26 views

Outputting handwritten digits with a Neural Network

I know that you can use a neural Network to recognize handwritten digits. How would you then use that same neural network to output handwritten digits in the unique style of that network? In other ...
Uriah Sanders's user avatar
0 votes
0 answers
8 views

Interpreting Centered 2-Way PDP

I have recently used scikit-learn's PartialDependenceDisplay.from_estimator function to display cICE plots in combination with PDPs using the ...
Guest's user avatar
  • 21
0 votes
0 answers
11 views

How contextual embeddings learned during training a transformer are applied to the input sequence at inference time

I'm trying to understand contextual word embeddings better, and how they are applied at inference time. While training a transformer, embeddings are learned as parameters during training. Are the ...
Last_neutrin0's user avatar
2 votes
1 answer
56 views

The best algorithm(s) for finding the best hyperparameters (special case)

I would like to ask for help with the following. Given the following dataset, which I have split into train and test sets: ...
ProgrammerGnome's user avatar
0 votes
0 answers
9 views

Estimating the Increase in Rademacher Complexity after Feature Selection

I'm trying to estimate how much the Rademacher complexity (or empirical Rademacher complexity) increases when performing feature selection using methods like Sequential Forward Selection or Genetic ...
x H's user avatar
  • 1
0 votes
0 answers
14 views

Implementing L2 Regularization in pure NumPy

I was implementing L2 Regularization in pure NumPy as an exercise to figure out the inner workings of the mathematics of an ML model. I'm unsure if it's done well, I don't really have a reference to ...
vxnuaj's user avatar
  • 11
0 votes
0 answers
13 views

does DALL-E api use Microsoft account info while generating responses?

I have read some work regarding occupational gender bias in AI image generation and it seemed. According to my research, tools like DALL-E generated more images of men when trying out for images with ...
x89's user avatar
  • 191
0 votes
0 answers
22 views

Theoretical Limitations of Achieving 100% Accuracy in Modeling Non-linear Relationships with Neural Networks

I am working on a project where I need to model a specific non-linear relationship using a neural network. The relationship is given by $y = 3x_1^2x_2^3 $. The approach involves: Preprocessing the ...
Mo McWebmo's user avatar
3 votes
1 answer
212 views

Why do Shapley value solutions remain consistent when the value function of the empty set changes in the ML context?

Hey there data science stack exchange - question about SHAP. In the original Shapley value formulation from Lloyd, one assumption is that the value function of the empty set equals zero, $v(\emptyset) ...
shay's user avatar
  • 133
0 votes
0 answers
12 views

How to choose segment in Grouped AUC metric?

Background In Binary Classification, AUC is a common metric. However, Group-AUC performs better in some scenario, such as we use AUC grouped by user in recommendation systems. In the below examples, I ...
Travis's user avatar
  • 111
0 votes
0 answers
12 views

Is DataSpell super slow training models?

I am working on a project where I have to train a couple of models, from Random Forest Regressor to Hybrid CNN-LSTM models. I was using DataSpell for this, also using the GPU of my laptop for the ...
David C.'s user avatar
0 votes
0 answers
11 views

ML for lot sizing task

I am solving the problem of automatic lot sizing, which consist of different products. I receive data about a certain product and I have to decide which products to combine into lots. And then ...
user162857's user avatar
1 vote
1 answer
40 views

Does f1 score evaluate only the model or does it also enable us to observe and evaluate the data?

I have a dataset. This dataset consists of the data that the actual picture that needs to be drawn, that is, the 100-point graded paper, and the similarity between 100 and 0 points graded pictures ...
doqukan's user avatar
  • 11
0 votes
1 answer
25 views

How to explain missing dates to a model?

I have this dataset that I'm trying to train a neural network on. The problem is that since weekend dates are not available, I am not confident in whether the model is able to account for that. ...
Akshat Vats's user avatar
1 vote
1 answer
22 views

Feature Engineering a Recency feature

I have a customer scoring problem I'm working on specifically on predicting conversion and coming up with a probability score on conversion (using xgboost classifier atm). There's a feature I want to ...
MetalicSt33l's user avatar
1 vote
1 answer
19 views

Improving GPU Utilization in LLM Inference System

I´m trying to build a distributed LLM inference platform with Huggingface support. The implementation involves utilizing Python for model processing and Java for interfacing with external systems. ...
Cardstdani's user avatar
0 votes
0 answers
27 views

Fuzzy Name Matching with Machine Learning. Input data encoding

I have a huge amount of data in my dataset: Last name, first name, date of birth of Indian residents and I need to match them for similarity. The matching is fuzzy, the data looks like this (names are ...
ккк ккк's user avatar
0 votes
1 answer
76 views

Test Error is extremely higher than Training error after gridsearch and crossvalidation

I'm currently working on a machine learning project. It's a supervised learning problem. My goal is to predict for given data of an animal(keeping,size,weight,...) ingredients(energy,vitamine etc..). ...
Marco Cotrotzo's user avatar
1 vote
1 answer
37 views

How to measure different models' feature importance using a generic and common standard?

I want to measure the feature importance of a series of models after training them. Most models have some built-in APIs that allow me to access their feature importance, but as far as I know, these ...
Yuuya's user avatar
  • 21
-1 votes
0 answers
33 views

What two different formulas in SVC minimization problem means?

Im studying a Support Vectors Machine and for soft margin I found minimization problem in form like this: $$\min_{w,b} \frac{1}{2} \|w\|^2 + C \sum_{i=1}^l \xi_i$$ And this this formula seems pretty ...
Almer's user avatar
  • 1
0 votes
1 answer
33 views

Can anyone help me understand this problem in my data?

I tried making a model using the autoTS library but the thing is in the result it gives me the following results. I checked everything there is no missing data but the original data had a missing ...
theunknown's user avatar
1 vote
0 answers
27 views

recognition of names, surnames and patronymics

is there an example of neural networks on Github or Kaggle that perform the task of recognizing identical surnames, first names and patronymics? I'm just learning neural networks so it's interesting ...
nanana's user avatar
  • 11
0 votes
0 answers
8 views

Does Factorization Machines accept continuous variables?

Most of the implementations I have seen of FM rely on an Embedding lookup matrix, restricting the variables that can be used to some categorical variable. Is there a way to use FM with both ...
Daniel Ávila Vera's user avatar
1 vote
1 answer
31 views

Diffusion Models: Conditioning on Time vs. Noise Level

I am new to SE-Data Science, therefore I hope this is the right place to ask this rather theoretical question. In diffusion models we usually have a time variable which determines the noise schedule (...
Lockhart 's user avatar
1 vote
0 answers
60 views

Using SMOTE Train Model and Optimal Cutoff on Unbalanced Test Data

My original dataset has a binary dependent variable with 3% of the values being one. First, I split the original dataset into training and testing sets using an 80-20 split. Since it includes both ...
CraigS's user avatar
  • 11
0 votes
0 answers
38 views

Is it possible to train a neural network to feed into a Random Forest Classifier or any other type of classifier like XGBoost or Decision Tree?

I want to create a model architecture to predict future stock price movement as such: The Goal of this model is to predict if the price will go UP or DOWN within the next 3 months. I have tried a few ...
Evank's user avatar
  • 1
1 vote
0 answers
11 views

Training VAE in Latent Diffusion Models

When working with Latent Diffusion Models (LDMs), is it common practice to only train the U-Net component while leaving the VAE untrained? Additionally, does this approach apply when fine-tuning an ...
NakataKoo's user avatar
1 vote
1 answer
61 views

How do I interpret probability results in conjunction with my known precision/accuracy/recall scores?

I have a Random Forest Classifier (trained with sklearn) modeling a binary data set. Here's what the configuration looks like (I've tuned it for precision intentionally): ...
Colin's user avatar
  • 113
0 votes
0 answers
13 views

Modeling spatial data

I have the following dataset. For every time point (at a frequency of 1 hour), we can construct a graph consisting of 20 nodes representing countries. Each country (node) is characterized by 5 ...
Peter's user avatar
  • 1
0 votes
0 answers
4 views

Leveraging Extra Data to Enhance Text Clustering

I want to cluster thousands of text data (called corpus A) and find a label for each cluster. Accuary of clustering is significantly important, because I want to use the texts and their labels for ...
Mohammadreza Riahi's user avatar
0 votes
0 answers
8 views

How to implement CP tensor completion with extra calculations?

I am new to tensor decomposition. I want to know from a practical point of view, how to use an already known tool/library to compute CP factorization for tensor completion. Specifically, I want to ...
jjjj's user avatar
  • 1
3 votes
1 answer
280 views

Using training data that requires manual interpretation

I have a dataset that comprises several data streams that are measured on objects (>10k objects). The data is essentially time series data (0.5 second intervals). Typically, an expert interpreter ...
user1563247's user avatar
-2 votes
2 answers
44 views

Determining the threshold value for the neural network

I have a dataset with last name, first name, middle name of people participating in sporting events. I need to train a neural network that will match similar surnames, first names and patronymics. But ...
nanana's user avatar
  • 11
1 vote
1 answer
77 views

Optimized input data structure for ML model training

I have a large dataset (20M+ rows) of user interactions which I want to use to predict the probability of a customer purchasing an item in one-, three- and six months time. However since the ...
MJ_VdH's user avatar
  • 11
0 votes
1 answer
34 views

How good are LSTMs in generalizing when learning curves?

I'm interested in the following scenario: I want to learn a mapping that maps a function to another function, i.e. I want to approximate a functional operator. If one is unfimiliar with operators one ...
ZenDen's user avatar
  • 1
0 votes
1 answer
26 views

CS undergrad query about DS

why is learning DS so ambigious .you dont truly know what should you learn to actually do DS .web dev say has a clear path learn html css js and you can make something .i am a cs undergrad just want ...
Muhammad Umer's user avatar
0 votes
0 answers
10 views

jar files downloading very slowly in jupyter notebook in Mac Book(M2 pro)

Required jar files are downloading from maven repository in Jupyter notebook are very slow in Mac book (M2 pro). how can i increase the speed of download?
Tovlk's user avatar
  • 43
-1 votes
1 answer
33 views

I need suggestion for a project

I want to make a forecasting system which will forecast how much quantity will be sold next year based on the previous 5 years' data from 2019 to 2023 and want to predict for future years. Now the ...
theunknown's user avatar
0 votes
0 answers
14 views

Whats a suitable feature selection method for Time series data across multiple files?

My problem is basically a higher dimensional regression, where my input is (100 levels, 300 timesteps, 23 features) My goal is to build a deep learning LSTM model that finds which level the data ...
Youssef Badr's user avatar
0 votes
0 answers
10 views

Can transfer learning on VGG better align with Across the Spider-Verse styles for improved style transfer?

Our project is working on implementing style transfer using styles from Across the Spider-verse. We've gotten some good outputs so far, but were wondering if we could better align the VGG model to the ...
Geo C's user avatar
  • 1
0 votes
0 answers
10 views

Remove feature from kernel matrix

I am pretty new to machine learning so please bear with me :) I am trying to do a binary classification task using an SVM with precomuted kernel (in python using sklearn). I created my train kernel ...
Georgia's user avatar
0 votes
0 answers
18 views

The machine learning of identifying the inner workings of a lift

There are a few lifts that go up and down vertically. This system has its own inner workings so that it decides which lift to use at a specific level according to which lifts are being operated and ...
feynman's user avatar
  • 237

1
2 3 4 5
229