All Questions

Filter by
Sorted by
Tagged with
0 votes
0 answers
7 views

Negative MNIST - Trying to understand what's going on here

I'm new to machine learning and pytorch and any insight would be greatly appreciated. I've been playing around with the MNIST number recognition dataset and thought it would be interesting to train ...
Sloth Man's user avatar
  • 101
0 votes
0 answers
7 views

Is there any standard or heuristic for deciding on the dimensions and filters of a convolution layer for image processing?

I reposted this from StackOverflow since it does not meet StackOverflow's guideline to focus on programming and coding questions. Link to the original question. I want to find ways other than trial ...
Joachim Rives's user avatar
1 vote
1 answer
26 views

Effect of Sequential Data Quality Variation on Transformer Model Training: Seeking Insights and Experiences

I'm exploring the training efficiency of transformer models against the backdrop of data quality sequencing. Specifically, I ponder whether arranging unlabeled data by presumed quality affects ...
Lukas N.P. Egger's user avatar
0 votes
0 answers
8 views

ValueError with matmul Single Class Sep. mismatch in its core dimension 0

Single Class Separation Problem Creating custom NMF function with custom weights updates (nmf_updateH) and (nmf_updateW). The goal is to compute Single Class Separation (NMF). **Effort to update H is ...
Data Science Analytics Manager's user avatar
0 votes
0 answers
14 views

Method for Combining Text Embeddings and Numeric Features in Deep Learning

I'm working on a deep learning model in TensorFlow to predict if two records within a database refer to the same person. I'm trying to use text features (in the form of embeddings) and numeric ...
jgolliher's user avatar
1 vote
0 answers
17 views

Training Models Directly with Transformer Attention Weights: A Viable Strategy?

I'm currently using pre-trained transformers to extract embeddings for sequence analysis, which are then used in downstream tasks. My process involves using the extracted embeddings as features for ...
pparker's user avatar
  • 357
1 vote
0 answers
12 views

Does Google DeepMind's Gemma 7B models specs have inconsistent dimensions?

In Google DeepMind's Gemma technical paper (https://storage.googleapis.com/deepmind-media/gemma/gemma-report.pdf), the 7B Gemma model specs are given as d_model = 3072, num_heads = 16 and head_size = ...
Unmesh's user avatar
  • 11
0 votes
0 answers
6 views

Decomposition and scaling and their effect on interpretability?

I have time series GDP growth rate data that I use as my Y and other X variables that I put into neural networks to make predictions. The two questions that I have are: When I decompose my GDP_growth ...
J_Bake's user avatar
  • 1
0 votes
0 answers
11 views

Can an OCR model consistently recognize every digit of a long number correctly?

I'm working on OCR on scanned documents and we need to recognize the exact sequence of some printed numbers on it. Imagine you're reading a bank cheque serial number (16 digits) so the system needs to ...
TlifeProgram's user avatar
-1 votes
0 answers
8 views

Machine Learning Model for time series data

For time series feature extraction, is [1] unsupervised, [2] supervised, or [3] reinforcement learning approach the most suitable? In addition, CRNN is one of the models I would like to use. Please ...
RAI SANJAYA's user avatar
0 votes
0 answers
10 views

Applicability of RAG for enterprise datasets

there are 2 basic queries that i haven't been able to find answers to on reddit / DSE.. hopefully someone can enlighten / educate me To populate/ ingest the data, typically its broken into chunks and ...
Vikram Murthy's user avatar
0 votes
0 answers
6 views

Finding parameters which reveal clustering in t-SNE

These data are from SAMHSA, Mental Health Client-Level Data. I am trying to find the right parameters to obtain clustering as in this paper. Code here. For now, I'm dropping columns which aren't ...
Jackson Walters's user avatar
0 votes
1 answer
15 views

Where the term `cross-attention` is first used? (couldn't find the term in attention is all you need paper)

I am looking for the paper that first used the term cross-attention. I carefully read the paper ...
Jiho Choi's user avatar
  • 123
0 votes
1 answer
20 views

Min-Max Scaling more sensitive to outliers than 'Simple Feature Scaling'?

I am confused as to the pros and cons of two different approaches to normalization: Min-Max Scaling, and what the lecturer in the course I am taking refers to as 'Simple Feature Scaling'. The latter ...
Chris Bedford's user avatar
-1 votes
0 answers
11 views

Issues with a CNN trained on numerical data

I'm training a CNN on spectral data of different exoplanets. The two inputs I'm dealing with are wavelength and transmittance values. The goal of the CNN is to detect what molecules are present. The ...
Furno's user avatar
  • 1
1 vote
1 answer
8 views

How can I use contextual embeddings with BERT for sentiment analysis/classification

I have a BERT model which I want to use for sentiment analysis/classification. E.g. I have some tweets that need to get a POSITIVE,NEGATIVE or NEUTRAL label. I can't understand how contextual ...
average_discrete_math_enjoyer's user avatar
-1 votes
0 answers
8 views

How to deal with a heavily imbalanced test dataset?

Both my train data and test data were imbalanced. So I tried SMOTE for training. Before Smote: ...
GrGr11's user avatar
  • 1
0 votes
1 answer
20 views

the VCdim of class of double parameter threshold functions

Let $H$ be a family of classifiers such that $H=\{ h_{a,b} : a,b\in \mathbb{R}\}$ where $h_{a,b}(x,y)=1$ iff $x\geq a$ and $y\geq b$. I've proved that for $C=\{m=(x,y)\}$, $H$ shatters $C$. However, ...
Aishgadol's user avatar
  • 101
1 vote
1 answer
20 views

Top_p parameter in langchain

I am trying to understand the top_p parameter in langchain (nucleus sampling) but I can't seem to grasp it. Based on this we sort the probabilities and select a ...
Labyrinthian's user avatar
1 vote
0 answers
13 views

Misaligned Multivariate Time Series (weather and soil moisture) in soil moisture forecasting

I'm working on soil moisture forecasting using multivariate time series (MTS). More precisely, each time sample comes with multiple measurements regarding: the soil (e.g. soil temperature, and soil ...
Marco DC's user avatar
-1 votes
0 answers
7 views

Truncate property of external tables

Why is the truncate property not supported for external table in Spark SQL, while it is supported for managed table? Also, apart from truncate are there any other major differences between managed and ...
sarah's user avatar
  • 1
0 votes
0 answers
10 views

Aside from trial and error, how do I select the number of layers and unit counts for LSTMS, GRUs, and Transformer units for text and time series?

When deciding on the number of units and layers for text processing or time-series prediction I rely heavily on trial and error. First, I look for a reference or paper on the topic such as the white ...
Joachim Rives's user avatar
0 votes
0 answers
10 views

Evaluation of the loss function

Why the three evaluations of the loss in the following code do not agree? ...
Perochkin's user avatar
  • 311
0 votes
0 answers
8 views

How bootstrapping works for prediction intervals?

I'm experimenting with prediction interval (PI) over univariant time-data using skforecast pythonic package.. in the documentation it is mentioned that: Prediction intervals A prediction interval ...
Mario's user avatar
  • 414
0 votes
0 answers
12 views

Time Series forecasting with SVR

I am trying to forecast my data by Support Vector Regressor, Here is my code: ...
Hadis's user avatar
  • 1
1 vote
0 answers
14 views

How to solve imbalanced dataset oversampling problem in multi labels-classes instance segmentation task?

I want to use models YOLOv7-seg for instance segmentation of tree species in images. There are 26 species of trees, and each image may contain multiple species. There is a distinction between dominant ...
yuga555's user avatar
  • 11
0 votes
1 answer
14 views

What languages llama2 supports?

Which languages llama2 supports? I looked at the docs and huggingface but I couldn't find a list. Just it says usage in other languages than English as out-of-scope.
heyula's user avatar
  • 21
-1 votes
0 answers
14 views

How to use a large language model as database querying tool?

How to use a large language model as database querying tool using RAG? How to understand a pretrained model is suitable for RAG
MobiusT's user avatar
0 votes
0 answers
15 views

Semantic segmentation sometimes give bad result

I'm training Unet+MobileNetV3 for semantic segmentation objects on real photos using custom dataset and get strange results. I have already accumulated pretty big dataset and constantly improve it by ...
Vladislav D's user avatar
-1 votes
0 answers
18 views

How can I get the list of pretrained large language models?

Is there any place I can get the list of pre-trained large language models in a neat way? Despite the most common ones like gpt, BARD, llama2, which llm do you suggest that can be used for RAG and ...
heyula's user avatar
  • 21
-1 votes
0 answers
10 views

Current Data Science skills in demand [closed]

I am currently pursuing MS Data Science in USA and was searching for summer internships in data science field. However, even after searching since last 6 months, I haven't had any luck till now. What ...
Naman Bhargava's user avatar
0 votes
0 answers
11 views

Why are we replacing values in leaves in gradient boosting?

As far as I understand, we decompose the error function into a Taylor series, find its derivative, set it to zero and get a new optimal final value for the sheet. This is the gradient step in the ...
lemintare's user avatar
1 vote
1 answer
27 views

Find closest color class to an RGB value

I have a module that estimates the color of an object and returns an RGB value in this format: (40, 48, 68) which corresponds to this color: Now I have to classify ...
Tina J's user avatar
  • 227
0 votes
0 answers
14 views

How do you find the effects of external shocks in stock time series?

I have to identify 4 different points in time per stock price. I have several thousand stock prices, which are available as a monthly time series, so I need an automated calculation of the points in ...
Sepp's user avatar
  • 1
0 votes
0 answers
10 views

How to migrate my ML Model from Staging to Prod without having to retrain the model and without lossing the hyperparameters

I want to train my ML model in my staging environment and then push the model to production if it performs well. However, I do not want to retrain the model on the entire dataset. I simply want to ...
QuantumCoderX's user avatar
0 votes
0 answers
7 views

Trip/Hazard/Fall Dataset

I'm working on a project that involves describing/detecting 3 main situations from an image. First, if there's a trip hazard or o potential situation that could result in a fall, for example someone ...
Ricardo Mezarina's user avatar
0 votes
1 answer
21 views

How to check the license of a LLM for specific use?

How to check if a large language model has a license allowing to fine tune the model and then publish it publicly? How can I be sure that I can use and fine-tune a large language model without ...
heyula's user avatar
  • 21
0 votes
1 answer
22 views

Why is my LSTM model not predicting well when predicting labels for a new dataset?

I have a 15 timeseries datasets with 25-30 columns and is labeled by following a complex formula applied on the 25-30 columns. When training, I split the datasets as training datasets and unseen ...
Rushabh Kheni's user avatar
2 votes
1 answer
39 views

Impose minimal value on ANN prediction?

I want to predict a feature using a NN, but some business logic require that the prediction will be no less than min_value. I imposed it after the training by: <...
Cohensius's user avatar
  • 159
-1 votes
1 answer
26 views

In order to predict after training on Standardized data, do I need the StandardScaler as well?

I have little understanding in ML so I might be not even wrong. I want to train an ANN, save it, then to send it to a co-worker that will do the predictions on data that I do not have access to. Do I ...
Cohensius's user avatar
  • 159
0 votes
0 answers
12 views

What is normalized winning frequency in kernel self organizing map(SOM)?

In the k-means based kernel SOM, proposed by MacDonald and Fyfe (2000), the update of the mean is based on a soft learning algorithm ...
Anshuman Jayaprakash's user avatar
0 votes
0 answers
42 views

Generating quality synthetic tabular data - is it possible when one's dataset is extremely small?

I've got a dataset consisting of only 17 samples and 6 continuous features (all values in the dataset contain decimals, although 2 features exhibit categorical-ish behaviour). I'm looking at the ...
user23493275's user avatar
3 votes
1 answer
52 views

When do you know training a model is not feasible?

A couple weeks ago I volunteered to take on a project at work to try predicting the ideal price rental cars my employer should be charging based on our historical rental data. The variables available ...
enmasse's user avatar
  • 31
0 votes
0 answers
4 views

PR-AUC vs F1 vs Balanced Accuracy

I'm trying to create a Random Forest Classifier for selecting ~ 700 features. I have a highly imbalanced dataset to select features from. There are significantly fewer positive cases (1%) compared ...
user155775's user avatar
0 votes
0 answers
5 views

How to explain my standard error of my ANN prediction

I have a question on how to satisfactorily explain the standard error of my ANN model. For background, I have an ANN model that predicts protein post translational modifications based on their GC-MS ...
hypermiler3's user avatar
0 votes
0 answers
11 views

How to use pairwise data to cluster users into group?

I have a table_1 shows the phone call history, with two columns 'ID_1' and 'ID_2' (id1 calls id2), how can I find the clusters where each user in the cluster in the calls with at least 2 other people ...
kumalu's user avatar
  • 1
0 votes
0 answers
15 views

Getting actions probabilities instead of an unique prediction in Stable Baselines 3 SAC?

I try to understand how getting an actions probability table instead of an unique prediction in stable baselines 3 SAC in order to override 'predict' method to filter invalid actions. I guess the good ...
GerardL's user avatar
0 votes
0 answers
11 views

Systematic bias of neural network regression

I am not sure if here is the correct place to ask this question. I was trying to do graph-level regression task using graph convolutional networks, basically I concatenated 3 linear layers after ...
Tianjian Qin's user avatar
0 votes
0 answers
5 views

Seeking ML Model Recommendations for Enhancing OCR on Corrupted Text Images

I am working on a project where I need to perform Optical Character Recognition (OCR) on text-based images. However, these images are corrupted in various ways (e.g., blurred, distorted, low ...
Nurbek Ss's user avatar
0 votes
0 answers
5 views

Robustness and Sensitivity of Naive Bayes to Irrelevant Features

I understand that one of the strengths of Naive Bayes is its robustness to irrelevant features. However, it's also important to note that it can be sensitive to the presence of irrelevant features, ...
baddy's user avatar
  • 165

15 30 50 per page
1
2 3 4 5
735