All Questions

Filter by
Sorted by
Tagged with
0 votes
0 answers
22 views

While working on binary image classification, the class mode set to binary incorrectly labels the images, but does it correct on categorical

I am currently working on a binary image classification. My problem is that when i use data augmentation, it incorrectly labels the images when it is set to binary. The things i have tried: Looked ...
Enes Aygun's user avatar
0 votes
0 answers
7 views

Rename a variable (column name) in a SAS dataset with unknow suffix

The ICT team provides me with a dataset with a column that changes name every month, but always starts with "Reality". It's always column 10. There are other variables that match these ...
babipsylon's user avatar
0 votes
0 answers
6 views

Subsequence classification

Given multiple paragraphs, is it possible to classify an entire paragraph while taking into account the surrounding paragraphs? Paragraph1 Paragraph2 Paragraph3 ...
BPDev's user avatar
  • 101
0 votes
0 answers
16 views

How is a causal language model correctly fine-tuned?

I want to fine-tune an SLM like Phi-2 through the huggingface API. I am in doubt how to achieve that, because I see two ways to do that and I am wondering which is the correct way. The task is just a ...
Marcel Braasch's user avatar
0 votes
1 answer
20 views

Searching ChatGPT transcripts?

Maybe I just don't understand the functionality of the web version. Using GPT4 here. When I do technical queries (usually TensorFlow applications) I use similar prompts until I get the understanding I ...
PracticalKat's user avatar
0 votes
1 answer
20 views

Applying dropout effectively in CNN

I am fairly new to deep learning and machine learning in general and have been trying to teach myself. I’m interested in understanding when and how to effectively use dropout in a CNN. While ...
Nile's user avatar
  • 3
0 votes
0 answers
16 views

Calculation of Covariance Matrices for a QDA classifier in Python Numpy

For a school project, I have to design a QDA classifier for 28x28 pixel images of letters in sign language. I have been given 27455 images for training, which have to be flattened to a 784 pixel ...
Neev Penkar's user avatar
0 votes
0 answers
20 views

Negative values when calculating weighted Jaccard similarity

I have a bilateral dataset that includes countries and their the weight of their relation. I'd like to calculate the similarity of countries in 1) who their trade parterns are and 2) the weight of the ...
Johanna's user avatar
0 votes
0 answers
21 views

Machine learning model that takes multiple records as input to help predict the last

I want to create a ML model that is able to forecast the yield from a farm. My data source gives me data about the inspections from the field, but that is too much info to fit in 1 record, so there ...
Milan N's user avatar
0 votes
0 answers
8 views

Feature Selection in no labeled data

I'm new to this field and trying to learn by working with a fraud dataset. Initially, I used the dataset as is, but now I'm trying unsupervised learning without the labels. I've tried clustering ...
DrGenius's user avatar
  • 101
0 votes
0 answers
6 views

Speaker Verification models on

I went through different articles of speaker verifications (ECAPA-TDNN, TITANET). They trained on ...
user3668129's user avatar
0 votes
0 answers
7 views

Strange situation RF classification: perfect train, test predictions all in a single category

I am puzzled by an issue with a boolean classification task using RF on a large dimensional dataset (1680 obs x 110 dim) and moderate imbalance (431 vs 1249). train/test partition is random (0.8,0.2) ...
Antonello's user avatar
  • 101
0 votes
0 answers
12 views

Decreasing reward when using DDPG

When I try to use the DDPG to solve a problem about resource allocation in communication networks, I get an odd result, e.g., the reward becomes smaller and smaller. At the same time, the critic's ...
Baolin Yin's user avatar
0 votes
0 answers
19 views

Can someone interpret my Binary Cross Entropy Loss Curve?

I am trying to understand my loss curve using : tf.keras.losses.BinaryCrossentropy() Question 1: Based on my loss curve/accuracy, would it be wise to proceed to feed it into a ensemble learning model ...
Leibon Jarbis's user avatar
1 vote
0 answers
21 views

What is the most optimal way to work with the "names" variables?

Suppose the following df: ...
Daniel_DS's user avatar
0 votes
0 answers
4 views

Adding sliding window dimension to data causes error: "Expected 3D or 4D (batch mode) tensor ..."

I wrote a pytorch data loader which used to return data of shape (4,1,192,320) representing the 4 samples of single channel image, each of size ...
Mahesha999's user avatar
0 votes
1 answer
15 views

Generate VTT file from speech to text

I was able to generate text from an audio file using huggingface, using this code ...
Kelly Goedert's user avatar
1 vote
0 answers
17 views

Is There any Open Source Implementation of Large-Scale SVM?

Question: Is anyone aware of a publicly accessible python package for large scale SVMs? Thanks! Why the Question Ought to be Answerable: As has been noted (e.g., here), the SVM problem can be ...
Thomas Winckelman's user avatar
0 votes
1 answer
17 views

Class imbalance problem in binary classification of ecg and eeg data. I am cross posting it here from stackExchange as per a user suggestion

I have attached the link to the stack overflow question page under. In short it is a Class imbalance problem in binary classification of ecg and eeg data. https://stackoverflow.com/questions/78232398/...
Shanthanu's user avatar
0 votes
0 answers
12 views

Best value of K when using K-Nearest Neighbors with Spectral Clustering

I'm using scikit-learn's SpectralClustering class, which has the option of building its affinity matrix using a K-Nearest Neighbors algorithm. Is there any way to ...
Hippopotoman's user avatar
0 votes
0 answers
6 views

Which model and embedding to use for portuguese chat with docs

I would like to have a model to read all my personal documents, meeting notes and things like that, all text based, and then be able to ask questions like: what was decided about the feature x? what ...
Kelly Goedert's user avatar
0 votes
0 answers
34 views

deep learning for stock prediction

I am learning deep learning . Right now I am using MNIST data set, which contains tens of thousands of scanned images of handwritten digits, together with their correct classifications. My question ...
quanity's user avatar
  • 101
0 votes
0 answers
22 views

Why is positional encoding preferable over adding additional features for transformer models?

Why is information about the position not added as an additional feature? I read in forums that the only reason would be length-based overfitting, but I couldn't find a reliable source for that. What ...
kot's user avatar
  • 11
0 votes
1 answer
16 views

SHAP values are explaining the wrong output value

I was checking the local accuracy property of the SHAP values. It states that for a data point $(X,y)$, the SHAP values $(s_1,s_2,s_3,...)$ of features $(x_1,x_2,x_3,...)$ sum up to the difference of ...
Abhay Gupta's user avatar
0 votes
0 answers
24 views

Combining monte carlo with deep learning to improve the estimation

I am in situation where i need to estimate the attenuation of an EM wave . we consider EM wave as collection of photons. These photons when strike with some dust particles they scatter in different ...
user7341333's user avatar
0 votes
1 answer
30 views

Prompt Ops Alternatives

What are the main alternatives for prompt ops nowadays? By prompt ops, I mean a comprehensive solution for tracking prompt engineering experiments and also registering prompts in different stages, ...
Raffaele 's user avatar
0 votes
0 answers
8 views

Replacing values in a dataset based on a IF statement

I have code for which this works perfectly, see code 1 below. But for code 2, it does not work at all. Very strange. Only difference is the way the tables were created, and the use of macro variables ...
babipsylon's user avatar
1 vote
1 answer
26 views

Asynchronous Training of Deep Learning Models

I am thinking of how would it be if I can create asynchronous forward function in sub-class of nn.Module . When I came across architecture in attached image, I felt that it would be faster if we could ...
Sarvagya_P's user avatar
0 votes
0 answers
19 views

Insights about W0rd2Vec

As per my knowledge, Word2Vec is belongs to non-contextual embedding technique. this have only semantic relationship between words. We can implement Word2Vec, either in CBoW or skip-gram model. but i ...
Tovlk's user avatar
  • 43
0 votes
1 answer
29 views

Uneven spaced time series data, any advise on how to approach?

In dealing with uneven spaced time series data, any advise what would be the approach ? data is ECG data to predict if the blood pressure Sys would drop -20% or 80% of normal. In the usual approach ...
curiosityfrown's user avatar
0 votes
0 answers
15 views

Lost when trying to get good time series prediction results (regression problem) even after trying many things

I'm not able to get good results after a long time testing when using TensorFlow to predict time series data (regression problem). I don't know if the problem is with the data (little quantity and/or ...
Marco's user avatar
  • 101
1 vote
1 answer
35 views

Standard Scaling After Log Transformation

I have a quick question about whether or not to standardize features after a log transformation. I have one feature that is heavily skewed and requires the log transformation, for the other features I'...
atn291's user avatar
  • 11
0 votes
0 answers
15 views

VC dimension of a class H that assigns 1 to at most k points or that assigns 0 to at most k points

Let $X$ be a finite domain and $k$ a number such that $k\le|X|$. Consider the hypothesis class $$ H:=\{h:|\{x\in X:h(x)=1\}|\le k\text{ or }|\{x\in X:h(x)=0\}|\le k\}. $$ Find the VC dimension of $H$.
harshchy2210's user avatar
0 votes
0 answers
15 views

SAS: how to replace a value in column two in a dataset for which column one = x?

So, total SAS noob here (and I don't like it al all so far). I tried 4 different methods, which all do not work. So I guess in all of these code, something similar is wrong, something rather ...
babipsylon's user avatar
0 votes
1 answer
18 views

Error while executing the adaptiverandomforest with river libraray

I have installed rivery library and write the adaptiverandomforestregression program to apply onlinelearning and I am getting errror that AttributeError: module 'river.ensemble' has no attribute '...
RAJESH KOYI's user avatar
0 votes
1 answer
12 views

Doing correctly paired-trial validation

In paired-trial validation, a statistical (ML) models are trained on $n$ datasets separately and then applied to other datasets, as a way of estimating the generalization of the models obtained. ...
Roger V.'s user avatar
  • 103
0 votes
1 answer
42 views

Pearson correlation with overlapping data

I have a financial time series and I want to calculate correlation between past and future returns. First I select look back and holding periods, say l and h respectively. Then I calculate past ...
970541804's user avatar
2 votes
1 answer
45 views

Univariate time series forecasting with bimodal distribution

This is my first ML project ever. Well the objective is to build a forecasting model of a univariate time series containing solid waste weights loaded from the city of Austin,Texas. The distribution ...
karim abousselham's user avatar
2 votes
1 answer
35 views

Time Series Analysis and Price Elasticity

Introduction: As of now, I am a fourth year data science student. As of now, I also have my own company where I work parttime (8/12 hours per week) to gain some more experience in the domain. As you ...
Martijn's user avatar
  • 21
0 votes
0 answers
12 views

Dataset for access control policies?

I'm working on a dynamic access control policy generation model using machine learning and I need a real dataset to evaluate the performance. Is there any access control policy dataset consisting ...
Binod Karunanayake's user avatar
0 votes
0 answers
9 views

Is this how you would go about this NLP Project?

What do you think of these steps? And where can I find help with this project? I am in a business class and was assigned a data science problem. I was advised to seek out a coder at my school who can ...
Layla M's user avatar
0 votes
0 answers
14 views

I want to know how to debug this code because it gives me error

The following is a code for the cvrp problem using simmulated annealing algorithm but im trying to incorporate the time windows as delivery schedule. but its not working ...
user161734's user avatar
0 votes
0 answers
4 views

Intuition and technical explanation behind "3D-aware Feature Attention" in Sync Dreamer? (Multiview Generating Diffusion Model)

I am looking to understand the whole block on how the Sync Dreamer paper has constructed the "3D aware feature attention" which is outlined on page 5. To enforce consistency among multiple ...
ChaoS Adm's user avatar
  • 141
0 votes
0 answers
18 views

Content based filtering with dissimilar user interests

I'm prototyping a system for recommending articles to users. A single embedding vector is generated for the article summary, and users self report a list of non-enumerated interests. Concretely, a ...
stevester94's user avatar
0 votes
1 answer
18 views

Which Experiment Results Should Be Included: Reproduced or Original?

I am currently working on a research project in the field of machine learning where I am attempting to reproduce the results of a specific paper. To ensure accuracy and transparency, I have utilized ...
jackson's user avatar
  • 25
2 votes
1 answer
86 views

How to do a Multilabel classification where the label order is important?

I am doing carbon composite modelling for my college project. Each composite sample is created by stacking carbon fiber of different angles (0, 45, 90,-45). A sample can contain 8, 12 or 16 of such ...
apotheke's user avatar
0 votes
1 answer
31 views

When applying softmax over multiple dimensions of a tensor, does the order in which those dimensions are matter?

Lets say i have a tensor of order 256, dimensions indexed from 0 to 255. Lets say i am writing a function implementing the softmax operation because i am a newbie and i want to understand the ...
Maciej's user avatar
  • 101
0 votes
0 answers
19 views

Multiclass PyTorch neural net is stuck predicting 1 class, even with "simple" dataset

I'm trying to predict a class of some data, and am struggling. So, to debug I created a simple test dataset, yet I am having the same issues. I've tried adding weighting, and lastly adding a column ...
Russ's user avatar
  • 1
0 votes
0 answers
16 views

Training the neural network does not give the expected result

I'm trying to create a pytorch neural network capable of recognizing peaks in 2D graphs. Previously, I was able to get a result close to what I wanted, but it was not ideal and did not give a ...
AlterEGO's user avatar
1 vote
0 answers
17 views

Outlier detection with elliptic envelope - unexpected error

I am trying to detect outliers with sklearn.covariance.EllipticEnvelope for a single variable, but it throws an unexpected error. Here is an example the reproduces ...
Maya's user avatar
  • 11

15 30 50 per page
1
3 4
5
6 7
738