Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [deep-learning]

a new area of Machine Learning research concerned with the technologies used for learning hierarchical representations of data, mainly done with deep neural networks (i.e. networks with two or more hidden layers), but also with some sort of Probabilistic Graphical Models.

Filter by
Sorted by
Tagged with
0 votes
0 answers
3 views

Theoretical Limitations of Achieving 100% Accuracy in Modeling Non-linear Relationships with Neural Networks

I am working on a project where I need to model a specific non-linear relationship using a neural network. The relationship is given by $y = 3x_1^2x_2^3 $. The approach involves: Preprocessing the ...
Mo McWebmo's user avatar
0 votes
0 answers
9 views

ML for lot sizing task

I am solving the problem of automatic lot sizing, which consist of different products. I receive data about a certain product and I have to decide which products to combine into lots. And then ...
user162857's user avatar
2 votes
1 answer
19 views

How to chose the right activation function for CNN output depending on the output value ranges?

I'm working on training a CNN model that takes an eye image as input and outputs the 5 coordinates of the ellipse representing the pupil ...
Ersven's user avatar
  • 21
-1 votes
0 answers
19 views

convolution neural network

how can i use CNN to know the percent of each compenet in a food and how can I get this Quality and Quantity of Training Data i found that i start with a range of labels representing different ...
sekhra salma's user avatar
0 votes
0 answers
20 views

Segment a spectrogram into a series of images by (constant) beats per minute to train a Deep Neural Network

I have a .csv file with information about a soundtrack and it is divided into beats (per minute), which are ordered by row. As in: the index corresponds to each beat, and the columns have info about ...
Johnathan Smitherton's user avatar
1 vote
1 answer
18 views

Improving GPU Utilization in LLM Inference System

I´m trying to build a distributed LLM inference platform with Huggingface support. The implementation involves utilizing Python for model processing and Java for interfacing with external systems. ...
Cardstdani's user avatar
0 votes
0 answers
19 views

Input 0 of layer "sequential_2" is incompatible with the layer: expected shape=(None, 3, 3), found shape=(1, 3, 11)

I am trying to predict stock closing price using news sentiment analysis with the help LSTM neural network but after I do model.fit(). I am encountered with the error message: ValueError: Input 0 of ...
pankaj yadav's user avatar
1 vote
1 answer
36 views

How to measure different models' feature importance using a generic and common standard?

I want to measure the feature importance of a series of models after training them. Most models have some built-in APIs that allow me to access their feature importance, but as far as I know, these ...
Yuuya's user avatar
  • 11
0 votes
0 answers
9 views

Why is resnet regression model (on a skewed data with small interval) not converging?

Using resnet50 (torchvision.models pretrained=False) with an input of [15, 224,224] which includes 14 heatmaps and a level set ...
topcat's user avatar
  • 1
0 votes
0 answers
21 views

Diffusion Models: Conditioning on Time vs. Noise Level

I am new to SE-Data Science, therefore I hope this is the right place to ask this rather theoretical question. In diffusion models we usually have a time variable which determines the noise schedule (...
Lockhart 's user avatar
0 votes
1 answer
18 views

Accuracy and test_accuracy gives a result =1

I've developed a code for classifying hyperspectral images using three different convolutional neural network (CNN) architectures: 1D, 2D, and 3D. The code has two main parts: Preprocessing and data ...
user162895's user avatar
0 votes
0 answers
35 views

Is it possible to train a neural network to feed into a Random Forest Classifier or any other type of classifier like XGBoost or Decision Tree?

I want to create a model architecture to predict future stock price movement as such: The Goal of this model is to predict if the price will go UP or DOWN within the next 3 months. I have tried a few ...
Evank's user avatar
  • 1
0 votes
0 answers
8 views

Training VAE in Latent Diffusion Models

When working with Latent Diffusion Models (LDMs), is it common practice to only train the U-Net component while leaving the VAE untrained? Additionally, does this approach apply when fine-tuning an ...
NakataKoo's user avatar
0 votes
3 answers
48 views

Why do we use similarity/cosine between Query and Key in attention?

Let's take an example sentence for translation: I am going to my home and play with toy house. For translating 'home', as per my understanding, Query will be 'house'...
Pratham's user avatar
0 votes
1 answer
25 views

CS undergrad query about DS

why is learning DS so ambigious .you dont truly know what should you learn to actually do DS .web dev say has a clear path learn html css js and you can make something .i am a cs undergrad just want ...
Muhammad Umer's user avatar
0 votes
0 answers
10 views

jar files downloading very slowly in jupyter notebook in Mac Book(M2 pro)

Required jar files are downloading from maven repository in Jupyter notebook are very slow in Mac book (M2 pro). how can i increase the speed of download?
Tovlk's user avatar
  • 43
-1 votes
1 answer
33 views

I need suggestion for a project

I want to make a forecasting system which will forecast how much quantity will be sold next year based on the previous 5 years' data from 2019 to 2023 and want to predict for future years. Now the ...
theunknown's user avatar
0 votes
0 answers
13 views

Whats a suitable feature selection method for Time series data across multiple files?

My problem is basically a higher dimensional regression, where my input is (100 levels, 300 timesteps, 23 features) My goal is to build a deep learning LSTM model that finds which level the data ...
Youssef Badr's user avatar
0 votes
0 answers
10 views

Can transfer learning on VGG better align with Across the Spider-Verse styles for improved style transfer?

Our project is working on implementing style transfer using styles from Across the Spider-verse. We've gotten some good outputs so far, but were wondering if we could better align the VGG model to the ...
Geo C's user avatar
  • 1
0 votes
0 answers
23 views

Candidate sampling

In the context of extreme multiclass classification with softmax, if I use candidate sampling where each training sample has different output node meanings, how does the network determine at inference ...
Barney's user avatar
  • 1
0 votes
0 answers
21 views

Research in Machine Learning in the era of transformers

I'm a master's student in Machine Learning. I'm interested in pursuing research in the field, but I'm concerned about the recent advancements like ChatGPT, CLIP, and DiNO that require massive compute ...
brahim benelghali's user avatar
0 votes
1 answer
14 views

Should I standardise time series data for deep learning classification?

Say I have time series data for classifying stars using deep learning based on stellar variability, with each time series data measuring the flux of the star overtime. For each star, I have the data ...
Johnathon Smith's user avatar
2 votes
1 answer
24 views

Practical Experiments on Self-Attention Mechanisms: QQ^T vs. QK^T

I'm currently exploring the self-attention mechanism used in models like Transformers, and I have a question about the necessity of using a separate key matrix (K) instead of just using the query ...
Peyman's user avatar
  • 1,165
0 votes
0 answers
7 views

Importance of stride and padding

Why keeping the image size the same after convolution (in normal: new image size = image size + 1 - kernel size) perform a better result? Why strides different from 1 may be useful?
Тима 's user avatar
0 votes
0 answers
12 views

Can a multi-task model work on conditions for each layer?

I am currently working on a multi-task model that needs to handle car detection, damage segmentation and license plate ocr. my idea was to only run the OCR layer when there is a license plate detected ...
Enes Aygun's user avatar
-1 votes
0 answers
13 views

Assistance Required with Python Project Setup

I am currently focusing on enhancing my skills in deep learning and have recently downloaded a project from GitHub to work on. Unfortunately, I am experiencing issues with getting the project to run ...
dreamv's user avatar
  • 1
1 vote
1 answer
33 views

Unordered Set Classification Problem

In my setup I have one feature which is a sparse list representing categories. For example, let's say that we have M categories in the interval ...
dpalma's user avatar
  • 111
0 votes
1 answer
17 views

How will weights learn in CNN for multi class classification?

How are the weights of filters in a CNN can learn meaningful features in multiclasses classification if they keep changing as different images are passed through the network during training.Say we are ...
Jai's user avatar
  • 1
1 vote
0 answers
17 views

Recreating results from Research Paper

so I have been trying to recreate the results from this particular paper (Neural Collaborative Filtering). The dataset I use closely resembles this . I understand that I should my data into train and ...
Panos_42's user avatar
0 votes
0 answers
18 views

Create model for manufacturing defect detection using python

Has anyone done some work on manufacturer defect detection? I need some input on this. I have done some research and found some examples like TensorFlow/Keras and CNN, but I need some real-time ...
Reetesh Nigam's user avatar
0 votes
0 answers
38 views

Tensorflow SegNet architecture

I was unable to find a complete description of the SegNet architecture for image segmentation (specifically, the decoder layers). Therefore, I would like to clarify the correctness of my ...
D .Stark's user avatar
0 votes
0 answers
27 views

Extremely Imbalanced and Gapped Dataset in Regression Problem

Currently I am working with a biological dataset with a range of 0-to-1 to do a multi-task regression with Deep Learning. However, this dataset has an empty gap in the range 0 to 0.2 (however there ...
Abdullah Faqih's user avatar
0 votes
0 answers
11 views

Trying to understand Ch.2.1 "2.1. Monads and their algebras" of "Categorical Deep Learning: An Algebraic Theory of Architectures"

I am trying to read article "Categorical Deep Learning: An Algebraic Theory of Architectures" https://arxiv.org/abs/2402.15332 and I am stuck with the Chapter 2.1 "2.1. Monads and their ...
TomR's user avatar
  • 141
0 votes
0 answers
8 views

DCGAN for mammograms

I'm currently working on a DCGAN with Wasserstein Distance Gradient Penalty (WGAN-GP) for mammograms. The target mammograms are in 4D, as I'm using SD VAE 1.4 to reduce the complexity. Each of the ...
Norhther's user avatar
0 votes
0 answers
7 views

MIT-BIH and ECG-ID for ECG Authentication System

Both the MIT-BIH and ECG-ID data files are stored in the Waveform Database (WFDB) file format. The record_name.dat file formats are binary files containing samples of digitized signals. So, can I ...
Mohamed Azab's user avatar
0 votes
1 answer
18 views

can we use tanh activation function to detect outliers?

Can we use tanh activation function to detect outliers ? Does my image below true for dataset outliers (after training model with tanh activation function) ?
user3668129's user avatar
1 vote
1 answer
26 views

Best modelling method when target is a distribution

I have a regression task where each data sample is annotated by multiple (5-10) experts. I observe that the annotated target of each data sample is a Gaussian distribution. Usually, people will use ...
zqtan98's user avatar
  • 11
1 vote
0 answers
25 views

Are formulas in the article incorrect?

I am learning about backpropagation in LSTM. I have been studying an article and watching two videos on the topic. The videos 1 and 2 repeat all the information from the article, but with additional ...
Тима 's user avatar
0 votes
0 answers
11 views

I am training LSTM model for flood water level prediction. How to make the performance of the model better?

...
Param Thakkar VJTI CS's user avatar
0 votes
0 answers
8 views

Resources for writing CNN for semantic segmentation

I am intermediate/advanced in Python and new to machine learning. Most of what I know about deep learning I learned through Deep Learning with Python by François Chollet. I am trying to do image ...
utx7563yu's user avatar
0 votes
0 answers
13 views

graph signal in GNN

I am reading several materials about graph signal processing for a thesis on Graph Neural Network and i see that a graph signal is defined as a vector so each node signal is a scalar. In practice, a ...
endeavor's user avatar
  • 101
0 votes
0 answers
102 views

How to properly prune a YOLOv8 model

I was trying to apply pruning to a YOLOv8 detection model. Following is my code and it runs successfully. I see the saved pruned model as well. My YOLOv8 model has 22 layers (an example list of layers ...
Mary H's user avatar
  • 1
0 votes
0 answers
21 views

How to improve Accuracy on dermaMNIST dataset?

Unlike the regular MNIST which gets 97-99% with a fairly basic network, dermaMNIST gets training/validation stuck on 0.69. This tells me the model is underfitting. But, making it bigger seems to have ...
Zwerchhau's user avatar
4 votes
0 answers
62 views

Why did I got opposite results of the original "How transferable are features in deep neural networks" paper?

I got tasked with reproducing the results of the influential "How transferable are features in deep neural networks?" paper in a DL class I'm taking (Full code). I got the exact opposite ...
OfirD's user avatar
  • 91
0 votes
0 answers
12 views

LSTM, different size for feature set and target

I am trying to build a weather forecasting model. X_train shape :(2970, 1, 9) Y_train shape : (3299675, 1, 4) I am following ...
Abhishek Patil's user avatar
0 votes
1 answer
20 views

Why are some columns of feature matrix after dimentionality reduction zero?

I am trying to implement a paper in which the ultimate goal is to predict mutliple labels for instances (which are genes here). The feature matrix with shape of 1236*18930 is built by calculating term ...
Satarnejad's user avatar
0 votes
0 answers
12 views

Keras Tuner for a (stacked) LSTM model?

I have a question about how to correctly setup a Keras Tuner model for a stacked LSTM model. What I have tried is the normal tutorial with a loop and the hp.Int() function to define the size of each ...
Barry's user avatar
  • 1
1 vote
1 answer
26 views

How to Balance Dataset extracted using image_dataset_from_directory

I'm new to tensorflow, so I've been trying to find the best way to do class balancing over a dataset where I used image_dataset_from_directory to load. But I haven't find the way to do it. I saw from ...
lopez-mgu's user avatar
0 votes
0 answers
23 views

Validation loss not decreasing

I am building a model for predicting stock portfolio positions, by minimizing a Sharpe loss function (corresponding to maximize the Sharpe ratio of the portfolio). The architecture is puting ...
Dan Lee's user avatar
0 votes
0 answers
89 views

How to prune my Yolov8 object detection model?

I trained a yolov8-medium object detection model, but I'm not sure how to apply pruning on it. What is the proper way to prune it? I got this example code, but it only looks for ...
Mary H's user avatar
  • 1

1
2 3 4 5
98