Questions tagged [multitask-learning]
The multitask-learning tag has no usage guidance.
35
questions
0
votes
1
answer
151
views
How to compute sample weight in multi-task model?
What's the correct way to calculate sample weight in a multi-task model?
Concretely, I have a model that outputs a 400 class [multi-class] classification, as well as a 5 class multi-label ...
0
votes
0
answers
12
views
Treating a Multi Task Problem as Single Task
In my model, the input is textual data. I have 5 targets, and each can take values from 0 to 5 (categorical values), which means that I am dealing with a multi-task problem and I need 5 heads for 5 ...
1
vote
1
answer
373
views
Is it possible to modify YOLOv8 to use it as a feature extractor for other tasks?
I'm reading through the documentation of YOLOv8 here, but I fail to see an easy way to do what I suggest in the title. What I want to do is to load a pretrained YOLOv8 model, create a bigger model ...
- 377
0
votes
0
answers
132
views
How to fine-tune a large language model for translation in a multi-dataset setting?
The Problem
We need to translate from language N to language C. If it helps, N is a natural ...
0
votes
0
answers
24
views
Weighting loss functions for multi task learning
I am training a multi-task neural network which is predicting a binary target variable, an 18-class target, and a 17-class target. I am calculating the cross-entropy loss for each task, then summing ...
- 1
0
votes
0
answers
39
views
Large change in validation loss, small change in training loss
I'm training a multi-task, multi-label neural network. I am attempting to tune the architecture and am having some trouble interpreting the learning curves. Particularly, when I look at the learning ...
- 63
0
votes
0
answers
27
views
Object detection (with bounding boxes) end-to-end as an auxiliary task (as in multitask learning)?
Let's say that I have a visual encoder (CNN or ViT) which outputs a volume of local features of dimensions WxHxD plus a global feature vector of dimension D, which I'm currently using as the backbone ...
- 377
1
vote
0
answers
20
views
Each multi-class output has another level of multi-class output
I want to predict a major class and then minor class.
Major class is a multi-class model which has 4 categories. Each of this categories has 10-15 subcategories, for which I can build a multi-task ...
- 11
2
votes
0
answers
218
views
Are more target labels in a multi-label classification always better?
Context
We work on medical image segmentation. There are a lot of potential labels for one and the same region we segment. There can be different medically defined labels like anatomical regions, more ...
- 121
0
votes
0
answers
78
views
Multi-task learning for improving segmentation
I am building a multi-task model, where my main task is segmentation and my auxiliary task is either denoising or image inpainting. The goal is to try to improve the quality of the segmentation with ...
- 11
2
votes
1
answer
52
views
Multi-modal neural network [closed]
How do you start with creating a multi-modal neural network?
- 131
1
vote
1
answer
218
views
What is the difference between Multi task learning and domain generalization
I was wondering about the differences between "multi-task learning" and "domain generalization". It seems to me that both of them are types of inductive transfer learning but I'm ...
- 113
2
votes
0
answers
64
views
How do we bring Pareto optimality into the realm of Machine Learning?
I have a multi-objective optimisation problem with a large number of objectives (more than 10) which is generally the case in most-real life problems. The use of traditional GAs such as NSGA-II or ...
1
vote
1
answer
70
views
Emotion Recognition with Multi-task Learning [closed]
Introduction
I am a beginner in Data Science and currently working on a learning project aimed at emotion recognition from a bio-medical sensor dataset.
The dataset consists of 8 sensors data from 20 ...
- 119
1
vote
1
answer
227
views
Tips for improving multitask learning based on multiple outputs
I'm currently trying to use multi-task learning based on a multi-output model that both allows to get an output for classification and regression. However, at the moment it's staying at around 20% ...
- 11
2
votes
0
answers
38
views
What kind of learning problem is this?
Say I have $n$ multi-class classification problems $p_1$, ..., $p_n$. Each of these have their own training data. While they are all distinct problems, there may be similarities in their data (which ...
- 21
1
vote
1
answer
116
views
Which is better: multi-output model or separate models for similar tasks?
I am working on two problems:
classification of images into high-level classes (e.g. shoe, dress, jacket etc.)
classification of the attributes of the same images on a lower level (e.g. shoe style, ...
- 19
1
vote
0
answers
32
views
Multitask learning model with variable number of tasks
This is my basic multitask learning model, and it has 2 tasks. Since there are only 2 tasks, maybe I can duplicate the code for each task as self.tower1 and self.tower2.
...
- 111
0
votes
1
answer
1k
views
ImageDataGenerator for multi task output in Keras using flow_from_directory
I am creating a multitask CNN model and I have two different classification properties (one with 10 classes, 2nd with 5 classes) and my directory structure looks like this:
...
- 131
1
vote
2
answers
5k
views
How to feed data to multi-output Keras model from a single TFRecords file
I know how to feed data to a multi-output Keras model using numpy arrays for the training data. However, I have all my data in a single TFRecords file comprising several feature columns: an image, ...
- 131
1
vote
1
answer
397
views
Combining heterogeneous data sets for more powerful machine learning
Suppose we have two data sets of movie reviews; one from IMDB and one from Rotten Tomatoes (RT). Each entry has a written-review and a score attached to it. The concatenated datasets might look like
...
0
votes
1
answer
2k
views
Implementing Multitask Classification in Keras
I am Trying to implement Multitask Learning in Keras with share constitutional Layers and task specific FC layers.
Following is my model:
...
1
vote
1
answer
481
views
Architecture for multivariate multi-time-series model where some features are TS specific and some features are global
I'm looking to build a time series model (using a TCN or a LSTM) with $N$ different series, each of which has $P$ series-specific features $\mathbf{X}$. My input array is of dimension $N \times t \...
- 499
1
vote
1
answer
234
views
Why and how BERT can learn different attentions for each head?
https://towardsdatascience.com/deconstructing-bert-distilling-6-patterns-from-100-million-parameters-b49113672f77
I read the blog above. It visualizes that different color/head has different ...
- 691
4
votes
1
answer
2k
views
Should I rescale losses before combining them for multitask learning?
I have a multitask network taking one input and trying to achieve two tasks (with several shared layers, and then separate layers).
One task is multiclass classification using the CrossEntropy loss, ...
- 143
4
votes
1
answer
1k
views
Missing outputs in multiple-output neural net
I am looking at a task, where I want to predict multiple things from an image (an animal's breed [categorical], age [continuous number] and gender [categorical]). Unsurprisingly, my first thought was ...
- 363
4
votes
1
answer
1k
views
Thoughts on improving the Multitask Learning Model
Any Thoughts on improving the Model. So far i was able to achieve around accuracy 0.20 on each task specific dense network of a Multi task Learning Architecture. I have posted model and validation ...
- 457
1
vote
1
answer
2k
views
Multi task learning architecture for Multi-label classification
I am working a classification problem. The dataset was collected from Painters by number, a competition hosted by kaggle. The task is to identify painter,style and genre given paintings.
So far, I ...
- 457
5
votes
4
answers
12k
views
Multi target classification for different types of target variables
I am new to machine learning and I got this task in my university. I have a dataset with over 100 columns and two target variables: $target1$ is categorical i.e. $0$ or $1$ and $target2$ is continuous ...
15
votes
1
answer
12k
views
Multi task learning in Keras
I am trying to implement shared layers in Keras. I do see that Keras has keras.layers.concatenate, but I am unsure from documentation about its use. Can I use it to ...
- 253
1
vote
1
answer
695
views
Multitask learning NN only trains on a few tasks
I am fairly new to the Machine Learning field, but I am working on building a multi-task network for a project I am working on. Unfortunately, despite all my best googling and digging through ...
- 31
4
votes
1
answer
610
views
Multi-task learning for Multi-label classification?
I have a multi-label classification problem wherein each example can belong to one of the pre-defined classes (or can belong to none of them).
I was wondering if I can somehow apply multi-task ...
- 3,775
3
votes
3
answers
2k
views
Multi-Source Time Series Data Prediction
I was wondering if anyone has experience with time series prediction for data from multiple sources. So for instance, time series $a,b,..,z$ each have their own shape, some may be correlated with ...
- 41
6
votes
2
answers
96
views
Error on multitask neural nets where all outputs not observed for every example
Let's say I have 2 datasets, each from a set of experiments. Dataset A measures a set of properties X for set S, while dataset B measures properties Y for set T. X and Y are highly correlated, and S ...
- 3,077
5
votes
1
answer
2k
views
How to do multitask learning using Caffe?
I wonder how to do multitask learning using Caffe. Should I simply use the output layer SigmoidCrossEntropyLoss or EuclideanLoss, and define more than one outputs?
E.g. is the following architecture ...
- 5,630