Questions tagged [multitask-learning]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
151 views

How to compute sample weight in multi-task model?

What's the correct way to calculate sample weight in a multi-task model? Concretely, I have a model that outputs a 400 class [multi-class] classification, as well as a 5 class multi-label ...
Snake Verde's user avatar
0 votes
0 answers
12 views

Treating a Multi Task Problem as Single Task

In my model, the input is textual data. I have 5 targets, and each can take values from 0 to 5 (categorical values), which means that I am dealing with a multi-task problem and I need 5 heads for 5 ...
mansoor sh's user avatar
1 vote
1 answer
373 views

Is it possible to modify YOLOv8 to use it as a feature extractor for other tasks?

I'm reading through the documentation of YOLOv8 here, but I fail to see an easy way to do what I suggest in the title. What I want to do is to load a pretrained YOLOv8 model, create a bigger model ...
Pablo Messina's user avatar
0 votes
0 answers
132 views

How to fine-tune a large language model for translation in a multi-dataset setting?

The Problem We need to translate from language N to language C. If it helps, N is a natural ...
NotNotLogic's user avatar
0 votes
0 answers
24 views

Weighting loss functions for multi task learning

I am training a multi-task neural network which is predicting a binary target variable, an 18-class target, and a 17-class target. I am calculating the cross-entropy loss for each task, then summing ...
sdg's user avatar
  • 1
0 votes
0 answers
39 views

Large change in validation loss, small change in training loss

I'm training a multi-task, multi-label neural network. I am attempting to tune the architecture and am having some trouble interpreting the learning curves. Particularly, when I look at the learning ...
tensormoby's user avatar
0 votes
0 answers
27 views

Object detection (with bounding boxes) end-to-end as an auxiliary task (as in multitask learning)?

Let's say that I have a visual encoder (CNN or ViT) which outputs a volume of local features of dimensions WxHxD plus a global feature vector of dimension D, which I'm currently using as the backbone ...
Pablo Messina's user avatar
1 vote
0 answers
20 views

Each multi-class output has another level of multi-class output

I want to predict a major class and then minor class. Major class is a multi-class model which has 4 categories. Each of this categories has 10-15 subcategories, for which I can build a multi-task ...
Di sha's user avatar
  • 11
2 votes
0 answers
218 views

Are more target labels in a multi-label classification always better?

Context We work on medical image segmentation. There are a lot of potential labels for one and the same region we segment. There can be different medically defined labels like anatomical regions, more ...
Spenhouet's user avatar
  • 121
0 votes
0 answers
78 views

Multi-task learning for improving segmentation

I am building a multi-task model, where my main task is segmentation and my auxiliary task is either denoising or image inpainting. The goal is to try to improve the quality of the segmentation with ...
A. Cimet's user avatar
2 votes
1 answer
52 views

Multi-modal neural network [closed]

How do you start with creating a multi-modal neural network?
Nikto's user avatar
  • 131
1 vote
1 answer
218 views

What is the difference between Multi task learning and domain generalization

I was wondering about the differences between "multi-task learning" and "domain generalization". It seems to me that both of them are types of inductive transfer learning but I'm ...
Milad Sikaroudi's user avatar
2 votes
0 answers
64 views

How do we bring Pareto optimality into the realm of Machine Learning?

I have a multi-objective optimisation problem with a large number of objectives (more than 10) which is generally the case in most-real life problems. The use of traditional GAs such as NSGA-II or ...
thatbangaloreanguy's user avatar
1 vote
1 answer
70 views

Emotion Recognition with Multi-task Learning [closed]

Introduction I am a beginner in Data Science and currently working on a learning project aimed at emotion recognition from a bio-medical sensor dataset. The dataset consists of 8 sensors data from 20 ...
H.PTavakoli's user avatar
1 vote
1 answer
227 views

Tips for improving multitask learning based on multiple outputs

I'm currently trying to use multi-task learning based on a multi-output model that both allows to get an output for classification and regression. However, at the moment it's staying at around 20% ...
Sunshine's user avatar
2 votes
0 answers
38 views

What kind of learning problem is this?

Say I have $n$ multi-class classification problems $p_1$, ..., $p_n$. Each of these have their own training data. While they are all distinct problems, there may be similarities in their data (which ...
Velvet Ghost's user avatar
1 vote
1 answer
116 views

Which is better: multi-output model or separate models for similar tasks?

I am working on two problems: classification of images into high-level classes (e.g. shoe, dress, jacket etc.) classification of the attributes of the same images on a lower level (e.g. shoe style, ...
DeeM's user avatar
  • 19
1 vote
0 answers
32 views

Multitask learning model with variable number of tasks

This is my basic multitask learning model, and it has 2 tasks. Since there are only 2 tasks, maybe I can duplicate the code for each task as self.tower1 and self.tower2. ...
Jingles's user avatar
  • 111
0 votes
1 answer
1k views

ImageDataGenerator for multi task output in Keras using flow_from_directory

I am creating a multitask CNN model and I have two different classification properties (one with 10 classes, 2nd with 5 classes) and my directory structure looks like this: ...
Obiii's user avatar
  • 131
1 vote
2 answers
5k views

How to feed data to multi-output Keras model from a single TFRecords file

I know how to feed data to a multi-output Keras model using numpy arrays for the training data. However, I have all my data in a single TFRecords file comprising several feature columns: an image, ...
magomar's user avatar
  • 131
1 vote
1 answer
397 views

Combining heterogeneous data sets for more powerful machine learning

Suppose we have two data sets of movie reviews; one from IMDB and one from Rotten Tomatoes (RT). Each entry has a written-review and a score attached to it. The concatenated datasets might look like ...
Peter DeWeirdt's user avatar
0 votes
1 answer
2k views

Implementing Multitask Classification in Keras

I am Trying to implement Multitask Learning in Keras with share constitutional Layers and task specific FC layers. Following is my model: ...
Muhammad Fasiurrehman Sohi's user avatar
1 vote
1 answer
481 views

Architecture for multivariate multi-time-series model where some features are TS specific and some features are global

I'm looking to build a time series model (using a TCN or a LSTM) with $N$ different series, each of which has $P$ series-specific features $\mathbf{X}$. My input array is of dimension $N \times t \...
generic_user's user avatar
1 vote
1 answer
234 views

Why and how BERT can learn different attentions for each head?

https://towardsdatascience.com/deconstructing-bert-distilling-6-patterns-from-100-million-parameters-b49113672f77 I read the blog above. It visualizes that different color/head has different ...
惊天补扣's user avatar
4 votes
1 answer
2k views

Should I rescale losses before combining them for multitask learning?

I have a multitask network taking one input and trying to achieve two tasks (with several shared layers, and then separate layers). One task is multiclass classification using the CrossEntropy loss, ...
Silver Duck's user avatar
4 votes
1 answer
1k views

Missing outputs in multiple-output neural net

I am looking at a task, where I want to predict multiple things from an image (an animal's breed [categorical], age [continuous number] and gender [categorical]). Unsurprisingly, my first thought was ...
Björn's user avatar
  • 363
4 votes
1 answer
1k views

Thoughts on improving the Multitask Learning Model

Any Thoughts on improving the Model. So far i was able to achieve around accuracy 0.20 on each task specific dense network of a Multi task Learning Architecture. I have posted model and validation ...
James K J's user avatar
  • 457
1 vote
1 answer
2k views

Multi task learning architecture for Multi-label classification

I am working a classification problem. The dataset was collected from Painters by number, a competition hosted by kaggle. The task is to identify painter,style and genre given paintings. So far, I ...
James K J's user avatar
  • 457
5 votes
4 answers
12k views

Multi target classification for different types of target variables

I am new to machine learning and I got this task in my university. I have a dataset with over 100 columns and two target variables: $target1$ is categorical i.e. $0$ or $1$ and $target2$ is continuous ...
Rajeev Motwani's user avatar
15 votes
1 answer
12k views

Multi task learning in Keras

I am trying to implement shared layers in Keras. I do see that Keras has keras.layers.concatenate, but I am unsure from documentation about its use. Can I use it to ...
Aditya's user avatar
  • 253
1 vote
1 answer
695 views

Multitask learning NN only trains on a few tasks

I am fairly new to the Machine Learning field, but I am working on building a multi-task network for a project I am working on. Unfortunately, despite all my best googling and digging through ...
THerzog's user avatar
  • 31
4 votes
1 answer
610 views

Multi-task learning for Multi-label classification?

I have a multi-label classification problem wherein each example can belong to one of the pre-defined classes (or can belong to none of them). I was wondering if I can somehow apply multi-task ...
SHASHANK GUPTA's user avatar
3 votes
3 answers
2k views

Multi-Source Time Series Data Prediction

I was wondering if anyone has experience with time series prediction for data from multiple sources. So for instance, time series $a,b,..,z$ each have their own shape, some may be correlated with ...
Nmaple's user avatar
  • 41
6 votes
2 answers
96 views

Error on multitask neural nets where all outputs not observed for every example

Let's say I have 2 datasets, each from a set of experiments. Dataset A measures a set of properties X for set S, while dataset B measures properties Y for set T. X and Y are highly correlated, and S ...
jamesmf's user avatar
  • 3,077
5 votes
1 answer
2k views

How to do multitask learning using Caffe?

I wonder how to do multitask learning using Caffe. Should I simply use the output layer SigmoidCrossEntropyLoss or EuclideanLoss, and define more than one outputs? E.g. is the following architecture ...
Franck Dernoncourt's user avatar