Data Science

Questions tagged [multitask-learning]

Ask Question

The tag has no usage guidance.

24 questions
Newest
Active
Bountied
Unanswered
Filter by
Sorted by
Tagged with
2
votes
0answers
35 views

What kind of learning problem is this?

Say I have $n$ multi-class classification problems $p_1$, ..., $p_n$. Each of these have their own training data. While they are all distinct problems, there may be similarities in their data (which ...
0
votes
0answers
12 views

Tensorflow Model not returning a Distribution object when having DistributionLambda as last layer in a multitasking model

I am building a TF CNN model that takes a picture as input and has 3 outputs (multitask learning). On one of the output layers, I would like to output a distribution object, ...
0
votes
1answer
19 views

Which is better: multi-output model or separate models for similar tasks?

I am working on two problems: classification of images into high-level classes (e.g. shoe, dress, jacket etc.) classification of the attributes of the same images on a lower level (e.g. shoe style, ...
0
votes
0answers
23 views

Multi-task Learning and Multi-task Loss

I'm working with Mask R-CNN and want to understand the relationship between the produced losses Lmask, Lclass, Lbox which are eventually making up the muli-loss output and generally, multi-task ...
0
votes
0answers
31 views

Confusion Matrix for Multi task Learning using custom data generator

I am working on developing an MTL model. There are two tasks in the model, task1, and task2. And I have used a custom data generator using following code: ...
0
votes
0answers
22 views

Data Loader (imbalanced classes) for Multitask Learning - same input multiple output

I am working on developing an MTL model. There are three tasks in the model, task1, task2, and task3. The classes in these tasks are imalanced and I am stuck at how I should sample from these so that ...
0
votes
0answers
13 views

Multitask learning model with variable number of tasks

This is my basic multitask learning model, and it has 2 tasks. Since there are only 2 tasks, maybe I can duplicate the code for each task as self.tower1 and self.tower2. ...
0
votes
1answer
228 views

ImageDataGenerator for multi task output in Keras using flow_from_directory

I am creating a multitask CNN model and I have two different classification properties (one with 10 classes, 2nd with 5 classes) and my directory structure looks like this: ...
0
votes
2answers
1k views

How to feed data to multi-output Keras model from a single TFRecords file

I know how to feed data to a multi-output Keras model using numpy arrays for the training data. However, I have all my data in a single TFRecords file comprising several feature columns: an image, ...
1
vote
1answer
225 views

Combining heterogeneous data sets for more powerful machine learning

Suppose we have two data sets of movie reviews; one from IMDB and one from Rotten Tomatoes (RT). Each entry has a written-review and a score attached to it. The concatenated datasets might look like ...
0
votes
1answer
791 views

Implementing Multitask Classification in Keras

I am Trying to implement Multitask Learning in Keras with share constitutional Layers and task specific FC layers. Following is my model: ...
1
vote
1answer
296 views

Architecture for multivariate multi-time-series model where some features are TS specific and some features are global

I'm looking to build a time series model (using a TCN or a LSTM) with $N$ different series, each of which has $P$ series-specific features $\mathbf{X}$. My input array is of dimension $N \times t \...
0
votes
1answer
89 views

Why and how BERT can learn different attentions for each head?

https://towardsdatascience.com/deconstructing-bert-distilling-6-patterns-from-100-million-parameters-b49113672f77 I read the blog above. It visualizes that different color/head has different ...
3
votes
1answer
405 views

Should I rescale losses before combining them for multitask learning?

I have a multitask network taking one input and trying to achieve two tasks (with several shared layers, and then separate layers). One task is multiclass classification using the CrossEntropy loss, ...
3
votes
1answer
814 views

Missing outputs in multiple-output neural net

I am looking at a task, where I want to predict multiple things from an image (an animal's breed [categorical], age [continuous number] and gender [categorical]). Unsurprisingly, my first thought was ...
4
votes
1answer
934 views

Thoughts on improving the Multitask Learning Model

Any Thoughts on improving the Model. So far i was able to achieve around accuracy 0.20 on each task specific dense network of a Multi task Learning Architecture. I have posted model and validation ...
1
vote
1answer
2k views

Multi task learning architecture for Multi-label classification

I am working a classification problem. The dataset was collected from Painters by number, a competition hosted by kaggle. The task is to identify painter,style and genre given paintings. So far, I ...
5
votes
4answers
6k views

Multi target classification for different types of target variables

I am new to machine learning and I got this task in my university. I have a dataset with over 100 columns and two target variables: $target1$ is categorical i.e. $0$ or $1$ and $target2$ is continuous ...
14
votes
1answer
8k views

Multi task learning in Keras

I am trying to implement shared layers in Keras. I do see that Keras has keras.layers.concatenate, but I am unsure from documentation about its use. Can I use it to ...
1
vote
1answer
662 views

Multitask learning NN only trains on a few tasks

I am fairly new to the Machine Learning field, but I am working on building a multi-task network for a project I am working on. Unfortunately, despite all my best googling and digging through ...
4
votes
1answer
466 views

Multi-task learning for Multi-label classification?

I have a multi-label classification problem wherein each example can belong to one of the pre-defined classes (or can belong to none of them). I was wondering if I can somehow apply multi-task ...
2
votes
3answers
1k views

Multi-Source Time Series Data Prediction

I was wondering if anyone has experience with time series prediction for data from multiple sources. So for instance, time series $a,b,..,z$ each have their own shape, some may be correlated with ...
6
votes
2answers
83 views

Error on multitask neural nets where all outputs not observed for every example

Let's say I have 2 datasets, each from a set of experiments. Dataset A measures a set of properties X for set S, while dataset B measures properties Y for set T. X and Y are highly correlated, and S ...
5
votes
1answer
2k views

How to do multitask learning using Caffe?

I wonder how to do multitask learning using Caffe. Should I simply use the output layer SigmoidCrossEntropyLoss or EuclideanLoss, and define more than one outputs? E.g. is the following architecture ...