Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [multitask-learning]

The tag has no usage guidance.

0
votes
0answers
36 views

Multi task learning with missing labels in Keras tutorial question

https://www.dlology.com/blog/how-to-multi-task-learning-with-missing-labels-in-keras/ I followed this tutorial to create a multi task model for binary classification with missing labels in keras. The ...
0
votes
1answer
26 views

Architecture for multivariate multi-time-series model where some features are TS specific and some features are global

I'm looking to build a time series model (using a TCN or a LSTM) with $N$ different series, each of which has $P$ series-specific features $\mathbf{X}$. My input array is of dimension $N \times t \...
0
votes
1answer
58 views

Why and how BERT can learn different attentions for each head?

https://towardsdatascience.com/deconstructing-bert-distilling-6-patterns-from-100-million-parameters-b49113672f77 I read the blog above. It visualizes that different color/head has different ...
1
vote
0answers
29 views

Should I rescale losses before combining them for multitask learning?

I have a multitask network taking one input and trying to achieve two tasks (with several shared layers, and then separate layers). One task is multiclass classification using the CrossEntropy loss, ...
2
votes
1answer
430 views

Missing outputs in multiple-output neural net

I am looking at a task, where I want to predict multiple things from an image (an animal's breed [categorical], age [continuous number] and gender [categorical]). Unsurprisingly, my first thought was ...
4
votes
1answer
685 views

Thoughts on improving the Multitask Learning Model

Any Thoughts on improving the Model. So far i was able to achieve around accuracy 0.20 on each task specific dense network of a Multi task Learning Architecture. I have posted model and validation ...
1
vote
1answer
1k views

Multi task learning architecture for Multi-label classification

I am working a classification problem. The dataset was collected from Painters by number, a competition hosted by kaggle. The task is to identify painter,style and genre given paintings. So far, I ...
5
votes
4answers
3k views

Multi target classification for different types of target variables

I am new to machine learning and I got this task in my university. I have a dataset with over 100 columns and two target variables: $target1$ is categorical i.e. $0$ or $1$ and $target2$ is continuous ...
12
votes
1answer
4k views

Multi task learning in Keras

I am trying to implement shared layers in Keras. I do see that Keras has keras.layers.concatenate, but I am unsure from documentation about its use. Can I use it to ...
1
vote
1answer
600 views

Multitask learning NN only trains on a few tasks

I am fairly new to the Machine Learning field, but I am working on building a multi-task network for a project I am working on. Unfortunately, despite all my best googling and digging through ...
2
votes
0answers
345 views

Multi-task learning for Multi-label classification?

I have a multi-label classification problem wherein each example can belong to one of the pre-defined classes (or can belong to none of them). I was wondering if I can somehow apply multi-task ...
2
votes
3answers
766 views

Multi-Source Time Series Data Prediction

I was wondering if anyone has experience with time series prediction for data from multiple sources. So for instance, time series $a,b,..,z$ each have their own shape, some may be correlated with ...
5
votes
1answer
64 views

Error on multitask neural nets where all outputs not observed for every example

Let's say I have 2 datasets, each from a set of experiments. Dataset A measures a set of properties X for set S, while dataset B measures properties Y for set T. X and Y are highly correlated, and S ...
5
votes
1answer
1k views

How to do multitask learning using Caffe?

I wonder how to do multitask learning using Caffe. Should I simply use the output layer SigmoidCrossEntropyLoss or EuclideanLoss, and define more than one outputs? E.g. is the following architecture ...