Questions tagged [multitask-learning]
The multitask-learning tag has no usage guidance.
0
votes
1answer
42 views
Implementing Multitask Classification in Keras
I am Trying to implement Multitask Learning in Keras with share constitutional Layers and task specific FC layers.
Following is my model:
...
0
votes
1answer
59 views
Architecture for multivariate multi-time-series model where some features are TS specific and some features are global
I'm looking to build a time series model (using a TCN or a LSTM) with $N$ different series, each of which has $P$ series-specific features $\mathbf{X}$. My input array is of dimension $N \times t \...
0
votes
1answer
65 views
Why and how BERT can learn different attentions for each head?
https://towardsdatascience.com/deconstructing-bert-distilling-6-patterns-from-100-million-parameters-b49113672f77
I read the blog above. It visualizes that different color/head has different ...
1
vote
0answers
42 views
Should I rescale losses before combining them for multitask learning?
I have a multitask network taking one input and trying to achieve two tasks (with several shared layers, and then separate layers).
One task is multiclass classification using the CrossEntropy loss, ...
2
votes
1answer
482 views
Missing outputs in multiple-output neural net
I am looking at a task, where I want to predict multiple things from an image (an animal's breed [categorical], age [continuous number] and gender [categorical]). Unsurprisingly, my first thought was ...
4
votes
1answer
728 views
Thoughts on improving the Multitask Learning Model
Any Thoughts on improving the Model. So far i was able to achieve around accuracy 0.20 on each task specific dense network of a Multi task Learning Architecture. I have posted model and validation ...
1
vote
1answer
1k views
Multi task learning architecture for Multi-label classification
I am working a classification problem. The dataset was collected from Painters by number, a competition hosted by kaggle. The task is to identify painter,style and genre given paintings.
So far, I ...
4
votes
4answers
3k views
Multi target classification for different types of target variables
I am new to machine learning and I got this task in my university. I have a dataset with over 100 columns and two target variables: $target1$ is categorical i.e. $0$ or $1$ and $target2$ is continuous ...
12
votes
1answer
4k views
Multi task learning in Keras
I am trying to implement shared layers in Keras. I do see that Keras has keras.layers.concatenate, but I am unsure from documentation about its use. Can I use it to ...
1
vote
1answer
610 views
Multitask learning NN only trains on a few tasks
I am fairly new to the Machine Learning field, but I am working on building a multi-task network for a project I am working on. Unfortunately, despite all my best googling and digging through ...
3
votes
0answers
352 views
Multi-task learning for Multi-label classification?
I have a multi-label classification problem wherein each example can belong to one of the pre-defined classes (or can belong to none of them).
I was wondering if I can somehow apply multi-task ...
2
votes
3answers
818 views
Multi-Source Time Series Data Prediction
I was wondering if anyone has experience with time series prediction for data from multiple sources. So for instance, time series $a,b,..,z$ each have their own shape, some may be correlated with ...
5
votes
1answer
66 views
Error on multitask neural nets where all outputs not observed for every example
Let's say I have 2 datasets, each from a set of experiments. Dataset A measures a set of properties X for set S, while dataset B measures properties Y for set T. X and Y are highly correlated, and S ...
5
votes
1answer
1k views
How to do multitask learning using Caffe?
I wonder how to do multitask learning using Caffe. Should I simply use the output layer SigmoidCrossEntropyLoss or EuclideanLoss, and define more than one outputs?
E.g. is the following architecture ...
