Questions tagged [multitask-learning]
The multitask-learning tag has no usage guidance.
19
questions
0
votes
1answer
18 views
How to feed data to multi-output Keras model from a single TFRecords file
I know how to feed data to a multi-output Keras model using numpy arrays for the training data. However, I have all my data in a single TFRecords file comprising several feature columns: an image, ...
0
votes
0answers
19 views
Any previous work to develop time series models for multiple label sets with different sampling rates
We have time series data with multiple labels: one label is sampled every day and the other label is added every one month and we would like to train the model accounting for both labels at the same ...
0
votes
0answers
16 views
How to optimize neural network with mutile losses
There is a multi-task problem that I try to solve with a single neutral network. In general it works fine, but it seems like there is a room for improvement.
The final loss to optimize looks like ...
0
votes
0answers
34 views
Multi-Model Learning | Text and Image | Mutually Differentiable Models | Is it possible?
Problem : Document classification of scanned financial documents using Text (OCR on the images) and Images. The documents are both structural (forms, tables), unstructured (letters, descriptions, ...
1
vote
1answer
113 views
Combining heterogeneous data sets for more powerful machine learning
Suppose we have two data sets of movie reviews; one from IMDB and one from Rotten Tomatoes (RT). Each entry has a written-review and a score attached to it. The concatenated datasets might look like
...
0
votes
1answer
274 views
Implementing Multitask Classification in Keras
I am Trying to implement Multitask Learning in Keras with share constitutional Layers and task specific FC layers.
Following is my model:
...
0
votes
1answer
158 views
Architecture for multivariate multi-time-series model where some features are TS specific and some features are global
I'm looking to build a time series model (using a TCN or a LSTM) with $N$ different series, each of which has $P$ series-specific features $\mathbf{X}$. My input array is of dimension $N \times t \...
0
votes
1answer
80 views
Why and how BERT can learn different attentions for each head?
https://towardsdatascience.com/deconstructing-bert-distilling-6-patterns-from-100-million-parameters-b49113672f77
I read the blog above. It visualizes that different color/head has different ...
1
vote
1answer
110 views
Should I rescale losses before combining them for multitask learning?
I have a multitask network taking one input and trying to achieve two tasks (with several shared layers, and then separate layers).
One task is multiclass classification using the CrossEntropy loss, ...
2
votes
1answer
634 views
Missing outputs in multiple-output neural net
I am looking at a task, where I want to predict multiple things from an image (an animal's breed [categorical], age [continuous number] and gender [categorical]). Unsurprisingly, my first thought was ...
4
votes
1answer
842 views
Thoughts on improving the Multitask Learning Model
Any Thoughts on improving the Model. So far i was able to achieve around accuracy 0.20 on each task specific dense network of a Multi task Learning Architecture. I have posted model and validation ...
1
vote
1answer
1k views
Multi task learning architecture for Multi-label classification
I am working a classification problem. The dataset was collected from Painters by number, a competition hosted by kaggle. The task is to identify painter,style and genre given paintings.
So far, I ...
4
votes
4answers
4k views
Multi target classification for different types of target variables
I am new to machine learning and I got this task in my university. I have a dataset with over 100 columns and two target variables: $target1$ is categorical i.e. $0$ or $1$ and $target2$ is continuous ...
12
votes
1answer
6k views
Multi task learning in Keras
I am trying to implement shared layers in Keras. I do see that Keras has keras.layers.concatenate, but I am unsure from documentation about its use. Can I use it to ...
1
vote
1answer
641 views
Multitask learning NN only trains on a few tasks
I am fairly new to the Machine Learning field, but I am working on building a multi-task network for a project I am working on. Unfortunately, despite all my best googling and digging through ...
3
votes
1answer
412 views
Multi-task learning for Multi-label classification?
I have a multi-label classification problem wherein each example can belong to one of the pre-defined classes (or can belong to none of them).
I was wondering if I can somehow apply multi-task ...
2
votes
3answers
975 views
Multi-Source Time Series Data Prediction
I was wondering if anyone has experience with time series prediction for data from multiple sources. So for instance, time series $a,b,..,z$ each have their own shape, some may be correlated with ...
5
votes
2answers
73 views
Error on multitask neural nets where all outputs not observed for every example
Let's say I have 2 datasets, each from a set of experiments. Dataset A measures a set of properties X for set S, while dataset B measures properties Y for set T. X and Y are highly correlated, and S ...
5
votes
1answer
2k views
How to do multitask learning using Caffe?
I wonder how to do multitask learning using Caffe. Should I simply use the output layer SigmoidCrossEntropyLoss or EuclideanLoss, and define more than one outputs?
E.g. is the following architecture ...