How can I finetune XLM-R for neural machine translation between the same language(Catalan to Catalan-with different grammar structure))?

Ask Question

Asked 2 years, 4 months ago

Modified 2 years, 4 months ago

Viewed 179 times

$\begingroup$

Can I fine-tune XLM-R to do something similar to https://www.guru99.com/seq2seq-model.html (encoder-decoder architecture or any other way that perform good in small dataset - around 1000) For example: Input: He sells food(in Catalan) Output: Food he sells(in Catalan)

Improve this question

edited Feb 27, 2020 at 15:59

NLP Dude

asked Feb 27, 2020 at 5:19

NLP DudeNLP Dude

3155 bronze badges

$\endgroup$

Add a comment |

0

Sorted by: Reset to default

Know someone who can answer? Share a link to this question via email, Twitter, or Facebook.

Your Answer

Thanks for contributing an answer to Data Science Stack Exchange!

Please be sure to answer the question. Provide details and share your research!

But avoid …

Asking for help, clarification, or responding to other answers.
Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.

To learn more, see our tips on writing great answers.

Draft saved

Draft discarded

Sign up or log in

Post as a guest

Name

Required, but never shown

Post as a guest

Name

Required, but never shown

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged neural-network deep-learning sequence-to-sequence machine-translation or ask your own question.

The Overflow Blog

How Stack Overflow is leveling up its unit testing game
Developers vs the difficulty bomb (Ep. 459)

Upcoming Events

2022 Community Moderator Election
ends in 13 hours

Featured on Meta

Testing new traffic management tool
Duplicated votes are being cleaned up
2022 Moderator Election Q&A – Question Collection
Site design and logo — Draft

Principle behind seq2seq model's example in keras?

Number of parameters in seq2seq model

How/What to initialize the hidden states in RNN sequence-to-sequence models?

How to calculate compression ratio when using autoencoder in neural network

Sentences language translation with neural network, with a simple layer structure (if possible sequential)

Can I fine-tune BERT, ELMO or XLnet for Seq2Seq neural machine translation?

Transformer seq2seq model and loading embeddings from XLM-RoBERTa

Feeding XLM-R embeddings to neural machine translation?

What are the inputs to the first decoder layer in a Transformer model during the training phase?

Hot Network Questions

Why Fed Funds Rate's is higher than U.S. treasury yield on the short term (< 2M)
Erverse Hte Ifrst Wto Eltters fo Aech Owrd
Huge galaxies seen from earth
"if" statement syntax differences between C and C++
What map app would work well for via ferrata in the Dolomites?
I’m a foreigner with an expired passport which has my valid visa. Can I take a domestic flight in the US if I don’t have any other Id?
Secrecy in Mathematics
Multiple linear regression with lm() in R, why is the intersection dependent on the name of the "first" country
How can you map the probability of 2d6 onto a standard poker deck?
Examples of locally hyperbolic groups
Does the expression "(to be) filled with the Spirit" denote a temporary experience or a permanent state of being?
Amount of Isomorphisms Between Two Cyclic Groups of Identical Order is equal to the amount of Automorphisms of one of the cyclic groups
Why is it called "slew rate"?
How to put the text after the point legend?
Is the following sentence correct: "Confirm that someone is who they say they are"
Range hood lights on same switch as under cabinet lights?
Why are the Intel 8080's rotate instructions called opposite to intuition?
What are good ways to resolve intense intra-party conflict without PvP?
Why did (most of) the European NATO members support Ukraine's aspirations to joining NATO?
Book involving a metaverse of many parallel worlds, a section of which is known as "The Blight"
Identify this American novel set in the Great Depression era, perhaps set in Chicago and focused on meat packing?
Why is it assumed that space flights have to be safe?
Sapphic metre in Catullus 51.10
I overstayed a visa in the Schengen area, should I tell this when applying for a student visa in Canada?

Subscribe to RSS

Question feed

To subscribe to this RSS feed, copy and paste this URL into your RSS reader.

Stack Exchange Network

current community

your communities

more stack exchange communities

How can I finetune XLM-R for neural machine translation between the same language(Catalan to Catalan-with different grammar structure))?

0

Your Answer

Browse other questions tagged neural-network deep-learning sequence-to-sequence machine-translation or ask your own question.

Hot Network Questions

How can I finetune XLM-R for neural machine translation between the same language(Catalan to Catalan-with different grammar structure))?

0

Know someone who can answer? Share a link to this question via email, Twitter, or Facebook.

Your Answer

Sign up or log in

Post as a guest

Browse other questions tagged neural-network deep-learning sequence-to-sequence machine-translation or ask your own question.

Related

Hot Network Questions