Skip to main content

Questions tagged [machine-translation]

Machine translation in a data science context refers to the process of using machine learning techniques to translate input provided in one language into output in another. It includes topics referring to using text/corpus data, neural machine translation (NMT), deep learning, and speech recognition.

31 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3 votes
0 answers
42 views

Back-Translation model for German and English

Do you know of any pre-trained models for back translation between German and English? I am aware that there are ways to include a monolingual corpus into the training of a machine translation model (...
treebased's user avatar
3 votes
0 answers
751 views

How to train tensorflow's transformer model on my own data?

https://github.com/tensorflow/models/blob/master/official/transformer has an implementation of transformer model. I want to train the model on my own data(consisting of two files, src.txt, and tgt.txt)...
Abhishek Niranjan's user avatar
3 votes
0 answers
115 views

Encoder-Decoder Sequence-to-Sequence Model for Translations in Both Directions

Is it possible to use a pre-trained sequence to sequence encoder-decoder model which translates an input text in source language to an output in target language to do an inverse translation? That is, ...
Amir's user avatar
  • 193
2 votes
0 answers
59 views

Why does cross-attention in an NMT decoder use the encoder embeddings as values?

In the Vaswani 2017 paper introducing encoder-decoder transformers, the cross-attention step in the decoder is visualised as follows: Because keys and values are always taken to be equal, this figure ...
Mew's user avatar
  • 243
2 votes
0 answers
56 views

How much data and computation power do I need to train a machine translation model using Transformer architecture?

I am working right now on creating a dataset to use in creating a machine translation model to translate between two dialects. I have two questions that I am trying to find an answer for: How much ...
user13288833's user avatar
2 votes
0 answers
593 views

What is the difference between register_buffer() and parameter.detach() in PyTorch?

I am writing a PositionalEmbedding() module which is an implementation based on "Attention Is All You Need" using PyTorch. According to the paper, there ...
Jason Young's user avatar
2 votes
0 answers
529 views

Weight matrices in transformers

I am trying to understand the transformer architecture. I am aware that the encoder/decoder contains multiple stacked self attention layers. Further each layer contains multiple heads. For example ...
boredaf's user avatar
  • 161
2 votes
0 answers
223 views

Can BERT embeddings be used to reproduce the original content of the text?

From what I understand, BERT provides contextualized embeddings that are not deterministic the way Word2Vec embeddings (i.e. the word "Queen" doesn't always produce the same vector, it'll be different ...
RafiyaJaved's user avatar
2 votes
0 answers
35 views

How to estimate the lambda e to reweighing translation probabilities of entries in a dictionary

In this paper, Brown et al. proposed the usage of dictionary entries in addition to the machine translation probabilities that we're used to in the Math of Statistical Machine Translation. He ...
alvas's user avatar
  • 2,410
1 vote
1 answer
77 views

What could cause pre-trained Opus-MT models have wildly varying inference time when being used with transformers library?

I have been testing pre-trained Opus-MT models ported to transformers library for python implementation. Specifically, I am using opus-mt-en-fr for English to French translation. And the tokenizer and ...
Shan Dou's user avatar
  • 131
1 vote
0 answers
2k views

Pytorch build_vocab_from_iterator giving vocabulary with very few words

I am trying to build a translation model in pytorch. Following this post on pytorch I downloaded the multi30k dataset and spacy models for English and German. ...
k-c's user avatar
  • 13
1 vote
0 answers
83 views

Why does Bahdanau Attention Have to be Causal?

Using the Bahdanau attention layer on Tensorflow for time series prediction, although conceptually it is similar to NLP applications. This is how the minimal example code for a single layer looks like....
Della's user avatar
  • 335
1 vote
2 answers
3k views

Self Attention vs LSTM with Attention for NMT

I am trying to compare the A: Transformer-based architecture for Neural Machine Translation (NMT) from the Attention is All You Need paper, with B: an architecture based on Bi-directional LSTM's in ...
mashrivas's user avatar
1 vote
0 answers
273 views

How to do batch inference on Hugging face pretrained models?

I want to do batch inference on MarianMT model. Here's the code: ...
sai_varshittha's user avatar
1 vote
0 answers
24 views

Machine Learning for analyzing and generating sentences from given text inputs

I'm trying to create a program that will translate Sign Language to Text and apply NLP so that the text is understandable to human. I've used CNN for recognizing sign language but I don't know how to ...
Lord Dickenstein's user avatar
1 vote
1 answer
61 views

Attention network without hidden state?

I was wondering how useful the encoder's hidden state is for an attention network. When I looked into the structure of an attention model, this is what I found a model generally looks like: ...
JMRC's user avatar
  • 111
1 vote
0 answers
36 views

Which is the best way to install Moses for SMT?

I have tried many ways but it always ended up in error. My Configuration: Ubuntu 16.04, Python 3.6.10 The error that I am unable to solve is: undefined reference to ...
Abdullah Khilji's user avatar
1 vote
0 answers
41 views

Seq2Seq for sentence correction

I have a task in hand where I get a dirty formed sentence and need to correct it. Examples are, "StackOverflow best question answering platform" to be converted to "StackOverflow is best question ...
Sandeep Bhutani's user avatar
1 vote
0 answers
196 views

How can I finetune XLM-R for neural machine translation between the same language(Catalan to Catalan-with different grammar structure))?

Can I fine-tune XLM-R to do something similar to https://www.guru99.com/seq2seq-model.html (encoder-decoder architecture or any other way that perform good in small dataset - around 1000) For example: ...
NLP Dude's user avatar
1 vote
0 answers
18 views

searching for vocabulary for machine translation

Searching for DE-EN vocabulary, that I can use in my machine translation. It should consist of DE-EN phrases, words, sentences etc. Got one from here http://www.manythings.org/anki/ , but searching ...
codecodecode's user avatar
1 vote
0 answers
18 views

How can we predict Geo Tagged Pollution Parameters using a Machine Learning Model with an Android Device?

Newly installed Pollution Control Sensory Platforms are dumping Continous/Discrete Environment Pollution Parametric Data from various locations. Whats the best format structured or Unstructured of ...
Diaton's user avatar
  • 11
1 vote
0 answers
116 views

Algorithm to parse PSD into html/XML?

I have been working on a project and we were trying to convert a PSD (Adobe Photoshop) file to a HTML for web applications as well as a Layout XML for android. We worked our way to generate basic ...
TGW's user avatar
  • 111
1 vote
0 answers
109 views

What does NIST information weights refer to?

NIST is a metric used to measure the goodness of translation. In the paper, Doddington (2002) introduce the notion of "Information weights" Information weights were computed using N-gram ...
alvas's user avatar
  • 2,410
1 vote
0 answers
436 views

Hindi English Machine translation using OpenNMT

I am trying to perform machine translation using this. I am using this dataset for training. Result looks like this - ...
user123's user avatar
  • 169
1 vote
0 answers
90 views

Minimum Error Rate Training using Powell Search for Machine Translation

From the tutorial slides: http://mt-class.org/jhu/slides/lecture-tuning.pdf, (slide 37) the powell search algorithm goes as such: ...
alvas's user avatar
  • 2,410
0 votes
0 answers
8 views

Systematic way of selecting internet texts for a machine translation corpus / dataset?

I am currently working on a neural machine translation project and want to gather a corpus (or dataset) of internet texts that are written in standard and plain language. In theory, it certainly makes ...
tschomacker's user avatar
0 votes
1 answer
25 views

How to evaluate machine translations of long documents?

I'm using Python and I want to compare the output of two machine-translation (ish) systems. Most of the tools seem to be focused on sentence-by-sentence evaluation. Either I get memory blow-ups with ...
Paul Prescod's user avatar
0 votes
0 answers
654 views

How to Fine-Tune Multilingual Translational Transformer Models

I'm trying to fine-tune facebook/nllb-200-distteled-600M model on my english to arabic dataset, but the results are so bad I'm expecting there should be something wrong with defining the model and ...
Mohamed Abduljawad's user avatar
0 votes
0 answers
39 views

Is it possible for computers to tell how many people are speaking in a audio recording

Suppose I had a audio recording of 15 students saying "Here" all at the same. Can I tell how many students were speaking and who they were using machine learning? I want to create a school ...
Mustafa's user avatar
  • 101
0 votes
1 answer
16 views

Training NMT models for noisy social media roman text

I am trying to train an NMT model where the source side is roman text of Asian languages from social media, and target side is English. Note that since roman text is not native to Asia, the ...
Gokul NC's user avatar
  • 131
0 votes
1 answer
44 views

Passing Dependency/Constituency trees to a Neural Machine Translator

I am working on a project on Neural Machine Translation in the English-Irish domain. I am not an expert and have researched entirely on my own for a technology exhibition so apologies if my question ...
Justin Cunningham's user avatar