Questions tagged [machine-translation]

Machine translation in a data science context refers to the process of using machine learning techniques to translate input provided in one language into output in another. It includes topics referring to using text/corpus data, neural machine translation (NMT), deep learning, and speech recognition.

Filter by
Sorted by
Tagged with
2
votes
1answer
1k views

Is there a dataset with news articles and their headlines? [closed]

I need a set of news headlines and articles to help me in a project on automatic summarization. Is there such a dataset or something similar?
3
votes
0answers
113 views

Encoder-Decoder Sequence-to-Sequence Model for Translations in Both Directions

Is it possible to use a pre-trained sequence to sequence encoder-decoder model which translates an input text in source language to an output in target language to do an inverse translation? That is, ...
1
vote
0answers
18 views

How can we predict Geo Tagged Pollution Parameters using a Machine Learning Model with an Android Device?

Newly installed Pollution Control Sensory Platforms are dumping Continous/Discrete Environment Pollution Parametric Data from various locations. Whats the best format structured or Unstructured of ...
0
votes
2answers
1k views

Do we really need <unk> tokens?

I am wondering, do we really need <unk> tokens? Why do we limit our vocabulary? Is it for speed? Accuracy? If we disable all limitations, what do you ...
5
votes
2answers
8k views

Is there "Attention Is All You Need" implementation in Keras?

Has anyone seen this model's implementation using Keras? inb4: tensorflow, pytorch
3
votes
1answer
6k views

Problem with keras model loading

I want to use this keras seq2seq example to train my model. But i dont undestand role of encoder and decoder model and why we dont use model which we trained here. model.fit([encoder_input_data, ...
1
vote
0answers
115 views

Algorithm to parse PSD into html/XML?

I have been working on a project and we were trying to convert a PSD (Adobe Photoshop) file to a HTML for web applications as well as a Layout XML for android. We worked our way to generate basic ...
7
votes
1answer
2k views

What is the BLEU score used in Google Brain's "Attention Is All You Need" paper?

Google Brain's Attention Is All You Need paper on sequence-to-sequence translation reports: Our model achieves 28.4 BLEU on the WMT 2014 Englishto-German translation task, improving over the ...
1
vote
0answers
50 views

What does NIST information weights refer to?

NIST is a metric used to measure the goodness of translation. In the paper, Doddington (2002) introduce the notion of "Information weights" Information weights were computed using N-gram counts ...
1
vote
0answers
379 views

Hindi English Machine translation using OpenNMT

I am trying to perform machine translation using this. I am using this dataset for training. Result looks like this - ...
1
vote
1answer
2k views

Number of parameters in seq2seq model

I am trying to compute the total number of parameters in Ilya Sutskever's seq2seq model. In the paper, the authors mention a total number of 384M trainable parameters, or to be exact: The resulting ...
3
votes
1answer
2k views

Why does LSTM performs better when the source target is reversed? (Seq2seq)

I'm currently reading this paper : https://papers.nips.cc/paper/5346-sequence-to-sequence-learning-with-neural-networks.pdf Here, the author mentioned that LSTM learns better when the order of the ...
0
votes
1answer
57 views

What's the difference of Symbolic translation approach and statistical translation?

Based on what I know, symbolic computing is based on hard rules in the code. Statistical translation is based on statistic and probabilities. If so, could you give an easy to understand example to ...
3
votes
1answer
2k views

Tensorflow speech-to-text training on single file with tf.nn.ctc_loss not converging

I want to train speech-to-text model on tensorflow. Code at: https://github.com/bikramjitroy/speech-to-text/blob/master/TrainingUnitTest-CTCTrain.py A sample "audio.wav" and "label.txt" file also ...
3
votes
1answer
231 views

High Level Understanding of Neural Machine Translation

I am currently studying Deep Learning based Machine Translation systems but I'm not sure in my understanding the logic of the process. I understand that the source and destination language translation ...
3
votes
1answer
4k views

What is context window size?

I am trying to implement a recurrent neural network machine translation system, and I am just learning the things. I am creating a word embedding matrix. In order to do that, I should know my ...
8
votes
2answers
3k views

What's an LSTM-LM formulation?

I am reading this paper "Sequence to Sequence Learning with Neural Networks" http://papers.nips.cc/paper/5346-sequence-to-sequence-learning-with-neural-networks.pdf Under "2. The Model" it says: ...
2
votes
0answers
34 views

How to estimate the lambda e to reweighing translation probabilities of entries in a dictionary

In this paper, Brown et al. proposed the usage of dictionary entries in addition to the machine translation probabilities that we're used to in the Math of Statistical Machine Translation. He ...
1
vote
0answers
81 views

Minimum Error Rate Training using Powell Search for Machine Translation

From the tutorial slides: http://mt-class.org/jhu/slides/lecture-tuning.pdf, (slide 37) the powell search algorithm goes as such: ...
4
votes
2answers
293 views

How to get phrase tables from word alignments?

The output of my word alignment file looks as such: ...

1
2