Questions tagged [fasttext]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
0 answers
28 views

How does FastText create n-gram word features?

In the paper Bag of Tricks for Efficient Text Classification they talk about creating n-gram (word) features, and in their experiments they show results for both 1-gram and bi-gram. As far as I ...
CutePoison's user avatar
0 votes
0 answers
178 views

Finetuning fasttext with unlabeled text corpus

I am training a classifier which is supposed to take the name of a product as input. For this purpose I want to finetune a pre-existing fasttext model on my article names. My code looks like this <...
christallclear's user avatar
0 votes
0 answers
30 views

Encountered a problem while installing [ FastText ] library on MacOS

I have been trying to install the "FastText" library on macOS but I keep encountering a Runtime error. ...
Mira's user avatar
  • 1
1 vote
1 answer
438 views

How to fine-tune hyperameters of unsupervised training in fasttext?

I want train fasttext unsupervised model on my text dataset. However there are many hyperparameters in train_unsupervised method: ...
Ir8_mind's user avatar
  • 183
0 votes
1 answer
222 views

Is it normal for a model to perform worse with the use of word embeddings?

I have a multiclass text classification problem and I've tried different solutions and models, but I was not satisfied with the results. So I've decided to use GloVe ( Global Vectors for Word ...
HasanArcas's user avatar
1 vote
0 answers
176 views

Should I use Pad Sequence when using Word Vectors?

I have an unbalanced text data set. I want to use word vectors to embed words. When I use pad sequence? Before or after the word vector? I tried it, after the word vector I used pad sequence but my ...
grace's user avatar
  • 13
0 votes
1 answer
206 views

Training fasttext on your own corpus

I want to train fasttext on my own corpus. However, I have a small question before continuing. Do I need each sentences as a different item in corpus or can I have many sentences as one item? For ...
BlueMango's user avatar
  • 113
0 votes
1 answer
22 views

Data Set and guidance for Occupations/ Roles classification problem

I am working on a project where I need to find similar roles -- for example, Software Engineer, Soft. Engineer , Software Eng ( all should be marked similar) Currently, I have tried using the Standard ...
rspenpal's user avatar
1 vote
0 answers
42 views

When are subword ngrams trained in fasttext? (Enriching Word Vectors with Subword Information)

when is the training for subword ngrams done? is it done simultaneously as when the word representation are trained? or is it done at the end, after word representations are created? fasttext ...
Sid's user avatar
  • 667
1 vote
1 answer
336 views

Pre-trained models for finding similar word n-grams

Are there any pre-trained models for finding similar word n-grams, where n>1? FastText, for instance, seems to work only on unigrams: ...
dzieciou's user avatar
  • 697
1 vote
1 answer
73 views

Initializing weights that are a pointwise product of multiple variables

In two-layer perceptrons that slide across words of text, such as word2vec and fastText, hidden layer heights may be a product of two random variables such as positional embeddings and word embeddings ...
Witiko's user avatar
  • 111
3 votes
0 answers
635 views

Explain FastText model using SHAP values

I have trained fastText model and some fully connected network build on its embeddings. I figured out how to use Lime on it: complete example can be found in Natural Language Processing Is Fun Part 3: ...
Mikhail_Sam's user avatar
1 vote
0 answers
574 views

Extracting vectors of FastText own model to use it on a NN

I have trained my own model of fasttext using the pretrained model of English available on their website with the next code: ...
IMB's user avatar
  • 111
3 votes
1 answer
332 views

FastText Model Explained

I was reading the FastText paper and I have a few questions about the model used for classification. Since I am not from NLP background, some I am unfamiliar with the jargon. In the figure, what ...
Black Jack 21's user avatar
1 vote
0 answers
363 views

Removing duplicate records before training

I am currently working on a project classifying text into classes. The specific problem is classifying job titles into various industry codes. For example "McDonalds Employee" might get classified to ...
astel's user avatar
  • 347