Questions tagged [fasttext]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
28 views

How do I continue train fasttext pretrained model? [closed]

I use native fasttext library for message classification. I want to train the model on new data in case the dataset changes without using the old data, keeping the previous result. In my project user ...
user avatar
0 votes
0 answers
22 views

DBSCAN getting one huge cluster with noisy points

I'm currently trying to cluster customer service email answers (NLP). When I use DBSCAN with TF-IDF embeddings + Annoy indexes, I get good clusters. But, when I use DBSCAN with FastText embeddings + ...
user avatar
1 vote
0 answers
52 views

Should I use Pad Sequence when using Word Vectors?

I have an unbalanced text data set. I want to use word vectors to embed words. When I use pad sequence? Before or after the word vector? I tried it, after the word vector I used pad sequence but my ...
user avatar
  • 13
0 votes
0 answers
39 views

Training fasttext on your own corpus

I want to train fasttext on my own corpus. However, I have a small question before continuing. Do I need each sentences as a different item in corpus or can I have many sentences as one item? For ...
user avatar
  • 103
0 votes
0 answers
12 views

How can I use Ensemble learning of two models with different features as an input?

I have a fake news detection problem and it predicts the binary labels "1"&"0" by vectorizing the 'tweet' column, I use three different models for detection but I want to use ...
user avatar
0 votes
0 answers
67 views

Gensim fast text get vocab or word index

Trying to use gensim's fasttext, testing the sample code from gensim with a small change of replacing the arguement to ...
user avatar
0 votes
1 answer
17 views

Data Set and guidance for Occupations/ Roles classification problem

I am working on a project where I need to find similar roles -- for example, Software Engineer, Soft. Engineer , Software Eng ( all should be marked similar) Currently, I have tried using the Standard ...
user avatar
0 votes
0 answers
52 views

Genesis most_similar find synonym only (not antonyms)

Is there a way to let model.wv.most_similar in gensim return positive-meaning words only (i.e. that shows synonyms but not antonyms)? For example, if I do: ...
user avatar
1 vote
0 answers
21 views

When are subword ngrams trained in fasttext? (Enriching Word Vectors with Subword Information)

when is the training for subword ngrams done? is it done simultaneously as when the word representation are trained? or is it done at the end, after word representations are created? fasttext ...
user avatar
  • 617
1 vote
1 answer
155 views

Pre-trained models for finding similar word n-grams

Are there any pre-trained models for finding similar word n-grams, where n>1? FastText, for instance, seems to work only on unigrams: ...
user avatar
  • 645
1 vote
1 answer
47 views

Initializing weights that are a pointwise product of multiple variables

In two-layer perceptrons that slide across words of text, such as word2vec and fastText, hidden layer heights may be a product of two random variables such as positional embeddings and word embeddings ...
user avatar
  • 111
0 votes
1 answer
84 views

Keep word2vexc/fasttext model loaded in memory without using API

I have to use Fasttext model to return word embeddings. In test I was calling it through API. Since there are too many words to compute embeddings, API call seems to be expensive. I would like to use ...
user avatar
  • 141
2 votes
0 answers
408 views

Explain FastText model using SHAP values

I have trained fastText model and some fully connected network build on its embeddings. I figured out how to use Lime on it: complete example can be found in Natural Language Processing Is Fun Part 3: ...
user avatar
1 vote
0 answers
366 views

Extracting vectors of FastText own model to use it on a NN

I have trained my own model of fasttext using the pretrained model of English available on their website with the next code: ...
user avatar
  • 111
3 votes
1 answer
235 views

FastText Model Explained

I was reading the FastText paper and I have a few questions about the model used for classification. Since I am not from NLP background, some I am unfamiliar with the jargon. In the figure, what ...
user avatar
1 vote
0 answers
133 views

Removing duplicate records before training

I am currently working on a project classifying text into classes. The specific problem is classifying job titles into various industry codes. For example "McDonalds Employee" might get classified to ...
user avatar
  • 327