user avatar
user avatar
user avatar
Jindřich
  • Member for 2 years, 11 months
  • Last seen this week
9 votes

Overfitting with text classification using Transformers

5 votes
Accepted

Does BERT use GLoVE?

3 votes

What is the advantage of positional encoding over one hot encoding in a transformer model?

3 votes

How are Q, K, and V Vectors Trained in a Transformer Self-Attention?

3 votes

Transformer seq2seq model and loading embeddings from XLM-RoBERTa

3 votes
Accepted

Transformer masking during training or inference?

3 votes

BERT vs GPT architectural, conceptual and implemetational differences

2 votes

SpaCy string store

2 votes
Accepted

Does BERT need supervised data only when fine-tuning?

2 votes
Accepted

What are the differences between bert embedding and flair embedding

2 votes

Smart sentence segmentation not splitting on abbreviations

2 votes

How to interpret the value of categorical cross entropy?

2 votes
Accepted

Attention mechanism in Tensorflow 2

2 votes

Transformer-based architectures for regression tasks

1 vote
Accepted

What are the merges and vocab files used for in BERT-based models?

1 vote

Next sentence prediction in RoBERTa

1 vote
Accepted

How to use unigram and bigram as an feature on SVM or logistic regression

1 vote

Is there any way to calculate a relevance score between a title and the content of a text?

1 vote
Accepted

How to understand Inconsistent and ambiguous dimensions of matrices used in the Attention layer?

1 vote

ELMo - How does the model transfer its learning/weights on new sentences

1 vote

Are there any objections to using the same (unlabelled) data for pre-training of a BERT-Based model and the downstream task?

1 vote

What are good toy problems for testing Transformer architectures?

1 vote

Splitting into multiple heads -- multihead self attention

1 vote

Getting sentence embeddings with sentence_transformers

1 vote
Accepted

How to support a dynamic shape input for tf.where()

1 vote

How to know the probability of correctness of a test data in a Binary Classifier

1 vote

What are the elements in a BERT word embedding?

1 vote
Accepted

Attention Mechanism: Why use context vector instead of attention weights?

1 vote
Accepted

How does Byte Pair Encoding work?

1 vote

I have a word2vec embedding - now what?