Darren Cook

Member for 8 years, 4 months
Last seen this week

Summary

Reputation

977

977
539
101

2020
2021
2022
2023

Top tag

machine-learning

Next privilege

1,000 Rep.

Edit posts

Badges

5

12

Newest

Yearling

Next badge

0/1

Custodian

Answers

View all 42 answers

Score Activity Newest

8

Transformer model: Why are word embeddings scaled before adding positional encodings?

Jan 18, 2021

8

Why deep learning models still use RELU instead of SELU, as their activation function?

Oct 5, 2021

4

Does multi-head attention remove the need for self-attention?

Apr 12, 2021

3

Can we fine-tune a model on the same dataset which it is pretrained on?

Apr 19, 2021

3

Choosing best model produced from different algorithms. Metric produced by cross-validation on the train set or metric produced on the test set?

Feb 15, 2021

Questions

Score Activity Newest Views

2

How exactly have T5 3B and 11B models been scaled?

Oct 10, 2022

0

What does the random seed influence in transformers?

Dec 29, 2022

0

How quickly can a transformer self-heal if you wipe out one of its layers?

Jul 21

Tags

View all 65 tags

machine-learning

23

Score

15

posts

deep-learning

20

Score

11

posts

transformer

18

Score

11

posts

attention-mechanism

18

Score

5

posts

nlp

13

Score

10

posts

Reputation

+10

What does it mean order of input sequence does not matter for transformer self-attention head?

+10

Why do the performance of DL models increase with the volume of data while that of ML models will flat out or even decrease?

+10

Why deep learning models still use RELU instead of SELU, as their activation function?

+10

torch cuda not able to identify gpu on aws g4dn.xlarge

Badges

View all badges

This user doesn’t have any gold badges yet.

5

silver badges

Constituent

Jun 27, 2022
Yearling

× 4

Mar 22

12

bronze badges

Tag Editor

Feb 25, 2021
Quorum

Aug 6, 2021
Caucus

Jun 14, 2022

Accounts

View all 46 accounts

27.9k
13
118
219

Cross Validated

2,097
1
14
26

Quantitative Finance

1,427
1
17
26

994
2
9
19

977
5
12

Active bounties (0)

Active Offered Earned

This user has no active bounties

Votes cast

133

upvotes

2

downvotes

68

question votes

67

answer votes