In the paper of Universal Sentence Encoder (USE), the author mentions it to be trained using transfer learning in an unsupervised manner in two forms:
1. Using Deep Averaging Network (DAN)
2. Using Transformers
I am confused how the USE is trained using DAN since DAN is trained in a supervised setting. It will great if someone can explain the training process.