feat: attention layer for all hidden states (!11) · Merge requests · deep-learning-nlp / token-tricksters

fix(similarity/paragraph): concat embeddings and reduce the shape to hidden size to calculate the cosine similarity

Only merge after !10 (merged)

Edited Jun 30, 2023 by Lars Benedikt Kaesberg

feat: attention layer for all hidden states