Transformer

Home > Computer Science > Natural Language Processing > Word Embeddings > Transformer

It is a neural network-based architecture that uses an attention mechanism to compute the word embeddings. It generates contextualized embeddings by considering the words' relationships with other words in the context.