Key-Value Attention

Home > Computer Science > Natural Language Processing > Attention Mechanisms > Key-Value Attention

Key-value attention is a type of attention mechanism that is commonly used in neural machine translation. It works by using the keys and values of the input sequence to generate a weighted representation.