Transfer learning is the process of using knowledge gained from one task to improve the performance on another related task. In NLP, transfer learning can be used by using pre-trained word embeddings as a starting point for training models on different NLP tasks.