| BERT |
BERT (Bidirectional Encoder Representations from Transformers) is a pre-trained transformer-based neural network model for natural language processing (NLP) tasks |
NLP tasks such as sentiment analysis, question answering, and named entity recognition |
Google Search, Google Translate, and many NLP tasks in various industries |
| NLP |
NLP (Natural Language Processing) is a field of artificial intelligence that deals with the interaction between computers and human language |
Tasks such as text classification, language translation, and sentiment analysis |
Google Translate, Siri, Alexa |
| GPT |
GPT (Generative Pretrained Transformer) is a transformer-based neural network language model that can generate text based on a given prompt or condition |
Text generation, language translation, and sentiment analysis |
OpenAI’s GPT-3 language model, language-based chatbots |
| Transformer |
A type of neural network architecture designed for processing sequences of data, such as sequences of words in NLP |
Sequence processing tasks such as language translation, sentiment analysis, and text generation |
Google’s Transformer-based neural machine translation system, BERT and GPT models |
| Word Embeddings |
A technique in NLP where words are represented as dense vectors of numbers, allowing the capture of semantic relationships between words |
Tasks such as text classification, language translation, and sentiment analysis |
Word2Vec and GloVe, popular word embedding techniques in NLP |