Editing Nlp (section)

== <span style="color: #FFFFFF;">Understanding</span> ==
NLP's fundamental challenge is the '''ambiguity''' of language. The same sentence can mean different things in different contexts ("I saw her duck" — did someone see a person bend down, or see her waterfowl?). Humans resolve this using world knowledge, context, and pragmatics. Teaching machines to do the same is the core problem.

The evolution of NLP mirrors advances in representation learning:

'''Rule-based systems''' (1950s–1980s): Hand-crafted grammars and lexicons. Brittle, but interpretable.

'''Statistical NLP''' (1990s–2000s): Probabilistic models like Hidden Markov Models and n-gram language models. Better generalization, but still limited by sparse data.

'''Word embeddings''' (2013+): Word2Vec and GloVe showed that words with similar meanings cluster together in vector space. "King − Man + Woman ≈ Queen" is the famous demonstration of captured relational semantics.

'''Sequence-to-sequence with attention''' (2014–2017): Encoder-decoder architectures with attention mechanisms enabled machine translation breakthroughs. Attention allows the model to "look back" at relevant parts of the input when generating each output token.

'''Transformer era''' (2017+): The "Attention Is All You Need" paper replaced recurrence entirely with self-attention, enabling massively parallel training. BERT (encoder-only) enabled classification tasks; GPT (decoder-only) enabled generation. Models scaled from millions to hundreds of billions of parameters.

A key insight: language modeling — predicting the next word — is an extraordinarily rich self-supervised task that forces models to learn syntax, semantics, facts, and reasoning as a byproduct.
</div>

<div style="background-color: #8B0000; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">