Collocation - AI
AI ohn Rupert Firth , a leading British linguist of the mid-20th century, is famously remembered for his aphorism: "You shall know a word by the company it keeps." While he died long before the advent of modern computation, his theories on Firthian Linguistics laid the structural and philosophical foundation for Natural Language Processing (NLP), statistical inference in language, and today's Large Language Models (LLMs) like GPT-4 . Here is how Firth's ideas directly map to modern AI architecture and statistical NLP. 1. Collocation and the Birth of NLP Firth pioneered the concept of collocation , which describes the tendency of certain words to occur together with higher-than-random frequency (e.g., "heavy rain" vs. "strong rain"). The Shift in Linguistics: Before Firth, linguistics heavily favored syntactic rules (Noam Chomsky’s view that language is governed by rigid, innate mental rules) or etymology (historical word origins). Firth argued...