Computing and the Linguistic Turn
Symbolic analysis and statistical analysis were both approaches codebreakers took in breaking Enigma.
The development of AI has also incorporated both approaches.
One historical question for AI is why the dominance of Symbolic AI from 1950 to 1990?
Note the development of AI out of the Dartmouth Workshop and especially the contributions of one of its attendees, Ray Solomonoff, to the statistical approach, an approach taken up by Marcus Hutter, a DeepMind researcher.
Note too that along with the difference between the symbolic and the statistical is the difference between language learning and computer vision.
The turn Richard Sutton takes is to push learning outside the context of language, which is to push computing beyond its linguistic turn.
~ * ~
The Bitter Lesson First
On Learning as Other than a Mimicry of Language
~ * ~
Tommy Flowers
Current State of AI Processing
High-Dimensional [Word] Prediction
~ * ~
Overview of Computing and the Linguistic Turn
History of Computing (Medium, Mazhar Hassan )
Historical Development of Computing Devices (CSULB)
Analytic Philosophy ~ The Linguistic Turn (Oxford, Timothy Williamson)
Symbolic AI (Deep Code AI, Frank Fisher)
Symbolic AI History (Wikipedia)
Symbolic AI and Statistical AI (ANU, Yoshihiro Maruyama)
Linguistics
Philosophy of Linguistics (Stanford)
Linguistic Turn
Linguistic Turn (Institute of Historical Research)
As Related to Analytic Philosophy
Philosophy of Language (Internet Encyclopedia of Philosophy)
The Linguist Turn from Idealism (MIT)
Logical Positivism, Analytic Philosophy, Inferentialism, and Computing
Philosophy and Computer Science
On Logical Positivism (Wikipedia)
On Logical Positivism (Stanford)
Computing and Logical Positivism (The Philosophy Forum)
On Computational Positivism (Realizable)
From Logical Positivism to Analytic Philosophy
On Analytic Philosophy (The Ideas Letter)
On Analytic Philosophy (Internet Encyclopedia of Philosophy)
The Philosophy of Computer Science (Stanford)
Techne and Programming as Analytic Philosophy (TEGG)
Computing is Applied Analytic Philosophy (Y Combinator)
From Analytic Philosophy to Video Games (Columbia Spectator)
Inferentialism (University of St Andrews)
Inferentialism (Mapping Ignorance)
Between Inferentialism and LLMs (arxiv)
Philosophers, Linguists, Mathematicians, and Computer Scientists
On Philosophy, Math, and Computing
Frege
Frege: Philosophy of Language (Wikipedia)
Russell
Wittgenstein
Hayek
Whorf
Von Neumann
Harris
Austin
Turing
Lambek
Chomsky
Rorty
Hinton
Brandom
Manning
...
The Rationalistic Detour for AI
Rationalism ~ Symbolism as a Linguistic Turn
History of Early AI (Sil Hamilton)
Chomsky and McCarthy (VTechWorks, J.A.N. Lee)
Biolinguistic Turn (Berkeley, Chomsky)
Language Design for AI (StackExchange)
Linguistics and Lambek
The Mathematical Structure of Language (CMU)
...
Linguistics and Chomsky
Linguistics in the Electronics Lab at MIT (MIT)
Fundamental Issues in Linguistics (MIT)
Transformational Grammar (Wikipedia)
Against Universal Grammar (Reddit)
Chomsky's Theory (Structural Learning)
...
Computing and Chomsky
Parser Grammars (Stack Exchange)
...
On Codebreaking
Linguists or Mathematicians (BBC)
Codebreaking (The British Academy)
...
Computing
Symbolic ~ Statistical (SmythOS.com)
A Turing Program for Linguistics
NLP and Data (Sigma Computing)
Inferentialism and LLMs (arxiv)
...
Beyond the Linguistic Turn
From the Linguistic Turn to Information Theory (mpdi.com)
Unseen Syntax (cybernative.ai)
The Linguistic Turned (Larval Subjects)
...
Extending the Linguistic Turn to Biolinguistics and Brain Modeling
The Biolinguistic Turn (Psychology Today)
Computational Brain Modeling (NIH)
Computational Modeling (Brain Map)
Computational Modeling (YouTube)
...
From Symbolic Learning to Natural Language Processing
The Unnatural in Natural Language Processing
...
Computational Linguistics
Computational Linguistics (Stanford)
Computational Philosophy (Stanford)
Computational Linguistics (University of Maryland)
...
The Need for Interpretability
LLM Interpretability In Depth (ILLC)
...
Between the Linguistic Turn (Symbolic Computing) and Statistical Reasoning
Symbolic AI Versus Statistical AI (SmythOS.com)
...
On Meaning
Whence Meaning (Medium, Science Spectrum)?
...
~~~
...
On Computer Vision
On Language Models and Computer Vision
Computer Vision versus Natural Language Processing
Large Language Models versus Computer Vision
...
~~~
Comments
Post a Comment