Information Entropy

By

Entropies

Information Entropy

Entropy Information

Brown–Voiculescu Entropy

Your Noise Is My Signal


Cohomology

Information Cohomology

Information Cohomology and Entropy


Parallel Considerations

Symmetries and Confinement

Near Coincidence

Comments

Post a Comment

Popular posts from this blog

Computing and the Linguistic Turn

By
Image
Enigma (Wikipedia) Symbolic analysis and statistical analysis were both approaches codebreakers took in breaking Enigma. The development of AI has also incorporated both approaches. One historical question for AI is why the dominance of Symbolic AI, associated here with the linguistic turn, from 1950 to 1990? Note the development of AI out of the Dartmouth Workshop and especially the contributions of one of its attendees,  Ray Solomonoff , to the statistical approach, an approach taken up by Marcus Hutter , a DeepMind  researcher, and of course, others. Note that a history of AI outside the linguistic turn from Moritz Hardt and Ben Recht is in Patterns, Predictions, and Actions . And note too that along with the difference between the symbolic and the statistical is the difference between language learning and computer vision, which tends to be a history outside the linguistic turn. And the turn Richard Sutton takes is to push learning outside the context of language, which ...
Read more

How Does AI Solve Erdős Problems? - AI

By
Image
Erd ő s Problems List of Conjectures Erd ő s Problems On ChatGPT as Solver On Liam Price Terence Tao Tao AI AI solves Erdős problems through a combination of Large Language Models (LLMs) for generating creative proofs and formal verification tools like Lean 4 to ensure mathematical correctness . [ 1 , 2 , 3 ] Recent breakthroughs, such as the resolution of Erdős Problem #728 and #1196 , have used specialized workflows where AI acts as a "junior co-author" to discover novel connections that human mathematicians had previously overlooked. [ 1 , 2 , 3 , 4 , 5 ] The Core Solving Process Solving these open conjectures typically involves a "loop" between a reasoning model and a formal verifier: Creative Brainstorming : A model (like GPT-5.2 or GPT-5.4) is prompted to research the problem and brainstorm novel mathematical strategies. Generating informal Proofs : The AI writes a mathematical paper in LaTeX, often discovering "elegant" methods, such as using th...
Read more

AI as the Ghost of Christmas Future

By
AI Safety in the Metanarrative A Mythography The Industrial Age (19th Century) largely ushered in an optimism regarding technological progress, but with that optimism also came the critics.  Take the work of Nathaniel Hawthorne, for example. Better yet, take the work of Mary Shelley. Note that her Frankenstein is nearby on the timeline to the work of Charles Babbage and to the work of Ada Byron Lovelace .  And though Frankenstein is, in part,  about reanimation, it is also about the creation of intelligent being. So, we see that, historically, a narrative surrounding computing comes into being along another narrative, Frankenstein's monster, and we see these two narratives coupled now in much of the narrative around AI Safety. But my point here is not that we need to decouple the stories regarding the monstrous  ("War Games", "Sneakers", "Goldeneye", ...) so much as we need to re-assess the goals that are embedded in the narrative.  With what we know n...
Read more