Skip to content

How LLMs represent sums and arithmetic errors

An article published on June 28, 2026, analyzes internal representations during sums with multiple operands and proposes a geometric model to explain arithmetic errors.

By Wendelmaques ·

Source: Estruturas Geométricas por Trás da Aritmética em LLMs (arxiv.org). Text prepared with AI from this source.

What happened and what to do

Published on June 28, 2026, the article analyzes LLM residual-stream representations during sums with multiple operands. It identifies the Iso-Raw-Sum Trajectory, in which semantic digits anchor representations while continuous carry fibers modulate them, and proposes the Noisy Quantization Model to explain arithmetic errors.

A company using models for calculations can implement systematic tests with multi-operand cases, monitor accuracy by operation type, and route critical calculations through deterministic validation. This analysis can also inform evaluation criteria before these applications enter production.

How the consultancy can help

Wendelmaques can diagnose arithmetic risks in the company’s workflows, define tests and monitoring metrics, and implement a validation and operations solution suited to the client’s infrastructure.

Next step

Send a short description of your use case to receive a proposal scoped for diagnosis and implementation.

Looking for something else?Frequently asked questionsArticlesContact