October 7, 2026 · arxiv.org
ReContext: improving evidence use in long contexts
Published on July 6, 2026, the ReContext paper reports improved evidence use across eight 128K datasets, with three model backbones and no training.
AI and infrastructure news
Each item sums up the news and what a company can do.
Recent news
October 7, 2026 · arxiv.org
Red Queen Gödel Machine coevolves agents and evaluators
A paper published June 29, 2026 describes a method that evolves agents and evaluators, keeping evaluators fixed per epoch and replacing them only after better performance on reserved ground truth.
October 7, 2026 · t.co
Physical network learns without a digital model
A Nature Communications paper published on June 24, 2026 describes a physical neural network with four programmable metasurfaces that learns through electromagnetic interactions.
October 7, 2026 · accu.org
Using C++26 Reflection to Print Class Members
On June 18, 2026, an article by Lieven de Cock demonstrates using C++26 reflection to inspect class members and print their information.
October 7, 2026 · godbolt.org
C++ reflection can modify private data
An example published by Compiler Explorer on July 23, 2026, uses reflection with an unchecked access context to increment every non-static data member of Foo, including its private field secret.
October 7, 2026 · fa.bianp.net
REINFORCE: policy gradients and variance
A post published on July 12, 2026 derives the REINFORCE estimator without differentiating through the environment and analyzes how variance depends on trajectory length.
October 7, 2026 · arxiv.org
Rejection sampling for on-policy LLM alignment
A paper published on July 7, 2026 proposes using rejection sampling to treat accepted off-policy tokens as on-policy and address the variance of accumulated per-token importance sampling ratios.
October 7, 2026 · github.com
ARM repository offers 29 techniques for exploitation practice
Updated on June 28, 2026, the exploit_me repository provides a vulnerable ARM/AARCH64 application with 29 vulnerability techniques and obvious symbols removed for LLM fine-tuning experiments.
October 7, 2026 · github.com
auto-gpu-kernel 1.0 repository generates GPU kernels and harnesses
Published on September 15, 2026, the repository presents a system that evolves GPU kernels and harnesses and won the DSA category of an MLSys 2026 FlashInfer contest.
October 7, 2026 · proceedings.iclr.cc
RESA: recovering context with sparse attention
Published on September 29, 2026, the RESA paper proposes using residual estimation to recover context ignored by sparse attention, with no additional computational cost, according to the paper.
October 7, 2026 · arxiv.org
ResidencyRL explores clinical training through simulated consultations
Published on August 10, 2026, the article describes reinforcement learning in simulated clinical environments to train reasoning beyond static medical benchmarks.
October 7, 2026 · x.com
Token retention may reduce reliance on the KV cache
A publication dated September 13, 2026, claims that keeping four initial tokens and a 64-token window without training matches or exceeds distilled linear-attention models on nearly all benchmarks.
October 7, 2026 · arxiv.org
RetNet proposes recurrence as an alternative to attention
Published on September 24, 2026, the Retentive Network paper presents a language-model architecture that combines parallel training with recurrent inference.
October 7, 2026 · arxiv.org
In-context retrieval: study tests scale up to one million tokens
A paper published on July 6, 2026, examines language models as retrievers over one-million-token corpora. Its 0.6-billion-parameter BlockSearch generalizes up to 10 times beyond its training length, according to the study.
October 7, 2026 · blog.google
Multimodal retrieval with embeddings in a shared space
In a post published on October 6, 2026, Google says EmbeddingGemma 2 represents text, code, images, video, and audio in a shared vector space and uses the Apache 2.0 license.
October 7, 2026 · github.com
Reversecore_MCP connects AI agents to reverse engineering
The GitHub repository describes an MCP server for AI agents that integrates binary-analysis tools and lists uses in reverse engineering, malware analysis, forensics, vulnerability research, and SAST.
October 7, 2026 · github.com
Ridgeline: profiling LLM inference with the roofline model
Published on July 8, 2026, the text describes Ridgeline, a PyTorch-based profiler that applies the roofline model to analyze LLM inference workloads.
October 7, 2026 · riotgames.com
Riot announces on-demand Vanguard operation
In a post published on June 24, 2026, Riot announced that Vanguard can run only during gameplay when specified device security features are enabled.
October 7, 2026 · github.com
ripwire structures repository context for coding agents
Published on September 6, 2026, ripwire is a CLI and MCP server that analyzes 21 languages and returns relevant symbols, relationships, and tests in a token-limited response.
October 7, 2026 · zhihu.com
Long-horizon RL may favor PPO
A Zhihu post published on June 24, 2026, argues that long, noisy agentic rollouts may make credit assignment harder for GRPO and make PPO's value model useful.
October 7, 2026 · alignment.openai.com
RL for beneficial behavior across domains
In a post published on June 18, 2026, OpenAI reports that behavior-focused reinforcement learning improved alignment across domains and resisted adversarial pressure.
October 7, 2026 · x.com
Post-training RL with fewer parameters changed
A post published on July 5, 2026 describes an approach that reinforces high-contribution intermediate layers during post-training RL. It may match or outperform RL across all parameters while changing fewer parameters.
October 7, 2026 · arxiv.org
RLSD adjusts RLVR updates at the token level
A paper published on July 11, 2026 presents a training method that combines environmental rewards with self-distillation. Across five multimodal reasoning benchmarks, it reports higher average accuracy than the base model and GRPO.
October 7, 2026 · arxiv.org
RoLA proposes low-rank linear attention for Diffusion Transformers
Published on September 15, 2026, the paper presents RoLA, a method combining low-rank linear attention and rotary position encoding to address scaling bottlenecks in Diffusion Transformers.
October 7, 2026 · x.com
RubricEM uses step-by-step criteria to train research agents
Published on July 5, 2026, the work describes agents that create evaluation criteria before researching and reuse lessons from assessed attempts.
October 7, 2026 · github.com
RULER turns agent evaluations into rewards for GRPO
A September 17, 2026 post from OpenPipe ART describes how LLM-ranked agent trajectories can produce rewards for agent training.
October 7, 2026 · github.com
RVC WebUI: local voice conversion with data
A repository published on September 15, 2026 describes a web interface for training voice-conversion models, including with 10 minutes or less of voice data.
October 7, 2026 · arxiv.org
RWKV combines parallel training with recurrent inference
An article published on September 20, 2026 describes an architecture combining Transformer-style parallel training with RNN-style recurrent inference, with memory and computation scaling linearly with sequence length.
October 7, 2026 · x.com
Safety tuning may affect models’ attribution of minds
A study reports that tuning to prevent consciousness claims also reduces the attribution of minds to other entities in three models, and that mechanistic interventions restore these tendencies.
October 7, 2026 · x.com
Sampling for SFT: evaluating post-training
A post published on October 2, 2026 presents a method that adds sampling to the post-training stack and claims it may improve generalization and reduce forgetting in some cases.
October 7, 2026 · arxiv.org
Elastic sandboxes for training and evaluating agents
Published on September 23, 2026, the article describes stateful, elastic execution environments for large-scale agent training and evaluation, as well as defenses against agents exploiting training environments.
October 7, 2026 · x.com
Sandbox infrastructure: a scale reference
A publication dated September 22, 2026 reports that a production-scale compute unit spans about 160 nodes and supports more than 380,000 concurrent sandboxes.
October 7, 2026 · arxiv.org
SearchEyes connects simulated worlds to agent training
The SearchEyes paper describes a simulated search world built on a typed knowledge graph for training multimodal agents. Published on July 8, 2026, it addresses gaps among training data, search environments, and reward signals in multi-hop reasoning.
October 7, 2026 · alphaxiv.org
Sparse attention block selection reduced to O(N log N)
A paper published on September 28, 2026 presents hierarchical block selection with LogSumExp, reducing the cost of this step from O(N²) to O(N log N) for long-context models.
October 7, 2026 · arxiv.org
On-Policy Self-Distillation for Reasoning in LLMs
A paper dated September 28, 2026 describes a training method that combines trajectories generated by the student with dense teacher supervision at each token.
October 7, 2026 · alphaxiv.org
Self-play for pretraining models without natural data
A paper published on September 26, 2026 examines pretraining with program-generated byte sequences and reports transfer to unseen modalities and tasks.
October 7, 2026 · x.com
Data-free self-play: how to evaluate the approach
A paper dated September 25, 2026 explores self-play pretraining without real data and reports predictable reductions in zero-shot validation loss across several modalities.
October 7, 2026 · github.com
Semantica: knowledge graphs and agent decision traces
On August 8, 2026, the publication about the open-source Semantica project describes self-hosted infrastructure for turning data into knowledge graphs and recording agent decisions.
October 7, 2026 · x.com
Agent serving: measure bottlenecks beyond inference
A paper published on August 21, 2026 presents AgentSysBench, covering 10 agentic applications, and reports that inference is not always the main serving bottleneck.
October 7, 2026 · arxiv.org
LLM serving: cache and balancing after a year in production
A paper published on August 21, 2026 analyzes a year of production LLM traffic and examines prefix reuse, KV cache locality, and load balancing.
Let's assess your project
I reply with scope and a proposal.