Skip to content

The Stack v3 expands code dataset to 5 trillion tokens

A post published on July 23, 2026 presents an open dataset with about 5 trillion deduplicated and filtered code tokens across 713 languages, excluding code with restrictive licenses.

By Wendelmaques ·

Source: The Stack v3 lança 5T tokens de código deduplicados (x.com). Text prepared with AI from this source.

What happened and what to do

The post about The Stack v3, published on July 23, 2026, presents an open dataset with about 5 trillion deduplicated and filtered source-code tokens across 713 languages. According to the post, the dataset excludes code with restrictive licenses. Engineers training code models can assess this broader language coverage for their experiments.

A company evaluating or training models can implement a process to review the dataset and its inclusion criteria, and monitor language composition and experiment results. Before using the data, it can also establish internal controls for licensing, traceability, and quality validation, without assuming that filtering replaces legal review.

How the consultancy can help

Wendelmaques can diagnose the opportunity and risks of using the dataset, scope licensing, ingestion, and monitoring controls, and implement the solution on the company’s infrastructure. Ongoing operation can also be included in the scope.

Next step

Send a short description of your case — such as evaluating or training code models — to receive a scoped proposal.

Looking for something else?Frequently asked questionsArticlesContact