From the lab
Local AI for Chilean receipts and tax documents
IT Lab applies its own criteria to reading Chilean tax documents with local AI, so company data never leaves the organization.
Read article From the lab06 / 10 / 2026 · 7 minLocal AI reasoning on Chilean business cases
40 Chilean small-business cases scored with automatic controls: no model passes them all, and extra reasoning fixes only part of the failures.
Read article From the lab01 / 10 / 2026 · 7 minLocal AI for code: completing a base vs creating
On an existing base with marked gaps, three local models meet the criterion; creating from scratch, none. Paid models do.
Read article From the lab30 / 09 / 2026 · 7 minAgentic work with local AI: finishing the job
Three episodes with tools and actions: 5 of 14 models meet the criterion, the best is local, and the characteristic failure is not closing…
Read article From the lab29 / 09 / 2026 · 7 minVision: images and scanned documents
Five of six eligible models score 97 or higher in vision and two local ones reach 97. The limit is tiny or degraded text,…
Read article From the lab28 / 09 / 2026 · 7 minDocuments with local AI: extract yes, count no
In the IT Lab Bench, 12 of 14 models extract all 183 cells of a real document with no error; counting over what they…
Read article From the lab22 / 09 / 2026 · 7 minWhy AI benchmarks miss real work
High scores on HumanEval and BigCodeBench did not rank local models by usefulness; IT Lab therefore measures tasks completed without human intervention.
Read article From the lab17 / 09 / 2026 · 7 minHow IT Lab evaluates a local AI model
The IT Lab Bench measures real work with fixed automatic judges, gives each model its best configuration and publishes what it measures and why.
Read article