Research and engineering

An agent you let into your Mac should be measured on what people actually ask of it, scored by what it actually changed, and honest about what it still gets wrong. Here is how we build Brello for Mac, with the numbers.

Brello is an agent that changes real things on your Mac: it moves files, writes documents, changes settings and deletes what you tell it to. A chat app can be judged by how its answers read. An agent has to be judged by the state it leaves behind: which files moved, what was deleted, whether a setting really changed, and whether Undo put everything back. Every post here starts from that.

Three ideas run through all of it. Code first, model second: what code can read whole, such as a date, an app’s name, a setting or a folder, code decides, and Apple’s on-device model is asked only for language. Private by construction: one module may reach the network, a test reads every source file on every build to keep it that way, and every request is written down before it leaves. Ask first, then Undo: risk is decided by code, not by a model’s account of itself, and every change Brello PI makes can be reversed.

The numbers on these pages come from the product itself, played end to end on made-up Macs and on a same-shape copy of a lived-in one, never from a benchmark the product doesn’t run. Where something failed, the post says so and says what changed.

Start here

The system card is the one page to read if you read only one: what Brello for Mac does and doesn’t do, the evaluations it was held to, its known limits and what it never does with nobody at the Mac. How we test Brello explains the four layers of testing behind every number on this site.

Research: measured on real requests

What people type to an agent on their first day, how dates and money are read the way each region writes them, and how every change is undone. Each post names the suite it was measured with, how many cases, and what the first run got wrong.

Engineering: how it’s built

How a Mac app earns its place on a Mac: a Finder that finds files by what you remember, settings changed and read back from macOS, one click that balances the load across the processor’s cores, a health page that stopped being the busiest thing on the Mac, and the small fixes that make it feel native. Each post shows the measurement before and after.

Questions about a post, or a result you can’t reproduce? Write to hey@brello.ai. For what leaves your Mac and how to check it yourself, see the trust center.