AQITMechanistic interpretability tooling that runs on a local GPU

Reverse engineering intelligence with interpretability.

at Aquin Labs, We're reverse engineering and interpreting to help build better ML across foundation models for physics, life sciences, industrial, scientific discovery, clinical, and safety-critical.

Backed by
awesome programs.

Emergent Ventures
Founders Inc
The Residency
NVIDIA Inception
Emergent Ventures
Founders Inc
The Residency
NVIDIA Inception

AQIT (Aquin Interpretability Tooling)

aquinf03/AQITdocsapplied researchWe built mechanistic interpretability tooling that runs on a local GPU. Load an LLM or embedding model, then inspect, simulate a train, diff checkpoints, steer, watch a live run, and eval. SAE capture, train, and align; weight and residue diffs; red-team and custom evals.

IDE for Machine Learning

A workspace for training and reading models on a GPU you control, with the same precision as writing code. Load an LLM or embedding model, then inspect, simulate, compare checkpoints, and eval as the run unfolds.

Inspect pythia-70m layer 12 residual. Plot attention with viridis, origin lower.
Used 2 toolsinspect_residualplt.imshow

Layer 12 residual

Loaded pythia-70m and pulled the residual at layer 12. The map is viridis, origin lower.

  • Head 3 and 7 are the bright sinks.
plt.imshow · viridis · origin=lower
Send follow-up
llama 3.2 1bterminal 112%
ashm@Ashs-MacBook-Air nns %
$ aqit load pythia-70m
loading weights … ok
device  mps  layers=12  d_model=512

$ aqit inspect --layer 12
residual  [seq=48, 512]
F4412  0.84  european capitals
F118   0.61  proper nouns
F902   0.44  country names

$ python scripts/plot_attn.py
imshow  cmap=viridis  origin=lower
wrote figs/attn_l12.png

ashm@Ashs-MacBook-Air nns % 

develop + research with precision

build models with same precision as writing code.

build models with intent by locating, debugging, simulating and improving.

build transformers & llms

simulate lora


Work with us

Interpretability tooling, custom SAE databases, mechanistic audits, circuit reports, and hands-on research, experiments, and studies for teams of all sizes. Reach us at aquin@aquin.app

Not sure if Aquin is right for you?