aqDeveloper environment for foundation models

Environments, libraries and frameworks for applied ML and foundation models.

We're an AI research lab for applied ML and foundation models. We reverse engineer, interpret and build environments, libraries and frameworks. Our dream is to accelerate ML development with precision and intent for all, enabling safer and better ML across physics, life sciences, industrial, frontier and critical verticals.

Backed by
awesome programs.

Emergent Ventures
Founders Inc
The Residency
NVIDIA Inception
Emergent Ventures
Founders Inc
The Residency
NVIDIA Inception

Our work

1/

We're heading towards a future where foundation models play a significant role across physics, life sciences, industrial, and frontier verticals, and it's critical we find ways to develop and train them better and safer. We're building aq, developer environment for foundation models built with frameworks, libraries, tools and autonomous agents helping design, test, and refine models. aq is built for precision and intent. Think Next.js for JS, but for ML, handling architectural, experiments, and building AI the way it should be built, deliberately, not by guessing.

transformers

lora

curl -fsSL https://aq.aquin.app/framework/install.sh | bash

2/

Fine-tunes fail in ways a loss curve does not explain. AQIT is Aquin Interp Tooling: an open-source CLI and Python SDK to declare a recipe, train, gate, inspect, and patch on your own GPU, with results staying local. Same objects in both surfaces. Dense transformers, MoE, and embeddings. Attribution, sparse autoencoders, simulation, live training watch, evals, and benchmarks, so you can see why a run failed and fix it without guessing.

3/

We work with frontier labs, research groups, universities, and companies training their own models, from classical ML to foundation models and everything in between.

LAION

Building an interpretable VLM that maps text and vision towers on top of OpenCLIP.

KAIST

Using interpretability tooling for preference detection analysis in LLMs.

AEIA Lab

Training SAEs on a LLM to sense conflict, ambiguity, and tone, and choose the right response.

Zyogen

Building interpretable medical vision transformers and diffusion models.

Labs we worked with

Attention as Routing Graph: Circuit Extraction from Single Forward Pass

Treat attention as a routing map from one forward pass, keep a small subgraph aimed at the answer, and check it under ablation.

Finding Usable Weight Mechanisms with Tiled SVD

Extract mechanism mounts from weight sites as trigger, write, and strength triples. Pre-registered A/B/C eval on Gemma-2-2B: 182/182 GO.

Steering What Models Learn

Live, concept-level control of training runs: watch features form mid-run, then steer with data, loss, gradient, and representation interventions.

Replication of Single-Nucleus Transcriptomic Findings

Cross-study replication of snRNA-seq findings. Uniform pipeline, replication table, CSF/plasma biomarker shortlist.

Interpretability

Applied research on AQIT: transformers and LLMs, attribution, SAEs, simulation, training watch, embeddings, evals, security, and benchmarks.

Experimental Weight Editor

Agentic ROME on Pythia 2.8B with causal-trace layer location, rank-one updates, and a three-check validation loop.

Simulating LLM Behaviour in Different Environments

Activation steering for bias, Chess Agents, Echoes gossip RPG, and Among Us agents.

Structuring Social Data for AI

Reddit, X, and Hacker News discussions around Meta Ray-Ban glasses turned into a structured JSONL training dataset.

Latest research

Not sure if Aquin is right for you?