Cortex
On-Device Android Phone Assistant & Hybrid Dual-Engine Agent
Cortex leverages Claude 3.5 Sonnet / Haiku to orchestrate system-level intent. Built for the Anthropic Claude for Startups program (claude.com/programs/startups).
Architecture & Purpose
Cortex is an on-device Android assistant that executes system actions in your own language—preferably without ever looking at the screen. System settings (Wi-Fi, Bluetooth, volume, DND) run directly through a Privileged ADB daemon with state read-back verification. A local GGUF model (Qwen2.5 family via llama.cpp JNI and OpenCL on Adreno) uses GBNF grammars to guarantee valid execution with zero data leaving the phone. For complex multi-step reasoning, an optional Claude API fallback can be engaged with automatic local PII masking.
Core Specifications & Features
Privacy Perimeter & Runtime Verification
Decision Hierarchy: "LLM is the Last Resort"
Most mobile agents burn battery by blindly screenshotting the screen. Cortex inverts this with a four-tier hierarchical execution pipeline:
System toggles execute straight through Wireless Debugging ADB shell with state read-back verification. Screen stays off.
Chit-chat, translation, and user macros route to targeted lightweight handlers without invoking heavy agent reasoning.
Qwen2.5-3B loaded via native JNI with OpenCL GPU acceleration. Strict GBNF grammars constrain model output to valid phone actions.
Deep multi-step reasoning via Claude 3.5 Sonnet. PII is regex-masked locally; API key stored in Android hardware Keystore.
Engineering Metrics & Repository Audit
Open Source Repository & Technical Documentation
Inspect the complete system design, ARCHITECTURE.md specs, and training pipeline on GitHub.