Your coding agent can spend ~12k tokens before you type a word.
We measured the default system prompt of 30 open coding harnesses: from 235 tokens (goose) to 11,974 (Gemini CLI).
A 50x spread, and that's before any tool definitions 🧵
this was fun to build
- fork of signal
- agent built with GDK
- using open weights model
- served via e2ee mesh-llm
- via private GPU TEE
- making private search tool calls
- paid for with ₿ over LN
a cool stack of permissionless & open source tech all working together!
An agent inside Signal using decentralized compute paid for with bitcoin
@moneyball demos a fork of Signal built by @matbalez using @Mesh_LLM and @lexeapp ↓
Timestamps:
0:00 - Demo: agent inside Signal
10:51 - The economics of decentralized compute
14:39 - Running inference
Got setup w @buzzdotxyz beta at AGNTcon and super impressed with how modular & customizable it is w plugins.
Also very pleasant mellow design that sits pleasingly between corporate chaos of slack and wild west of discord. 🐝 💛