DRAFTPRIVATE AI / SYSTEMS
Running 500B+ parameter open-weight MoE models on a single workstation
Expert streaming, speculative decoding, and the practical boundary between available hardware and useful inference.
Research and implementation questions we are developing. Entries below are drafts, not published findings.
Technical notes, delivery letters, and applied research.
We write about the engineering decisions that change whether a system can be trusted in use.
Expert streaming, speculative decoding, and the practical boundary between available hardware and useful inference.
Scheduling, contention, and the operational choices behind a multi-model service.
How to specify reconciliation behavior, exceptions, and review points before implementation.
Finding the real workflow, the record of truth, and the person who can accept the result.
Tell us the system, the constraint, and the deadline. We will tell you if we can take responsibility for the result.