Musings
Updates, observations, and things I'm thinking about. Platforms come and go, data stays here.
A vision-language model fine-tuned on your CAD library and a year of factory-floor footage is a digital-twin starter kit on rails. It catches the gap between as-designed and as-built — the gap that eats manufacturing margin — without instrumenting a single new sensor.
Kolmogorov–Arnold networks run slower than MLPs at inference. In regulated industries — banking, pharma, defense — that trade is worth it: KAN edges are fixed, learnable functions you can read. MLP weights are an opaque chord. When auditors come knocking, an open book beats a black box.
A quantized 12B-parameter SLM with full PubMed RAG runs on a Jetson-class board. Doctors Without Borders, off-grid, 400:1 patient ratios, no internet. The frontier is not always where you think it is — sometimes it is exactly where the cloud cannot reach.
Most SMB AI projects start life as fine-tuning and end as RAG. Fine-tuning teaches the model to sound like you; RAG teaches it to know what you know. Almost everyone needs the second. They rarely need the first.
An agent that calls five tools to do what a single SQL query could do is not intelligence — it is overhead. The most useful agentic systems I have shipped are 80% deterministic plumbing and 20% LLM, in that order.
Differentiable physics lets you backprop through a manufacturing line. The same gradient that trains a neural net can now tune a production schedule. Operations research, but with a calculus you can actually ship.