Three local AI models get the same systems-engineering homework. The results are... educational.
When you feed the
same complex systems-engineering prompt into three very different local LLMs, you learn a lot—not just about the models, but about how modern AI handles the difference between
understanding an architecture and actually implementing one.
The prompt itself was non-trivial: build a fully asynchronous Python data-ingestion pipeline using asyncio, httpx, Pydantic v2, a custom token-bucket rate limiter, exponential-backoff retry logic, a bounded queue, and a worker pool that maintains thread-safe moving averages.
At first glance, there was a clear winner (at least according to Gemini's quick review). Then I looked more closely at the winner.
And that's where this little experiment got considerably more interesting.
Below, we break down how each model responded, what Gemini observed, what I found when I checked the generated code more closely, and what the results actually say about local LLM engineering.