Edge AI is having its GPT-3 moment, and the door is finally open to beginners
You can now describe a circuit board in one sentence and get back real KiCad files. Whether that board works is a different question, and it's the whole game.
Plenty of engineers are already building with this. Microcontrollers now ship with neural accelerators, and platforms like Edge Impulse have tens of thousands of developers. What's changing is who can join them: for a beginner, the path from "I have an idea" to "it runs on a board" is much shorter than it used to be.
It reminds me of how language models opened up around GPT-3. Not better than experts, but reachable by far more people. (That's an analogy, not a benchmark.)
WHY NOW
The hardware caught up. ST's STM32N6 is a microcontroller with a built-in neural accelerator. ST quotes up to 600 GOPS and 4.2 MB of on-chip RAM, plus a camera interface. That's the class of chip that can run real vision models without a Linux board.
The software caught up too. Edge Impulse reported 118,185 projects from 50,953 developers as of October 2022, per its own paper. And on the board side, heypcb turns a plain-language description into a schematic, layout and fab files as KiCad files you keep. Its terms reportedly warn that AI designs can be wrong or unsafe, so the review is on you.
Drafting got cheap. Verifying didn't. That's where the skill moved.
WHAT TO ACTUALLY LEARN (IN THIS ORDER)
- C, just the core. Pointers, structs, arrays, how memory works. You don't need C++ templates or a kernel. Python only enough to train a small model with NumPy and Keras.
- One cheap board. An ESP32, RP2040 or Arduino Nano 33 BLE Sense. Read a sensor, blink an LED, print over serial. Skip RTOS and Linux for now.
- The three ideas that make TinyML tiny. Quantization (int8 instead of float32), the memory budget (flash and RAM, not "GPU"), and signal windows (slicing sensor or audio data into chunks and turning them into features). A lot of beginner problems trace back to one of these.
- Ship the classic projects. The book TinyML by Pete Warden and Daniel Situnayake walks through three: a speech recognizer, a person-detecting camera and a gesture "magic wand". The publisher says no prior ML or microcontroller experience is needed. Pair it with Edge Impulse for a no-code start and Shawn Hymel's Coursera course. To go deeper into on-device deployment, HarvardX's Deploying TinyML on edX teaches TensorFlow Lite for Microcontrollers.
- PID control. One of the oldest tricks in embedded, and still everywhere: read a sensor, compare it to the target, correct the output. Thermostats, motor speed, drone stabilization. Build a temperature or motor-speed loop and tune the three gains by hand. It teaches you timing, sensors and actuators in a way blinking an LED never will, and it's a good reminder that not every problem needs a neural network. Phil's Lab has videos on control systems.
- Read a datasheet and a schematic. Power, decoupling caps, USB, crystals. Phil's Lab on YouTube shows KiCad and STM32 board design from schematic to layout, and covers real-time DSP in C, which is the "features" skill from the TinyML ideas above. Open KiCad next to the video.
- Then use AI as your board drafter. Describe your device to heypcb, or fork one of the 8,800+ open boards the company says are in Circuit World. Go through the result net by net until you can defend every connection. Run ERC and DRC. Order the board.
- Level up to vision. Get an NPU-class board (the STM32N6 has an ST toolchain and a public model zoo) and run a real detection model. That's your own GPT-3 moment demo.
WHAT TO SKIP AT FIRST
FPGAs, custom silicon, writing your own drivers from scratch, and anything that promises "mastery of embedded" before you've shipped one board.
One finished project beats ten courses.
The barrier to entry dropped.
The responsibility didn't.