Architecture
Single-hidden-layer network with sigmoid activations, trained entirely from scratch; interactive testing on MNIST or custom handwritten digits.
Lessons learned
- Implementing backprop by hand is the fastest way to actually understand what frameworks abstract away.