On-chip training of machine learning algorithms is challenging for photonic devices. Here, the authors construct nonlinear mapping functions in silicon photonic circuits, and experimentally demonstrate on-chip bacterial foraging training for projection-based classification.