Although mathematically elegant, back-propagation isn't perfect. Instead consider using particle swarm optimization (PSO) to train your neural network; here's how.

Qi Xiong, Hongbo Zhang, Qiusheng Rong, Path Planning Based on Improved Particle Swarm Optimization for AUVs, Journal of Coastal Research, SPECIAL ISSUE NO. 111.

Particle swarm optimization isn't usually seen as the first-choice technique for training a neural network but, as James McCaffrey demonstrates, it's a useful alternative.

Alireza Sahebgharani, MULTI-OBJECTIVE LAND USE OPTIMIZATION THROUGH PARALLEL PARTICLE SWARM ALGORITHM, Journal of Urban and Environmental Engineering, Vol. 10, No. 1 (January to June 2016), pp. 42-49 ...

Novel 'cuckoo search algorithm' beats particle swarm optimization in engineering design Date: May 28, 2010 Source: Inderscience Summary: The familiar early summer call of the cuckoo has inspired ...

As a group, simple creatures following simple rules can display a surprising amount of complexity, efficiency, and even creativity. Such swarm intelligence is found throughout nature, but researchers ...