This synthesis of recent work in both artificial neural networks and neurobiology, seeks to examine neurobiological data from a network perspective, and to encourage neuroscientists to participate in constructuring the next generation of neural networks.