The neurological processes involved in the growth and development of the brain from infancy to adulthood.