The changes that occur in memory functioning over the course of development, from infancy to late adulthood.