The study of how the skeletal system develops over time, including embryonic and postnatal development.