My experience is that milk glands/ducts will be noticeable in ~2 weeks, and will basically be finished growing in a few months. The fat that makes up the majority of the mass is what takes years to collect.