When is this supposed to happen?

im 7 weeks today. for about a two weeks my breast have been growing now my milk duds are really sore and my breast are harder than normal. i knew it would all happen but i thought it was later on in the pregnancy?