The town one thinks of as "the town where my home is". One's hometown is usually the town he is most familiar with, having spent a large proportion of his earlier life there. One's hometown is often the place he grew up in.