The $t$-distribution is easier to calculate.

The $t$-distribution accounts for the additional uncertainty introduced by estimating $\sigma$ with the sample standard deviation $s$.

The $t$-distribution is only for large samples.

The $t$-distribution assumes the population is not normal.