The $t$-distribution is more computationally efficient.

The $t$-distribution accounts for the additional uncertainty of estimating $\sigma$ with $s$.

The $t$-distribution is used only for categorical data.

The $t$-distribution is always narrower than the $z$-distribution.