For any positive integer $n$, let $D_n$ denote the set of all positive divisors of $n$. Determine the cardinality of the set $(D_{36} \cap D_{48}) \setminus D_{6}$.