Measures the disorder or uncertainty in the data. $$ \text{Entropy} = -\sum_{i=1}^{n} p_i \log_2(p_i) $$