Why is it…

…that brown M&Ms actually taste brown? I understand, objectively, that the color of the candy coating really has no flavor but what is it in my brain that imbues the different colors with slightly different tastes?