The way to think about color filters, they provide the least blockage of transmission of colors that are close to them on the color wheel, and block the most transmission of light on the opposite (often also known as the complementary) parts of the color wheel. In B&W this translates to the amount of luminance. Hence the dark gray of the blue sky.