Color is in the eyeballs. The proteins in your eyes that react to different wavelengths of light produce the network of colors we see. Your brain processes the image but all the color signals are assigned by your eyes.

I believe there’s even lens tech that can help alter colors so colorblind can differentiate the colors easier if the colorblindness falls into certain variants.