You say people tell you they are color-blind and don't see you are black - a person of color.
I feel for you; it's humiliating.
I live in Britain, though I have lived in other countries as well.
I am tall and white (actually I am 4th generation of Russian immigrants - so I am pseudo Western-White) and when I was younger I had a few occasions when people asked me questions in department stores as though I worked there.
I used to wear a suit - maybe that explains it.
It made me look into myself and wonder what they saw that made them think they knew who I was.
Was it something negative - something positive?
But it's a fool's errand - it's impossible to know what someone thought - even by asking them.
So I let it go.
The world is full of prejudice. I am prejudiced. I try to root out my prejudices, but some are pretty deep.
The biggest thing I am conscious of though, is not acting on my prejudices.
That means treating people fairly, relating to them neither from above nor below, and recognizing the person beyond the color or the country.
And it cuts both ways - I see myself leaning towards aciting positively to people from groups I know suffer prejudice.
When I see myself doing that, I hold myself back and look at the person behind and beyond the color or the country, to stop myself from apologizing for all the hurts they suffer.
But not to pretend it doesn't exist.
So I see peoples' color.
Relating to other human beings is difficult enough without all that baggage as well.