The 49-year-old star believes he suffers from prosopagnosia, a medical condition that prevents people from recognizing faces.
The actor says "people hate me because they think I'm disrespecting them." Pitt has not been officially diagnosed with the disorder but, plans to get tested.
He says even telling people about the condition doesn't help, it actually makes it worse because they think he's egotistical.
A 2006 study found one in every 50 people have this condition.
KGO-TV San Francisco, CA contributed to this report.