The Illusion of Being Fair