Face color plays an important role in enhancing empathy in human face-to-face communication, and supports recognition of human emotions such as delight and sorrow. However, these effects cannot be applied to people with a color vision deficiency, who differ in color vision compared to people with normal color vision. Therefore, it is essential to investigate differences in the role of face color in perceiving human emotions. This paper focuses on face color in color vision deficiency, and the experiments evaluate the influence of face color on perception in people with normal color vision and a color vision deficiency. In addition, we evaluated differences in emotion perception between people with normal color vision and people with a color vision deficiency. The results demonstrate that orange improves perception of delight.