To be social, the ability to recognize and discriminate conspecific individuals is indispensable in social animals, including primates, rodents, birds, fish, and social insects which live in societies or groups. Recent studies using molecular biology, genetics, in vivo and in vitro physiology, and behavioral neuroscientific approaches have provided detailed insights into how animals process and recognize the information of individuals. Here, we review the most distinct sensory modalities for individual recognition in animals, namely, olfaction and vision. In the case of rodents, two polymorphic gene complexes have been identified in their urine as the key and essential pheromonal components for individual recognition: the major histocompatibility complex (MHC) and the major urinary protein (MUP). Animals flexibly utilize MHC and/or MUP, which are detected by the main olfactory epithelium (MOE) and/or the vomeronasal organ (VNO) for various types of social recognition, such as strain recognition, kin recognition, and individual recognition. In contrast, primates, including humans, primarily use facial appearance to identify others. Face recognition in humans and other animals is naturally unique from genetic, cognitive, developmental, and functional points of view. Importantly note that nurture effects during growth phase such as social experience and environment can also shape and tune this special cognitive ability, in order to distinguish subtle differences between individuals. In this review, we address such unique nature and nurture mechanisms for individual recognition.