Among the many mysteries which encompass the world around us, lies a complex interaction right under our nose, or perhaps… right above it. In the labyrinth of human consciousness, we rely on the seemingly arbitrary judgements made from the combination of two eyes, a nose, and a mouth, to discern who might be a friend or foe. Facial recognition gives a snapshot into the intricate dance between our perception and cognition, which allows us to cultivate a more detailed understanding of those around us, and their thoughts, feelings and emotions.  

In those fleeting moments when you recognise your parents in a sea of unfamiliar faces, spot your friends ensconced among the rows of the lecture theatre, or simply bump into an old friend in a crowd of unacquainted strangers, your brain is able to identify faces in a fraction of a second, a remarkable feat of the human cognitive capacity. But what enables us to distinguish one face from another? How do the faces of those we know stand out from the countless other noses, eyes and mouths we see? To understand what makes these interactions so meaningful, we need to take a closer look at the mechanisms behind facial recognition and decoding within the brain. 

The Brain’s Blueprint

To be human is to seek meaning, even when none may exist. The mind has transformed what is two eyes above a nose, and a nose above a mouth, into its own pattern for classifying the identities and expressions we see around us. Many studies have suggested facial processing to be holistic, where the featural patterns of the eyes, nose and mouth are perceived together and upright (1,2). This mechanism of holistic facial processing explains the interesting phenomena behind pareidolia, where the brain adapts the characteristics of human faces onto everyday objects. It’s the reason why when glancing at a bowling ball it may appear surprised (3), or why some have sworn to see a face on Mars (4)! 

Figure 1. Bowling balls with surprised facial expressions! (3)

In pursuit of meaning for the patterns around us, the brain has developed specialised regions for processing the features of a face to help us recognise individual identities. Facial processing operates through a hierarchical mechanism where distinct aspects of the face are interpreted by different regions of the brain. The unchanging elements of the face such as gender, age, ethnicity and features related to someone’s identity are analysed by the Inferior Occipital Gyrus and Fusiform Face Area (FFA), while the changing aspects such as eye gaze, lip movements and facial expressions are analysed by the Superior Temporal Sulcus and Orbitofrontal Cortex (5,6). 

Of these face-selective regions, the FFA is particularly important for facial recognition as it helps us recognise who a person is (5). Through the activation of our FFA simple patterns shift from meaningless shapes into familiar visages representing our friends, family, or even our own reflection. Studies have uncovered the importance of the FFA for facial recognition by examining what may happen when this brain region malfunctions (7,8). A unique example of this is prosopagnosia, which results from damage to the FFA in the right hemisphere of the brain (9). Prosopagnosia is a relatively rare condition affecting about 1 in 50 people, impairing their ability to recognise faces (9). Imagine if every face you observed looked the same or unfamiliar… even your own reflection! 

It is through the brain and its specialised regions for facial recognition where we can appreciate the essence of human connection as a result of our neural hardware. These mechanisms responsible for transforming patterns into faces are the reason we can recognise our neighbour from a stranger, friend from a classmate, or our parents from a teacher. Often overlooked amidst the fleeting and impermanent nature of our social interactions, this complex system guides us along the fragile line of human relationships, between familiarity and estrangement, a friend or foe. It highlights how deeply-rooted our connection and sense of identity is to the faces we see. 

The Brain’s Threat Detection

With each neuron, synapse and pathway, our brains are machines wired for connection, not just in how we think, but also in how we perceive and interact with our surroundings. From the brief exchange of smiles with a stranger, to the furtive glare from someone across the room, one of the hallmarks of our emotional understanding is the ability to decode the thoughts and intentions of others, even from the most subtle of expressions.

In the vast and intricate web of neural connectivity, it can be difficult to isolate a singular brain region or connection to explain complex cognitive functions. Brain imaging studies have found a strong bidirectional link between the FFA and amygdala, making this a likely candidate for explaining our remarkable decoding ability (10,11). As the FFA picks up on who a person is or what facial expression is being made, it is the amygdala which then evaluates the emotional salience, or importance, of this face. The amygdala then signals back to the FFA to either increase or decrease the facial processing activity accordingly (10,12). Consider how the visibility of teeth in a barred expression can signal anger, the whiteness of someone’s eyes can hint fear or surprise, and the shape of a person’s eyebrows can indicate the intensity of their emotion, all which guide the brain to prioritise and interpret socially and emotionally relevant cues – almost like a survival filter! (13,14,15).

From an evolutionary perspective, the FFA-amygdala feedback loop serves as an important tool for rapidly and accurately interpreting the intentions of others, a pinnacle function in the architecture of our physical and social survival (16). The ability to recognise whether someone poses a friend or foe has been a survival mechanism and evolutionary advantage for millennia. The role of our facial processing network, from the amygdala and FFA, to other brain regions discussed, provides a microcosm into our nature as social beings, and our evolutionary selective changes, which have enhanced our ability to sense, respond to, and connect with those around us (17). 

In this way, maybe the most profound mysteries lie not in distant galaxies or ancient ruins, but are hidden in plain sight, within the faces we walk past every day. Our brain’s ability to read them is not merely a mechanism for decoding emotion, but a mirror into the nature of what it means to be human, where connection, trust, and survival have long been written in the expressions of those around us. 

References

1. Farah M, Wilson K, Drain M, Tanaka J. What is “special” about face perception?. Psychological Review [Internet]. 1998 Aug [cited 2025 May 14]; 105(3):482–98. Available from: https://pmc.ncbi.nlm.nih.gov/articles/PMC5561817/

2.  Richler J, Gauthier I. A meta-analysis and review of holistic face processing. Psychological Bulletin [Internet]. 2014 Sep [cited 2025 May 14]; 140(5): 1281–302. Available from: https://pubmed.ncbi.nlm.nih.gov/24956123/

3. What do you think these bowling balls saw to leave them so surprised & shocked?. Reddit [Internet]. 2022 [cited 2025 May 31]. Available from: https://www.reddit.com/r/Pareidolia/comments/zc12jo/what_do_you_think_these_bowling_balls_saw_to/#lightbox

4. Gilbert L. Why the brain is programmed to see faces in everyday objects. UNSW Sites [Internet]. 2020 Aug [cited 2025 May 14]. Available from: https://www.unsw.edu.au/newsroom/news/2020/08/why-brain-programmed-see-faces-everyday-objects

5. Kanwisher N, Yovel G. The fusiform face area: a cortical region specialized for the perception of faces. Philosophical Transactions of the Royal Society: Biological Sciences [Internet]. 2006 Dec 29 [cited 2025 May 14]; 361(1476):2109–28. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1857737/

6. Zhen Z, Fang H, Liu J. The Hierarchical Brain Network for Face Recognition.  Ptito M, editor. PLoS ONE [Internet]. 2013 Mar [cited 2025 May 14]; 8(3):e59886. Available from: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0059886

7. Hadjikhani N, de Gelder B. Neural basis of prosopagnosia: An fMRI study. Human Brain Mapping [Internet]. 2002 [cited 2025 May 14]; 16(3):176–82. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1002/hbm.10043

8. Sorger B, Goebel R, Schiltz C, Rossion B. Understanding the functional neuroanatomy of acquired prosopagnosia. NeuroImage [Internet]. 2007 Apr [cited 2025 May 14] ;35(2):836–52. Available from: https://www.sciencedirect.com/science/article/pii/S1053811906009906

9. Prosopagnosia | Psychology Today Australia [Internet]. www.psychologytoday.com. [cited 2025 May 14]. Available from: https://www.psychologytoday.com/au/basics/prosopagnosia

10. Herrington J, Taylor J, Grupe D, Curby K, Schultz R. Bidirectional communication between amygdala and fusiform gyrus during facial recognition. NeuroImage [Internet]. 2011 Jun [cited 2025 May 14]; 56(4):2348–55. Available from: https://pubmed.ncbi.nlm.nih.gov/21497657/

11. Said C, Dotsch R, Todorov A. The amygdala and FFA track both social and non-social face dimensions. Neuropsychologia [Internet]. 2010 Oct [cited 2025 May 14]; 48(12): 3596–605. Available from: https://pubmed.ncbi.nlm.nih.gov/20727365/

12. Šimić G, Tkalčić M, Vukić V, Mulc D, Španić E, Šagud M, et al. Understanding Emotions: Origins and Roles of the Amygdala. Biomolecules [Internet]. 2021 May [cited 2025 May 14]; 11(6):823. Available from: https://pmc.ncbi.nlm.nih.gov/articles/PMC8228195/

13. Jacobs R, Renken R, Aleman A, Cornelissen F. The amygdala, top-down effects, and selective attention to features. Neuroscience & Biobehavioral Reviews [Internet]. 2012 Oct  [cited 2025 May 14]; 36(9):2069–84. Available from: https://pubmed.ncbi.nlm.nih.gov/22728112/

14. Horstmann G, Lipp O, Becker S. Of toothy grins and angry snarls – Open mouth displays contribute to efficiency gains in search for emotional faces. Journal of Vision [Internet]. 2012 May [cited 2025 May 14]; 12(5):7–7. Available from: https://jov.arvojournals.org/article.aspx?articleid=2192034#:~:text=We%20suspected%20that%20visible%20teeth,(see%20also%20Figure%205).&text=Mean%20target%20present%20slopes%20(in,while%20angry%20faces%20do%20not.&text=Mean%20target%20present%20slopes%20(in,while%20angry%20faces%20do%20not.

15. Hasegawa H, Unuma H. Facial Features in Perceived Intensity of Schematic Facial Expressions. Perceptual and Motor Skills [Internet]. 2010 Feb [cited 2025 May 14]; 110(1):129–49. Available from: https://pubmed.ncbi.nlm.nih.gov/20391879/

16. Schmidt K, Cohn J. Human facial expressions as adaptations: Evolutionary questions in facial expression research. American Journal of Physical Anthropology [Internet]. 2001 [cited 2025 May 14]; 116(S33):3–24. Available from: https://pubmed.ncbi.nlm.nih.gov/11786989/

17. Carter E, Pelphrey K. Friend or foe? Brain systems involved in the perception of dynamic signals of menacing and friendly social approaches. Social Neuroscience [Internet]. 2008 Jun [cited 2025 May 14]; 3(2):151–63. Available from: https://pubmed.ncbi.nlm.nih.gov/18633856/