Our study aimed to explore the relationship between face processing patterns and individual differences in face recognition ability using tasks designed to impair holistic face processing. Face recognition performance, influenced by holistic processing strategies, was assessed in 206 participants (aged 18–63, including 26 super-recognizers and 17 individuals with developmental prosopagnosia) through inversion, composite, and part-whole tasks. Eye movement patterns were recorded alongside behavioral data to provide additional insights. Participants' holistic face processing indexes were calculated using subtraction and regression methods for each of these tasks. Face recognition performance was evaluated using CFMT+, EGEFACE (a new test using dynamic faces), and KFMT. We observed that as face processing ability increased, reliance on holistic processing measured via residual scores of part-whole, composite and inversion tasks increased. A moderating effect was found in terms of accuracy and reaction time in the inversion and composite face tasks. Eye movement data are analyzed in relation to face processing strategies, fixation duration, saccadic movements, and preferred fixation locations on the face, examining their connection to the holistic face processing index and face recognition ability across various face memory and perception tests.