Background: During the fourth age (80+ years), cognitive difficulties increase. Although language seems to resist the advancement of age, an older person without pathological developments in cognition may exhibit deficits in lexical access. This study examines the restrictions on lexical access in people aged 80 and older in word recognition and retrieval modalities through four lexical tasks. Method: The effect of aging on response time and accuracy was measured using recognition (lexical decision/naming/priming) and retrieval (picture naming) tasks. A fourth age group (>80) and two third age groups (60–69/70–79) were compared according to lexical access modality and type of task employed through linear regression models. Results: People aged 80 and older exhibit a strong lexical access constraint, as they are slower and less accurate in recognizing and retrieving words than both third age groups. These restrictions are more profound for the word retrieval modality, especially in the picture naming task. Conclusion: Impaired fluid intelligence and internode transmission deficits during advanced aging could further reduce the ability to recognize and/or retrieve words, having an impact on access speed and accuracy. Furthermore, the idea that crystallized intelligence could strengthen the accuracy of lexical access during aging is supported, specifically in word recognition modality.