Introduction To develop sustainable, walkable neighborhoods, it is essential to understand how amenity loss in residential areas affects older adults' active travel behavior, as measured by step count. The impact may be less pronounced in neighborhoods with high baseline amenity accessibility. Older seniors (aged ≥75) may be more affected by such losses than their younger counterparts (aged 65–74), likely due to age-related functional decline. Gender-differences in amenity use may also shape individual responses. However, few studies have directly examined changes in neighborhood amenities; the impact of amenity loss on older adults’ step count remains underexplored. Methods This study measured changes in accessibility to neighborhood amenities during the COVID-19 pandemic and analyzed their association with step count decline among 12,330 older adults in Yokohama, Japan, between 2017 and 2022. Results A greater decrease in accessibility was associated with a larger reduction in step count, although the relationship was nonlinear. Over time, the rate of decline in step count slowed among older adults in neighborhoods with reduced accessibility. In neighborhoods with initially high accessibility, decreases in amenities had a minimal impact on step count. Although the effect was more pronounced among older seniors, the decline in their step count decelerated over time, suggesting adaptive behaviors such as longer or more flexible walks. Maintaining access to a diverse range of amenities is particularly important for promoting walking among older women. Conclusions These findings underscore the importance of preserving neighborhood amenity access as a strategy to sustain daily walking among older adults.