The stack effect in high-rise buildings, stemming from an inside/outside temperature difference, may produce a significant pressure difference on the elevator doors, potentially causing elevator malfunctions. This effect can also be influenced by wind action and human behaviors, e.g., opening/closing of building entrances. In this study, a wind tunnel test was conducted to determine the real wind pressure distribution on a high-rise building in northern China. A numerical simulation utilizing the Conjunction of Multizone Infiltration Specialists software (COMIS) was carried out to investigate the pressure difference of elevator doors under the effects of thermal buoyancy, wind action, and opening/closing of the first-floor lobby entrance. An alternative solution of a locally strengthened envelope is proposed and validated for the studied building zone. The study reveals that the opening of the first-floor lobby entrance increases the pressure difference regardless of the environmental conditions, and the increase of wind speed tends to increase the pressure difference in winter but decrease it in summer. The proposed countermeasure combination, involving using revolving doors instead of swing doors, increasing additional partitions, and strengthening the local building envelope, was found to be synergistic and effective in reducing the pressure difference inside the building. The research findings offer practical engineering solutions for mitigating elevator door pressure challenges in high-rise buildings.