Modulating anisotropic phonon polaritons (PhPs) can open new avenues in infrared nanophotonics. Promising PhP dispersion engineering through polariton hybridization has been demonstrated by coupling gated graphene to single-layer α-MoO3.However, the mechanism underlying the gate-dependent modulation of hybridization has remained elusive. Here, using IR nanospectroscopic imaging, we demonstrate active modulation of the optical response function, quantified in measurements of gate dependence of wavelength, amplitude, and dissipation rate of the hybrid plasmon−phonon polaritons (HPPPs) in both single-layer and twisted bilayer α-MoO3/graphene heterostructures. Intriguingly, while graphene doping leads to a monotonic increase in HPPP wavelength, amplitude and dissipation rate show transition from an initially anticorrelated decrease to a correlated increase. We attribute this behavior to the intricate interplay of gate-dependent components of the HPPP complex momentum. Our results provide the foundation for active polariton control of integrated α-MoO3 nanophotonics devices.