2024ApJ...973..108B

Multiple analytical, semi-analytical, and empirical stability criteria have been derived in the literature for two-planet systems. But, the dependence of the stability limit on the initial mutual inclination between the inner and outer orbits is not well modeled by previous stability criteria. Here, we derive a semi-analytical stability criteria for two-planet systems, at arbitrary inclinations, in which the inner planet is a test particle. Using perturbation theory we calculate the characteristic fractional change in the semimajor axis of the inner binary β = δa₁/a₁ caused by perturbations from the companion. Stability criteria can be derived by setting a threshold on β. Focusing initially on circular orbits, we derive an analytical expression for β for coplanar prograde and retrograde orbits. For noncoplanar configurations, we evaluate a semi-analytical expression. We then generalize to orbits with arbitrary eccentricities and account for the secular effects. Our analytical and semi-analytical results are in excellent agreement with direct N-body simulations. In addition, we show that contours of β ∼ 0.01 can serve as criteria for stability. More specifically, we show that (1) retrograde orbits are generally more stable than prograde ones; (2) systems with intermediate mutual inclination are less stable due to von Ziepel-Lidov-Kozai (vZLK) dynamics; and (3) mean motion resonances (MMRs) can stabilize intermediate inclination secularly unstable regions in phase space, by quenching vZLK secular processes (4) MMRs can destabilize some of the dynamically stable regions. We also point out that these stability criteria can be used to constrain the orbital properties of observed systems and their age.