Thin shells are found in nature at scales ranging from viruses to hens' eggs; the stiffness of such shells is essential for their function. We present the results of numerical simulations and theoretical analyses for the indentation of ellipsoidal and cylindrical elastic shells, considering both pressurized and unpressurized shells. We provide a theoretical foundation for the experimental findings of Lazarus et al. [following paper, Phys. Rev. Lett. 109, 144301 (2012)] and for previous work inferring the turgor pressure of bacteria from measurements of their indentation stiffness; we also identify a new regime at large indentation. We show that the indentation stiffness of convex shells is dominated by either the mean or Gaussian curvature of the shell depending on the pressurization and indentation depth. Our results reveal how geometry rules the rigidity of shells.