This paper addresses the generalisation of stationary Hawkes processes in order to allow for a time-evolving second-order analysis. Motivated by the concept of locally stationary autoregressive processes, we apply however inherently different techniques to describe the time-varying dynamics of self-exciting point processes. In particular we derive a stationary approximation of the Laplace transform of a locally stationary Hawkes process. This allows us to define a local intensity function and a local Bartlett spectrum which can be used to compute approximations of first and second order moments of the process. We complete the paper by some insightful simulation studies.