1 way will be issuing short term or long term bonds. Once maturity date is up, the government has an obligation to honour the payment to those who bought it.
Nowadays, the market instrument is getting very innovative yet sophiscated. There could be many more ways to borrow.