How do I pause a campaign?

Set its status to Draft — that's the off switch. The campaign keeps all its settings and can go live again any time. With auto-publish on, the change reaches your storefront right away; otherwise press “Publish changes” on the campaign list.