Can I pause or cancel a campaign?

Yes. From the campaign detail page, use the actions menu to cancel an active campaign at any time.