I'm driving/I ate before I came/Maybe later/No, thank you/I'm not a big fan of those/Not just at the moment, thanks
All are appropriate responses (best not to lie, though!)
Just make sure you say it with a smile.
They won't hold it against you. If they do, they're silly, and why would you go to silly people's parties anyway!