那我就不客气了 - "then I won't stand on ceremony" - is the sentence that closes the offer-and-refusal dance. It acknowledges that you declined once for form's sake and are now accepting properly. Saying it makes you sound like someone who knows the rules, which is worth more than the favour itself.