That would be your decision to make. You shouldn't really allow other people determine what you do or do not say. They might get offended. It's part of life. The only way for people to not become offended is to avoid interaction with pretty much everyone.