Can keeping my smart phone in a shirt pocket affect my ICD?

Yes, it could. Your mobile phone, as well as any accessories containing magnets (such as earbuds or cases with magnetic clasps) need to be kept at least 6 inches away from your device.