If you no longer need to use the Add-in simply un-pin it and then close it. It will then cease to appear when you select messages.

Be sure to repeat this both on an incoming email and when composing an email, as the pinned status is saved separately for these two scenarios.

The Add-in will remain available on your ribbon menu but will then be dormant.