When trying to uninstall office 365 Dynamics 365 Outlook Plugin, it attempts to uninstall, then loops back to trying to install. It never uninstalls.
The Fix:
Deleting all registry entries fixed the root problem. Look for all entries under:
Program Files (x86)\Microsoft Dynamics CR
And
Program Files\Microsoft Dynamics CRM