It seems that if a user set an Out of office from their Outlook client, before the update was applied, it cannot be turned off using their Outlook client. They are simply asked again and again, without success.
This can be handled through the Exchange Control Panel website, where an admin can turn it off for the specific users.