Deactivate Public (Default) View

My client has duplicate views on Activity entity which I want to deactivate. However, when I try to deactivate one of "My Activities" view then I get alert, "The default view can not be deactivated", as show by screenshot.

Also I have tried to set another "My Activities" view as a default.