"Process Is Running" - rerun notification is hidden when running duplicated processes

Problem

When one application is running, and a duplicated application is started too, the notification is hidden by checking "Do not show this dialog in the future", how to let it show again.

Resolution

Go to Settings | Advanced Settings | Run/Debug | Enable "Confirm rerun with process termination".