Question

Every time I modify source code, for example, tests written in Kotlin, the IntelliJ IDEA automatically launches Run/Debug configuration without explicit actions from user’s side

Answer

This looks like an unexpected behavior. Contact IntelliJ IDEA support by filing a request here or create a new bug report in IJPL issues tracker for a development team

Workaround 1: File | Invalidate Caches... | Invalidate and Restart

Workaround 2: Go to Main IDE menu | Run | Edit Configurations... , and re-create Run/Debug configurations from scratch