I retested it with Unity 2020.2, see 2020.2: Deleting assets inside Unity is significantly slower than deleting them via Windows Explorer