Very slow exit from play mode - 2019.3.14 and later

It takes ages to exit the play mode after I upgraded from Unity 2019.3.13f1 where everything was working fine!

Refresh completed in 112.781982 seconds.

This issues is present in 2019.3.14 onward, I’ve tried 2019.4 as well as 2020.1 with no luck.

Does anyone have the same issue? Do you know what I should look into that could lead to this (which assets or what it is actually doing?)

Refresh completed in 112.781982 seconds.
RefreshInfo: RefreshV2(AllowForceSynchronousImport) scanfilter:
RefreshProfiler: Total: 0.000ms
    InvokeBeforeRefreshCallbacks: 112781.802ms
    ApplyChangesToAssetFolders: 0.476ms
    WriteModifiedImportersToTextMetaFiles: 0.057ms
    CleanLegacyArtifacts: 0.000ms
    Scan: 0.000ms
    OnSourceAssetsModified: 1.798ms
    UnregisterDeletedAssets: 0.000ms
    InitializeImportedAssetsSnapshot: 0.000ms
    GetAllGuidsForCategorization: 7.122ms
    CategorizeAssets: 0.220ms
    ImportAndPostprocessOutOfDateAssets: 112761.599ms (5.257ms without children)
        ImportManagerImport: 2.728ms (0.000ms without children)
            ImportInProcess: 0.000ms
            ImportOutOfProcess: 0.000ms
            UpdateCategorizedAssets: 0.000ms
            RemoteAssetCacheUploadArtifacts: 0.000ms (0.000ms without children)
                RemoteAssetCacheUploadMetadata: 0.000ms
            RemoteAssetCacheGetArtifact: 0.000ms (0.000ms without children)
                RemoteAssetCacheFetchMetadata: 0.000ms
                RemoteAssetCacheMatchMetadataResults: 0.000ms
                RemoteAssetCacheDownloadFile: 0.000ms
        CompileScripts: 0.000ms
        PostProcessAllAssets: 0.000ms
        ReloadImportedAssets: 0.000ms
        VerifyAssetsAreUpToDateAndCorrect: 0.000ms
        EnsureUptoDateAssetsAreRegisteredWithGuidPM: 0.000ms
        InitializingProgressBar: 0.370ms
        PostProcessAllAssetNotificationsAddChangedAssets: 0.000ms
        OnDemandSchedulerStart: 0.180ms
        RestoreLoadedAssetsState: 0.238ms
    InvokeProjectHasChanged: 1.740ms
    UpdateImportedAssetsSnapshot: 0.000ms
    ReloadSourceAssets: 0.000ms
    UnloadImportedAssets: 0.856ms
    Hotreload: 0.141ms
    FixTempGuids: 0.042ms
    VerifyGuidPMRegistrations: 0.004ms
    GatherAllCurrentPrimaryArtifactRevisions: 0.000ms
    UnloadStreamsBegin: 0.228ms
    LoadedImportedAssetsSnapshotReleaseGCHandles: 0.230ms
    GetLoadedSourceAssetsSnapshot: 0.818ms
    PersistCurrentRevisions: 3.074ms
    UnloadStreamsEnd: 0.131ms
    GenerateScriptTypeHashes: 0.025ms

Did you ever resolve this issue?