You can definitely go much lower than that! The current automated minimum build size is 3.32 MiB for Unity 6 URP and I believe this does not have package/module optimizations applied (eg uses new project defaults).
Also be sure to build a release/master build, and try enabling disk size optimization - both are in Player Settings.
There are long running thread about webgl build size optimizations here and here.