As shown in video,
I sovled it by remove the object when bake. Local nav mesh builder seem to not deal with the default bake mesh