Do I have to (re)build addressables whenever one of their files change or only when i add new files?

Unity Engine
1

as above

2

Yes. Addressable system builds asset bundles. They are like zip files and contain the representations of assets in the state when you last built the bundles.

So if you add, edit or remove an addressable asset. You need to rebuild the asset bundles to reflect those changes.