How can I make the text shrink with the visual element?

Hi, I’m making a player in-game UI for a multiplayer party game using UI Toolkit. As you can see below. The way the UI works is that as more player joined in the game (for example 8 players), the UI will scale accordingly, I managed to make the visual elements do that but the Labels don’t. How do I go about fixing this?
UI with 4 players:


UI with 8 players - Labels don’t scale accordingly

Hierarchy setting:
9775497--1401363--upload_2024-4-17_16-36-33.png