Hi, I am using visual observation of 256x192x3. I have 32GB RAM but it runs out while using SAC.
May I know which parameter to change in the config file that affects the RAM? should i change batch size or buffer size? how does changing it affect the training?
Thanks!
Probably both!
you can read about them in the following link ml-agents-1/docs/Training-SAC.md at master · yosider/ml-agents-1 · GitHub
If you’re running out of memory during training you should consider using smaller batch size. Also the network architecture and network size also affects the memory usage, so you could also consider using a smaller network or smaller hidden size.
i tested BS 64, Buffer 60000 and BS128, Buffer 60000
RAM usage is pretty much the same
but changing Buffer size affected the RAM the most so i guess i’ll tweak that
however, is it bad if batch size and buffer size is too close in value?
I guess it would depend on how ‘close’ the values are.
But I would say it depends on your hardware capabilities you just have to choose the numbers that gives you the best results given the limits of your machine.
Good luck!