Train a ML-agent with # RND

XXXXchris · March 26, 2021, 11:39am

Hey, does anyone know RND? Is it included in the latest version of Unity ML-Agents?

I find the introduction here, but no more information about how to achieve it.

Unity-Technologies/ml-agents/blob/main/docs/ML-Agents-Overview.md#rnd-for-sparse-reward-environments

# ML-Agents Toolkit Overview

**Table of Contents**

- [Running Example: Training NPC Behaviors](#running-example-training-npc-behaviors)
- [Key Components](#key-components)
- [Training Modes](#training-modes)
  - [Built-in Training and Inference](#built-in-training-and-inference)
    - [Cross-Platform Inference](#cross-platform-inference)
  - [Custom Training and Inference](#custom-training-and-inference)
- [Flexible Training Scenarios](#flexible-training-scenarios)
- [Training Methods: Environment-agnostic](#training-methods-environment-agnostic)
  - [A Quick Note on Reward Signals](#a-quick-note-on-reward-signals)
  - [Deep Reinforcement Learning](#deep-reinforcement-learning)
    - [Curiosity for Sparse-reward Environments](#curiosity-for-sparse-reward-environments)
    - [RND for Sparse-reward Environments](#rnd-for-sparse-reward-environments)
  - [Imitation Learning](#imitation-learning)
    - [GAIL (Generative Adversarial Imitation Learning)](#gail-generative-adversarial-imitation-learning)
    - [Behavioral Cloning (BC)](#behavioral-cloning-bc)
    - [Recording Demonstrations](#recording-demonstrations)

This file has been truncated. show original

TTrope · March 26, 2021, 12:17pm

You can enable it in the training conf files

github.com

Unity-Technologies/ml-agents/blob/main/docs/Training-Configuration-File.md

# Training Configuration File

**Table of Contents**

- [Common Trainer Configurations](#common-trainer-configurations)
- [Trainer-specific Configurations](#trainer-specific-configurations)
  - [PPO-specific Configurations](#ppo-specific-configurations)
  - [SAC-specific Configurations](#sac-specific-configurations)
- [Reward Signals](#reward-signals)
  - [Extrinsic Rewards](#extrinsic-rewards)
  - [Curiosity Intrinsic Reward](#curiosity-intrinsic-reward)
  - [GAIL Intrinsic Reward](#gail-intrinsic-reward)
  - [RND Intrinsic Reward](#rnd-intrinsic-reward)
  - [Reward Signal Settings for SAC](#reward-signal-settings-for-sac)
- [Behavioral Cloning](#behavioral-cloning)
- [Memory-enhanced Agents using Recurrent Neural Networks](#memory-enhanced-agents-using-recurrent-neural-networks)
- [Self-Play](#self-play)
  - [Note on Reward Signals](#note-on-reward-signals)
  - [Note on Swap Steps](#note-on-swap-steps)

This file has been truncated. show original

Topic		Replies	Views
Academy and imitation training Unity Engine ML-Agents , Question , com_unity_ml-agents	4	914	February 12, 2022
Train a ML-agent with # curiosity module Unity Engine ML-Agents , Performance , com_unity_ml-agents	1	3395	February 24, 2021
Implementing custom code for model training in ML-Agents package Unity Engine ML-Agents , Question , com_unity_ml-agents	2	1497	May 18, 2023
Is it possible to do in game agent training? Unity Engine ML-Agents , com_unity_ml-agents	6	1755	November 19, 2023
how to train agent in unity machine learning. Unity Engine	3	906	February 8, 2019

Train a ML-agent with # RND

Related topics