# Post Your ML-Agents Project
**URL:** https://discussions.unity.com/t/post-your-ml-agents-project/816756
**Category:** ML Agents
**Tags:** ML-Agents, Official
**Created:** [November 13, 2020, 6:13pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756 "2020-11-13T18:13:29Z")
**Posts on this page:** 20
**Page:** 1
### Author:  [@jeffrey\_unity538](https://discussions.unity.com/u/jeffrey_unity538)
#### Post date: [November 13, 2020, 6:13pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/1 "2020-11-13T18:13:29Z")
Thread on community created ML-Agents projects. Please share any posts, images, videos or project links.
---
### Author:  [@mbaske](https://discussions.unity.com/u/mbaske)
#### Post date: [November 16, 2020, 8:13pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/2 "2020-11-16T20:13:44Z")
Hi, here are a couple of my project videos. There are source files available for most of them, but I haven’t really kept those up to date, some are using old versions of ML-Agents. Also, since I’m still finding my way around Unity, I would approach some things differently now than I did back when I created these projects…
You can find more info in the video descriptions and a few other Unity and ML-Agents related videos on my channel.
[ ](https://www.youtube.com/watch?v=6rHBfuZEivc)
[ ](https://www.youtube.com/watch?v=omCJTvZ3ZMY)
[https://github.com/mbaske/ml-motorcycles](https://github.com/mbaske/ml-motorcycles)
[ ](https://www.youtube.com/watch?v=KzP-8lUQdmU)
[https://github.com/mbaske/ml-dogfight](https://github.com/mbaske/ml-dogfight)
[ ](https://www.youtube.com/watch?v=WvSyD8VFLFg)
[https://github.com/mbaske/ml-hover-bike-race](https://github.com/mbaske/ml-hover-bike-race)
[ ](https://www.youtube.com/watch?v=xeYvA6Ag0Hg)
[https://github.com/mbaske/robot-ants](https://github.com/mbaske/robot-ants)
---
### Author:  [@mbaske](https://discussions.unity.com/u/mbaske)
#### Post date: [November 16, 2020, 8:14pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/3 "2020-11-16T20:14:19Z")
[ ](https://www.youtube.com/watch?v=9t4YBXZe7hc)
> [@Self-play with automatic curriculum? \[now with source & video\]](https://discussions.unity.com/t/797987):
>
> Hi, I’d be interested in your thoughts on automating curricula with symmetric self-play. I’m not super familiar with the theory behind this, so I might be reinventing the wheel here or miss some crucial aspects. I have two humanoid agents pitted against each other in a boxing match. Episodes are open-ended and can terminate in one of three ways: Whenever an agent strikes its opponent, I’m adding its fist velocity’s magnitude to a float field that was nulled on episode start. Once the accumula…
[https://github.com/mbaske/ml-selfplay-fighter](https://github.com/mbaske/ml-selfplay-fighter)
EDIT
THANK YOU for featuring the self-play fighter on the Unity blog.
I’m embarrassed to admit I only saw it this week, should really check the blog more often…
[ ](https://www.youtube.com/watch?v=krzmg9eOeDM)
[https://github.com/mbaske/angry-ai](https://github.com/mbaske/angry-ai)
[ ](https://www.youtube.com/watch?v=_H11-7eXIko)
[https://github.com/mbaske/ml-table-football](https://github.com/mbaske/ml-table-football)
[ ](https://www.youtube.com/watch?v=gEf9V03HWv0)
[https://github.com/mbaske/ml-simple-driver](https://github.com/mbaske/ml-simple-driver)
[ ](https://www.youtube.com/watch?v=MKDBcKNJVS4)
[https://github.com/mbaske/ml-drone-collection](https://github.com/mbaske/ml-drone-collection)
---
### Author:  [@mbaske](https://discussions.unity.com/u/mbaske)
#### Post date: [November 16, 2020, 8:14pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/4 "2020-11-16T20:14:57Z")
[ ](https://www.youtube.com/watch?v=3-4_-FBDr8Q)
[ ](https://www.youtube.com/watch?v=B_cGPis6eDk)
---
### Author:  [@jeffrey\_unity538](https://discussions.unity.com/u/jeffrey_unity538)
#### Post date: [November 17, 2020, 10:09pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/5 "2020-11-17T22:09:04Z")
wow @mbaske !
---
### Author:  [@CallieChaos](https://discussions.unity.com/u/CallieChaos)
#### Post date: [December 29, 2020, 1:47am UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/6 "2020-12-29T01:47:17Z")
I’ve put together a project that makes the machine learning process into the game itself! I’ve set up a twitch stream where you can watch creatures learn to navigate their environment to reach an exit and bet game coins on which ones you think will make it the furthest. It’s running at [Twitch](https://twitch.tv/orbward)
---
### Author:  [@akTwelve](https://discussions.unity.com/u/akTwelve)
#### Post date: [December 29, 2020, 5:12am UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/7 "2020-12-29T05:12:10Z")
@mbaske Your project videos are always incredible. Also, that boxing match is hilarious!
---
### Author:  [@mbaske](https://discussions.unity.com/u/mbaske)
#### Post date: [December 29, 2020, 9:52am UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/8 "2020-12-29T09:52:33Z")
> [@akTwelve](#):
>
> @mbaske Your project videos are always incredible. Also, that boxing match is hilarious!
Thanks!
---
### Author:  [@Adam\_Streck](https://discussions.unity.com/u/Adam_Streck)
#### Post date: [January 2, 2021, 4:47pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/9 "2021-01-02T16:47:59Z")
Not as impressive as the above projects :), but I wrote a [tutorial on self driving car racing.](https://towardsdatascience.com/reinforcement-learning-a-self-driving-car-ai-in-unity-60b0e7a10d9e)
crazywastefulgiantschnauzer
(already made September 2019, I just updated it now to 1.0.0 ML-Agents).
---
### Author:  [@kodobolt](https://discussions.unity.com/u/kodobolt)
#### Post date: [January 4, 2021, 11:03am UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/10 "2021-01-04T11:03:53Z")
Hi everyone! I’ve been playing with ML agents again over the holidays and trying to see if I can build a small RTS game where units are trained agents.
Duel training with self-play:
[ ](https://www.youtube.com/watch?v=AZYF6ocxnno)
Resource gathering:
[![](https://europe1.discourse-cdn.com/unity/original/4X/f/1/4/f14501f68ba48e862787e39c27004ff26566fff5.jpeg "RL RTS - Basic resource gathering with "smell" maps") ](https://www.youtube.com/watch?v=JjV3GbrP6nI)
I’m experimenting with giving player control over high-level policies (e.g. which resource to gather, whether to prioritize attack or survival), curriculum learning (I’ve set up a system of lessons and scenarios to learn complex behavior step by step), various perception sensors (e.g. basic “range” sensor with OverlapSphere, “smell map” sensor with decaying influence that could give rough pathfinding data).
My overall goal is to build a small prototype/proof of concept to understand how RL can be part of a designer’s toolbox and learn best practices along the way.
I started looking into ML for Unity several years ago but had no time to fully flesh out something. I initially tried to set up my own interface to python, then the first version of ML-Agents came out but it was a bit rough around the edges. I’m very impressed with how far it has come and found it quite easy to understand and use. Thanks for making it!
---
### Author:  [@aureliantactics](https://discussions.unity.com/u/aureliantactics)
#### Post date: [January 19, 2021, 6:49pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/11 "2021-01-19T18:49:33Z")
I’m working on getting Unity ML to help train the AI for a tactics game (turn based strategy game). First I did TicTacToe. Code available on my [github](https://github.com/AurelianTactics/TictactoeUnityML).
Next I implemented a GridWorld mini-game in the game.
[ ](https://www.youtube.com/watch?v=IpHxccio_tg)
.
I tried to do a more advanced mini-game (one vs. one duel) but it ran way too slowly for the agent to learn anything. I’m working on speeding up the code. I can’t duplicate the game board and have many games run in parallel (like TicTacToe and the Unity examples) without a lot of changes to my code. I can get by without having to render anything so I’m trying to do some research to see how to go about creating a ‘fast’ mode to the game.
---
### Author:  [@Roboserg](https://discussions.unity.com/u/Roboserg)
#### Post date: [January 23, 2021, 5:52pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/12 "2021-01-23T17:52:52Z")
RoboLeague - a car soccer environment inspired by Rocket League for deep reinforcement learning experiments in an adversarial self-play setting. The project is open source - [GitHub - roboserg/RoboLeague: A car soccer environment inspired by Rocket League for deep reinforcement learning experiments in an adversarial self-play setting.](https://github.com/roboserg/RoboLeague)
udylxv
pq71qt
---
### Author:  [@dhyeythumar](https://discussions.unity.com/u/dhyeythumar)
#### Post date: [January 24, 2021, 7:54am UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/13 "2021-01-24T07:54:50Z")
Hi everyone! I am experimenting with ML-Agents on Unity’s Boat Attack environment. I have reduced the environmental objects for a smooth training process.
To project is open source and to get the assets and build versions of this environment, check out the following links:
Github env build repo - [GitHub - dhyeythumar/BoatAttack-with-ML-Agents-build-versions: This repo contains various build versions of my Boat Attack with ML-Agents repo.](https://github.com/Dhyeythumar/BoatAttack-with-ML-Agents-build-versions)
Github env assets repo - [GitHub - dhyeythumar/BoatAttack-with-ML-Agents: Applying ML-Agents to the Unity's Boat Attack env. ⛵️](https://github.com/Dhyeythumar/BoatAttack-with-ML-Agents)
Check out the following video of the trained agent:
[ ](https://www.youtube.com/watch?v=8N1f70Wxowk)
The following video contains the complete training process streamed from Google Colab to the twitch server:
[ ](https://www.youtube.com/watch?v=T0Oxb3aliwQ)
---
### Author:  [@mbaske](https://discussions.unity.com/u/mbaske)
#### Post date: [January 26, 2021, 11:50am UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/14 "2021-01-26T11:50:16Z")
Hi, you can now find updated “Angry AI” source files working with the latest (1.7.2-preview) ML-Agents release on Github.
The project uses imitation learning, multi-stage training, hierarchical/tiered agent control and grid sensor observations.
[https://github.com/mbaske/angry-ai](https://github.com/mbaske/angry-ai)
[ ](https://www.youtube.com/watch?v=7YYwERuy-w4)
---
### Author:  [@unity\_vS2z9d1vWrMH-Q](https://discussions.unity.com/u/unity_vS2z9d1vWrMH-Q)
#### Post date: [January 28, 2021, 9:37am UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/15 "2021-01-28T09:37:24Z")
WWWoooWW!! Great job guys! Here you are another one. An Air Hockey simulator with 12 brains trained using self-play. It is available in the play store.
[ ](https://www.youtube.com/watch?v=t1CuNx1JS14)
[https://play.google.com/store/apps/details?id=com.OnMyOwnStudio.AIAirHockey](https://play.google.com/store/apps/details?id=com.OnMyOwnStudio.AIAirHockey)
---
### Author:  [@Attack\_Potato](https://discussions.unity.com/u/Attack_Potato)
#### Post date: [February 1, 2021, 9:52pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/16 "2021-02-01T21:52:50Z")
I’ve been experimenting with agent flocking behaviors:
[ ](https://www.youtube.com/watch?v=LQCvZIkt7WM)
[Demo Link](https://attackpotatogames.itch.io/ml-agents-boids-fish)
---
### Author:  [@Attack\_Potato](https://discussions.unity.com/u/Attack_Potato)
#### Post date: [May 20, 2021, 12:54am UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/17 "2021-05-20T00:54:55Z")
[ ](https://www.youtube.com/watch?v=um7PkvgZj18)
Not the most advanced agents, but it works with raytracing.
[Download Link](https://attackpotatogames.itch.io/where-neon-goes-to-die)
---
### Author:  [@PinataMostGrim](https://discussions.unity.com/u/PinataMostGrim)
#### Post date: [May 29, 2021, 5:22pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/18 "2021-05-29T17:22:42Z")
There are some really cool projects in this thread 😄
@mbaske I’m a big fan of the exploration drone. It reminds me of the mapping drones in Prometheus, which I thought were the coolest thing when I saw it.
@aureliantactics A few of your Medium articles were really good references while I was learning to use the ML toolkit. Thanks for writing them!
Here are a few of the projects I’ve used ML-Agents for.
This is an agent that controls a physics-based MKV:
[ ](https://www.youtube.com/watch?v=xzUZWXadeDE)
Here is an agent that tries to use the MKV to intercept incoming projectiles:
[ ](https://www.youtube.com/watch?v=mB9eInHOBPE)
This one is a variation of Boids that tries to maintain a certain distance from a target point:
[ ](https://www.youtube.com/watch?v=o6D4PtzJhSI)
---
### Author:  [@flimflamm](https://discussions.unity.com/u/flimflamm)
#### Post date: [June 2, 2021, 7:24am UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/19 "2021-06-02T07:24:36Z")
A happy mile-stone in my un-named project; VR interaction with agents (even during live training!)
limpfilthyborer
aliveequatorialaddax
massivedecimalgrayling
Still massively unfinished, but I think this shows extreme promise.
---
### Author:  [@zeemanj](https://discussions.unity.com/u/zeemanj)
#### Post date: [August 24, 2021, 1:17pm UTC](https://discussions.unity.com/t/post-your-ml-agents-project/816756/20 "2021-08-24T13:17:07Z")
My first Unity project using ML-Agents.
The game is a agility game, where you have to try to get a ball into an arc by moving the board.
This can be very frustrating so I wanted to give it a try with Unity ML-Agents after following the excellent Hummingbirds tutorial by Immersive Limit LLC (see [ML-Agents: Hummingbirds - Unity Learn](https://learn.unity.com/course/ml-agents-hummingbirds)).
The agent moves the board, rotating it either to the left, right, forward or backward and gets a reward when a ball enters the arc.
**1 Ball**
After several tries I finally succeeded. ML-Agents is able to play the game, with 1 ball, in an average time of less then 6 seconds, amazing. See a video of a game at
[ ](https://www.youtube.com/watch?v=gKZBCa-mwug)
.
I learned to keep to rewards simpel, I started with a difficult reward schema but the Agent failed to learn.
The key to succes was to use the ‘Ray Perception Sensor 3D’ component. That made a huge difference for the better.
The training run of 4 million episodes takes about 1 hour on my machine.
**2 Balls**
Training (4 million steps) took 147 minutes. It takes the agent an average of 73 seconds.
See a video of a game at
[ ](https://www.youtube.com/watch?v=hMxvOkps6Cw)
(first win is at 00:11)
**3 Balls**
Training (12 million steps) took 500 minutes. It takes the agent an average of 1054 seconds to win.
See a video of a game at
[ ](https://www.youtube.com/watch?v=4n_t4zwsSpg)
. The first 00:05:30 are trimmed. The first win is at 00:10 (actual time at 05:40).
Not bad, but it would be nice to improve this. Still I can’t win the 3-ball game in less than this time, too frustrating. To improve the ML Agents performance in playing the game it may need a bit of curiosity.
The Unity project is at [GitHub - jpzpj/Unity-ML-Agility-Game: An agility game playable by Unity Machine Learning](https://github.com/jpzpj/Unity-ML-Agility-Game)
[Next page](https://discussions.unity.com/t/post-your-ml-agents-project/816756.md?page=2)