On behalf of the Unity ML-Agents team, we want to wish everyone and their loved ones a happy holiday and new year! As we close out 2020, we wanted to take a moment to highlight a few of our favorite community projects in 2020, recap our progress since our v1.0 release (Release 1) in April 2020, and provide an overview of what’s in store for 2021.
Thank you to our entire community for all your contributions and feedback to the growth and evolution of the Unity ML-Agents Toolkit. We continue to be amazed by the creativity of our developers in illustrating new kinds of behaviors and approaches using deep learning. As we close out the year, we wanted to showcase some of our favorite projects in 2020. If you would like to share your projects, please share them in our forum. If you share your project on social media, remember to tag your posts using #mlagents.
From the virtual world to the real world and back into the virtual world. Created by LittleFrenchKev.
Illustration of an ML-Agents trained model being transferred into a real-life robot. Created by jsalli.
Release 1, which came out in April 2020, was heavily centered around API stability, ease of installation, and releasing a verified Unity package. Since Release 1, we have prioritized shipping incremental improvements and bug fixes on a monthly basis in order to improve the stability of existing features. All of the notes and documentation for these improvements and bug fixes can be found in the release notes here.
In addition to these improvements and bug fixes, we have also shipped several new features to support training intelligent Agents in Unity projects.
As part of our own internal research and development, we are constantly experimenting with new algorithms and approaches with different kinds of games. Specifically, those that we see get requested via GitHub issues or in the forums. To this end, we focus on specific tasks an Agent might need to perform in the context of real game situations. For example, we recently shipped a prototype Match-3 environment to illustrate how to represent the board as an observation in order for an Agent to play through different levels. We strongly believe in illustrating implementations of ML-Agents in specific types of game situations to help developers overcome the hurdles of getting it to work and accelerating the development of new algorithms and approaches that can benefit the entire community.
In the first half of 2021, we will be focusing on some specific algorithmic improvements
Throughout 2021, we will be releasing these algorithmic improvements on GitHub and illustrating them through a cooperative shooter demo game. If you are interested in these algorithmic improvements, please post a request on GitHub.
Training Agents using the ML-Agents Toolkit requires experimentation to ensure that you've set-up the environment and training configurations correctly. This experimentation can be time-consuming and computationally expensive to complete locally on a regular laptop or desktop machine. To help alleviate this, as we announced in our v1.0 blog post, we've been working on a cloud service for ML-Agents training. This cloud service would enable you to kick-off multiple training sessions in parallel that run on our cloud infrastructure. This would enable you to complete your experimentation in a significantly shorter period of time. More specifically, ML-Agents Cloud has three key benefits:
Today, we currently have an alpha program for a handful of select Unity ML-Agents users. The alpha version of Unity ML-Agents cloud training core functionality includes:
In 2021, we plan to further accelerate the development of cloud training for Unity ML-Agents in order to improve and ultimately make available the service for all users. If you are interested to sign up to be considered for the alpha program, please sign up here.
If there are additional features or game genres that you are interested in, please post a feature request on GitHub.
If you use any of the features provided in this release, we’d love to hear from you. For any feedback, general issues, or questions regarding ML-Agents, please get in touch with us on the ML-Agents forums or email us directly. If you encounter any bugs, please reach out to us on the ML-Agents GitHub issues page.
If you’d like to work on this exciting intersection of machine learning and games, check out our current openings.