Please take two minutes to let us know what type of solution you plan to submit, and the type of HW and OS you plan to use. Open the survey here.
We are hard at work preparing the evaluation for the first round. We would like to ask you a couple of questions to have a better estimate of what to prepare for. We’d also like to share our plans so far. This description is just a preliminary plan. You will get detailed instructions soon enough.
The evaluation will run on one of two types of Azure VMs, either CPU-bound (with no GPU) or GPU-bound. We plan to run Linux-based solutions in Docker (nVidia Docker in case of GPU-bound VMs). The container will have an open port for access to the CommAI environment, and no access to the internet. The images will be self-contained without a need for external data.
On Windows the situation is different since nVidia Docker is not available there. Solutions using GPU will not be run in Docker. We have not yet decided about the CPU-bound Windows-based solutions. We will specify the details after we evaluate the survey linked above.