Welcome

Welcome to the Machine Learning Security Evasion Competition, sponsored by Microsoft and partners CUJO AI, NVIDIA, VMRay, and MRG Effitas.
Please find the official results of the MLSEC 2021 at https://cujo.com/announcing-the-winners-of-the-2021-machine-learning-security-evasion-competition/.

Getting Started

Visit the GitHub project for detailed information.

This contest involves functional malicious binaries. By participating, you agree to the terms of service.

Join our Slack channel!

Dates

• [Defender Challenge]: Jun 15 – Jul 23, 2021 AoE*
• [Attacker Challenge]: Aug 06 – Sep 17, 2021 AoE

*all times are Anywhere on Earth (AoE)

Resources

Attacker Challenge

• register/login to download malware samples
• extend the sample solution that leverages Microsoft Counterfit
• download and setup (with disabled networking) a free Windows 10 Virtual Machine for use over 90 days to validate that your samples are functional
• check out our API documentation

Prizes

Prizes are detailed in the contest rules. Briefly, they include:

• Defender Challenge
  1. First Place: Microsoft Gift Card valued at $1800 USD
  2. Honorable Mention: Microsoft Gift Card valued at $300 USD
• Attacker Challenge: Anti-Malware Evasion
  1. First Place: Microsoft Gift Card valued at $1800 USD
  2. Honorable Mention: Microsoft Gift Card valued at $300 USD
  3. Bonus Prize: Microsoft Gift Card valued at $300 USD
• Attacker Challenge: Anti-Phishing Evasion
  1. First Place: Microsoft Gift Card valued at $1800 USD
  2. Honorable Mention: Microsoft Gift Card valued at $300 USD
  3. Bonus Prize: Microsoft Gift Card valued at $300 USD

Judging criteria

Judging criteria are detailed in the contest rules. First Place and Honorable mentioned prizes will be awarded to the highest- and second-highest ranking entries, respectively, as determined by these criteria:

• Defender Challenge
  • highest true positive rate when deployed in the Attacker Challenge
  • the solution must also satisfy modest (<1%) FP requirements
• Attacker Challenge: Anti-Malware and Anti-Phishing Evasion
  • most number of evasions against defensive countermeasures
  • fewest number of model queries breaks a tie
  • submission time breaks any subsequent tie

One Bonus Prize for each track of the Attacker Challenge will be awarded to the highest-ranking solution (existing winner or not) that extends Counterfit to automate the attack solution.


Prizes are awarded only for a published solution. For full details, refer to the contest rules.