Welcome to the Adversarial Examples Challenge!

These Terms and Conditions ("Terms") apply to the Adversarial Examples Challenge sponsored by Google Inc. (the "Competition"). Please read these Terms carefully as they form a binding legal agreement between you and the Competition Sponsor.

COMPETITION SPONSOR: Google Inc., located at 1600 Amphitheatre Parkway, Mountain View, CA 94043, United States ("Google") with respect to the Competition.

COMPETITION HOST/AKA "Competition Website": kaggle.com

YOU MAY NOT SUBMIT AN ENTRY TO A COMPETITION UNLESS YOU AGREE TO THESE TERMS. YOUR SUBMISSION OF AN ENTRY IN A COMPETITION CONSTITUTES YOUR AGREEMENT TO THESE TERMS.

The words "include" and "including" as used in these Terms mean "including but not limited to."

1. Eligibility.
1. 1.1 VOID WHERE PROHIBITED. The Competition is void in Crimea, Cuba, North Korea, Syria, (due to OFAC restrictions), and Quebec, for example, where prohibited by law. Please check your local laws before entering.
2. 1.2 NO PURCHASE NECESSARY TO ENTER OR WIN. You do not need to purchase any Google product or service to enter or win the Competition.
3. 1.3 Ineligible Individuals.
  1. (A) You cannot participate in the Competition if you are, and will be immediately disqualified and forfeit all of your prizes if you become:
    1. (1) a resident of Crimea, Cuba, North Korea, Syria, (due to OFAC restrictions), and Quebec, for example, or anywhere where the Competition is prohibited by law;
    2. (2) restricted by applicable export controls and sanctions programs;
    3. (3) a current employee (including intern), contractor, officer, or director, of Google or its affiliates; or
    4. (4) an immediate family member (including a parent, sibling, child, spouse, or life partner regardless of where you live) of one of the individuals listed in subsection (3) above or you are a member of their household (whether related or not).
  2. (B) However, Section 1.3(A)(3) above does not apply if you are a Google Student Ambassador (whether paid or not) and you may participate in the Competition.
4. 1.4 Requirements to Enter.
5. 1.5 Verifying Eligibility. Google reserves the right to verify your eligibility and to adjudicate on any dispute at any time. You agree to provide Google with any proof of eligibility requested by Google and your refusal or failure to provide such proof within 10 days of Google's request will result in your disqualification from the Competition and forfeiture of any prizes.
6. 1.6 Communications. All communications between Google and you, including the Competition Website and email communications, will be in English.
2. How to Enter.
1. 2.1 Registration. To enter the Competition, you must register at the Competition Website and provide the required information about yourself.
  1. (A) Registration times are listed on the Competition Website. YOU ARE RESPONSIBLE FOR DETERMINING THE CORRESPONDING TIME IN YOUR TIME ZONE.
  2. (B) You may only register for the Competition with one valid email address. If you compete in the same Competition with multiple email addresses, you will be disqualified.
2. 2.2 Screen Names. Google reserves the right to change or omit participant screen names or nicknames for purposes of publication on Google websites or listserv, particularly if they are, in Google's sole opinion, obscene or violate the intellectual property rights of others.
3. Competition Structure.
1. 3.1 Overview. The competition is divided into three separate tasks. Participants can enter either or all tasks. One task is to provide a machine learning classifier that can correctly classify adversarial examples. The second task is to provide an algorithm for generating adversarial examples that cause a machine learning classifier to misclassify its input. The third task is to provide an algorithm for generating adversarial examples that are incorrectly recognized as belonging to a "target" class specified by the user of the algorithm.
2. 3.2 Submissions. You must submit your solutions for problems through the Competition Website.
  1. (A) Your submission must be in the format specified by the task, the Competition Website, and these Terms (with precedence given in that order). Deliberately obfuscated source code is not allowed.
  2. (B) Solutions submitted after the applicable deadline will not be accepted.
3. 3.3 Modifying the Competition. Google may cancel or modify the structure, location, and times of the Competition to run the Competition in accordance with these Terms or to prevent an unfair result.
4. Judging and Scoring. The solutions you submit will be judged as follows.
1. 4.1 Points. Each submission will earn a certain number of points.
  1. (A) For the adversarial example classification task, all submissions will be shown the same set of input images. Each correctly classified image is worth one point. If the classifier fails to return a prediction for an image, it receives no points for that image.
  2. (B) For the untargeted adversarial example generation task, each adversarial example generation algorithm will be asked to create the same amount of adversarial examples. Each example will be presented to the same set of classifiers. The submission is awarded one point for each classifier that misclassifies the example. If the adversarial example generation algorithm fails to create an image, it receives no points for the requested image. If any classifier fails to return a prediction for any image, no points will be awarded to any attack algorithm for that classifier.
  3. (C) For the targeted adversarial example generation task, each adversarial example will be asked to create the same amount of adversarial examples and for each target label. Each example will be presented to the same set of classifiers. The submission is awarded one point for each classifier that classifies the image with the chosen target class. If the adversarial example generation algorithm fails to create an image, it receives no points for the requested image. If any classifier fails to return a prediction for any image, no points will be awarded to any attack algorithm for that classifier.
2. 4.2 Ranking Participants.
  1. (A) Highest Score First. Participants will be ranked in order of the highest score first and lowest score last. A separate ranking will be prepared for each of the three tasks.
  2. (B) Ties Ranked by Submission Time. In the event of a tie between participants, the one with the earliest submission time will be ranked first while the one with the latest submission time will be ranked last. We reserve the right to break ties when necessary based on finer time precision than is specified on the scoreboard.
5. Notice of Winners.
1. 5.1 Announcement of Winners. The results of the Participant will be posted on the Competition Website after its completion. Posted results will include a list of the participants' names or nicknames in ranked order based on their scores.
6. Disqualification.
1. 6.1 You may be disqualified from the Competition and forfeit any prizes you may be eligible to receive if Google reasonably believes that you have attempted to undermine the legitimate operation of the Competition, including:
  1. (A) Providing false information about yourself during registration or concerning your eligibility;
  2. (B) Breaching or refusing to comply with these Terms;
  3. (C) Tampering or interfering with administration of the Competition or with the ability of other participants to participate in the Competition;
  4. (D) The Competition administrators determine that you have failed to comply with the Competition Rules. This determination is at their sole discretion.
  5. (E) Submitting content that:
    1. (1) violates the rights of a third party,
    2. (2) is lewd, obscene, pornographic, racist, sexist, or otherwise inappropriate to the Competition, or
    3. (3) violates any applicable law; or
  6. (F) Threatening or harassing other participants or Google, including its employees and representatives. Harassing behavior includes, offensive, threatening, and/or hateful comments directed toward an individual or protected class (gender, sexual orientation, disability, gender identity, age, race, religion, ethnicity, veteran status), the use or display of sexual images in public spaces, deliberate intimidation, stalking, following, taking unwelcome photos/videos, sustained disruption of talks or other events, inappropriate physical contact, unwelcome sexual attention, and developing and/or promoting any applications designed to encourage any of these behaviors.
2. 6.2 You may report to Google at adversarial-examples-competition@google.com any harassment, cheating, or violation of these Terms by another participant. Google may investigate any such allegations and all decisions by Google in these matters are final and binding. If you are asked to stop any harassing behavior, you are expected to comply immediately.
7. Ownership; Rights in Your Submissions; Privacy.
1. 7.1 License to Use Content; Reservation of Rights. You may use the data and content made available on the Competition Website solely to prepare for and compete in the Competition. Google retains all rights in such code and content not explicitly granted by these Terms.
2. 7.2 Ownership of Submissions. You retain all rights to your submissions of output files and source code that you had before submitting them to the Competition.
3. 7.3 License to Submissions. For any submission you make to the Competition, you grant Google a non-exclusive, worldwide, perpetual, irrevocable, free license (with the right to sublicense) to reproduce, prepare derivative works of, distribute, publicly perform, publicly display, and otherwise use such submission. Your submitted source code may be made available for anyone to view on the Internet and download and use at the end of the Competition.
4. 7.4 Open Source Release. You agree to release an open source version of any submission under one of the following open source licenses: Apache 2.0, BSD, LGPL, or MIT.
5. 7.5 Privacy.
  1. (A) How Google May Use Your Information.
    1. (1) Google will use the information you provide during registration and in any subsequent communications to administer the Competition (including verifying your eligibility to participate in the Competition and delivering prizes). This data may be transferred into the United States and will be maintained in accordance with Google's Privacy Policy.
    2. (2) By accepting a prize, you agree that Google and its agents may use your name, likeness, and statements without compensation to promote the Competition, including displaying it on the Competition Website.
  2. (B) Sharing Your Information. Your name and username you create during registration may be displayed publicly on the Competition Website. If you win a prize, Google may share your name and address with third parties to fulfill awarding a prize to you.
  3. (C) Accessing Your Information. You may access, review, and update any of your personal data held by Google in connection with the Competition by emailing adversarial-examples-competition@google.com.
  4. (D) Permission to Record You. If you participate in the presentation of competition results at NIPS, you give permission to Google to make and have made audio, visual, and audiovisual recordings (in any format or media) of you and your activity on a computer while you are participating in the Competition (the "Recordings") and grant Google an unrestricted, sublicensable, transferable, perpetual, irrevocable, worldwide, free license to use the Recordings to promote the Competition, including broadcasting it live. You waive all rights, including any right of prior approval, and release Google and its agents from, and will neither sue nor bring any proceeding against Google or its agents for, any claim or cause of action, whether now known or unknown, for defamation, copyright infringement, and invasion of the rights to privacy, publicity, or personality or any similar matter, or based upon or relating to the use and exploitation of the Recordings.
8. Your Representations, Warranties, Indemnities.
1. 8.1 Representations and Warranties. You represent and warrant that:
  1. (A) the information you provide about yourself while registering or in subsequent communications with Google is truthful and accurate;
  2. (B) except as permitted by these Terms, your submissions to the Competition are original and not created with the assistance of any information about the problems not provided by Google;
  3. (C) you own all rights in your submissions or otherwise have the right to submit your submissions to Google and grant to Google the licenses granted in these Terms without violating any rights of any other person or entity or any obligation you may have with them; and
  4. (D) your submissions do not violate any applicable laws.
2. 8.2 Indemnities. You will indemnify Google and its affiliates, directors, officers, employees against all liabilities, damages, losses, costs, fees (including legal fees), and expenses relating to any allegation or third-party legal proceeding to the extent arising from:
  1. (A) your acts or omissions in relation to the Competition (including your use or acceptance of any prize and your breach of these Terms); and
  2. (B) your submissions violating any rights of any other person or entity or any obligation you may have with them.
9. Disclaimers. THE COMPETITION WEBSITE AND ALL CONTENT (INCLUDING SOURCE CODE) IS PROVIDED ON AN "AS IS" AND "AS AVAILABLE" BASIS. GOOGLE DISCLAIMS ALL REPRESENTATIONS AND WARRANTIES (EXPRESS OR IMPLIED), INCLUDING ANY WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. GOOGLE IS NOT RESPONSIBLE FOR ANY INCOMPLETE, FAILED, OR DELAYED TRANSMISSION OF YOUR APPLICATION INFORMATION OR SUBMISSIONS DUE TO THE INTERNET, INCLUDING INTERRUPTION OR DELAYS CAUSED BY EQUIPMENT OR SOFTWARE MALFUNCTION OR OTHER TECHNICAL PROBLEMS. YOU USE ALL SOURCE CODE AVAILABLE ON THE COMPETITION WEBSITE AT YOUR OWN RISK.
10. General.
1. 10.1 Not an Offer or Contract Of Employment.
  1. (A) You acknowledge that your participation is voluntary.
  2. (B) You acknowledge that no confidential, fiduciary, agency or other relationship or implied-in-fact contract now exists between you and Google and that no such relationship is established by your submission of an entry to the Competition.
  3. (C) You understand and agree that nothing in these Terms, any Rules, a submission into the Competition, or an award of a prize may be construed as an offer or contract of employment with Google.
2. 10.2 Severability. If any term (or part of a term) of these Terms is invalid, illegal or unenforceable, the rest of the rules will remain in effect.
3. 10.3 Translations. In the event of any discrepancy between the English version of these Terms and a translated version, the English version will govern.
4. 10.4 Governing Law. ALL CLAIMS ARISING OUT OF OR RELATING TO THESE TERMS WILL BE GOVERNED BY CALIFORNIA LAW, EXCLUDING CALIFORNIA'S CONFLICT OF LAWS RULES, AND WILL BE LITIGATED EXCLUSIVELY IN THE FEDERAL OR STATE COURTS OF SANTA CLARA COUNTY, CALIFORNIA, USA; THE PARTIES CONSENT TO PERSONAL JURISDICTION IN THOSE COURTS.

Competition Rules

Please read carefully the Adversarial Examples Challenge Terms and Conditions, Google's general Privacy Policy, and these Rules for the 2017 Adversarial Examples Challenge (described below and referred to as the "Rules"), and all of which together are referred to as the "Terms", as they form a binding legal agreement between you and Google Inc. with respect to the 2017 Google Adversarial Examples Challenge.

1. Age. You may participate in the Competition only if you are 16 years of age or older at the time of registration.
2. Registration. Registration for the Competition opens on TBD and ends on Sunday, October 1, 2017 at 23:59 UTC.
3. Competition Structure. The Competition consists of three competition tracks: Defense, Nontarget Attack, and Targeted Attack.
1. 3.1 Adversarial Example Challenge Structure.
  1. (A) Submission: All submissions must be uploaded by October 1, 2017 at 23:59 UTC.
  2. (B) Evaluation and Scoring: All submissions will be evaluated and scored after the October 1 deadline. See the Terms and Conditions for a specification of the scoring criteria.
4. Submissions.
1. 4.1 Submitting Solutions for Adversarial Example Challenge tasks. For Adversarial Example Challenge tasks, you must submit through the Competition Website a source code of the solution with necessary data files in the format specified by provided examples in Development Toolkit.
  1. (A) Submission Requirements. You must submit source code and data files as one zipped file. The size of the submission may not exceed 1GB, and the total size of your source code for an output after being unzipped may not exceed 2GB.
  2. (B) Runtime requirement. During final evaluation your solution will be run by organizers inside an isolated Docker container. You may chose any publicly available Docker container (subject to the requirements below) to be used to run your submission. Organizers will impose following requirements on your submission:
    1. (1) Runtime requirement: Your solution will have to process a batch of 100 images within a 120 seconds time frame which includes any initialization or setup time. Any results not written by the end of this time limit will be regarded as failed.
    2. (2) Participant is responsible for ensuring that their solution can run on a machine with 24GB of RAM. This includes the runtime requirement of the solution itself and any overhead caused by the Docker container of their choice.
    3. (3) Your solution can not use any network interaction.
    4. (4) Organizers will provide one GPU accelerator (a single card within a two-card NVIDIA Tesla K80 board) which will be attached to the Docker container running the solution. Participants are welcome to take advantage of the provided GPU accelerator; however it’s their responsibility to ensure that Docker container of their choice provides proper support of GPU.
    5. (5) The image of the chosen Docker container may not exceed 8GB after installation.
  3. (C) Submission Errors and Discrepancies. The organizers may notify you that a submission was malformed and that you may submit again in whatever time remains before the deadline. This is at the organizer's discretion; malformed inputs may also simply receive a low score.
5. Winner Invitation to Present at NIPS.
1. 5.1 Invitation to Present at NIPS. There are no money prizes for this Competition. Winners will be invited to present how their solution works at NIPS. Attendance at NIPS is not required to win.
2. 5.2 Travel Expenses and Arrangements. Attendees are responsible for their own travel expenses and arrangements for attending NIPS, including NIPS registration fee, visa, passport, flights, meals and accommodations.
3. 5.3 TRAVEL DISCLAIMER. YOU UNDERSTAND AND AGREE THAT TRAVEL CONTAINS SOME INHERENT ELEMENT OF RISK OF ACCIDENT, ILLNESS, INJURY, LOSS OR DEATH. IN NO EVENT WILL GOOGLE, ITS AFFILIATES, OR AGENTS, BE LIABLE FOR ANY HARM, DAMAGE, CLAIM, LOSS OR OTHER ACTION ARISING OUT OF YOUR TRAVEL TO OR FROM NIPS.
6. Disqualification.
1. 6.1 You may be disqualified if:
  1. (A) You fail to respond to any request for information from Google related to the competition within 5 days of Google's request; or
  2. (B) You fail to comply with the above rules and regulations.