EPIC-Kitchens Challenges @CVPR2019, Long Beach, CA - Dates

Challenges Guidelines

The three challenges below and their test sets and evaluation servers are available via CodaLab. The leaderboards will decide the winners for each individual challenge. When comparing to state of the art (i.e. in papers), results should be reported on bot test sets (S1 and S2) via submitting your predictions to the evaluation server.

For each challenge, the CodaLab server page details submission format and evaluation metrics. To enter any of the three competitions, you need to register an account for that challenge using a valid institute (university/company) email address. A single registration per research team is allowed. For all challenges the maximum sumissions per day is limited to 1.

To submit your results, follow the JSON submission format, upload your results and give time for the evaluation to complete (in the order of several minutes). After the evaluation is complete, the results automatically appear on the public leaderboards but you are allowed to withdraw these at any point in time.

To participate in the challenge, you need to have your results on the public leaderboard, along with an informative team name (that represents your institute or the collection of institutes participating in the work), as well as brief information on your method. You are also required to submit a report on your method (in the form of 2-6 pages) to the EPIC@CVPR workshop by June 7th, detailing your entry's technical details.

To submit your technical report, use the CVPR 2019 camera ready author kit (no blind submission), and submit a report of 2-6 pages inclusive of any references to the EPIC@CVPR2019 CMT3 website. Please select the track "EPIC-Kitchens 2019 Challenges - Technical Papers" when submitting your pdf. These technical reports will be combined into an overall report of the EPIC-Kitchens challenges.

Make the most of the starter packs available with the challenges, and should you have any questions, please use our info email uob-epic-kitchens2018@bristol.ac.uk

Frequently Asked Questions

• Q. Who is allowed to participate?
  A. Any researcher, whether in academia or industry, is invited to participate in the EPIC-Challenges. We only request a valid official email address, associated with an institution, for registraton. This ensures we limit the number of submissions per team. Do not use your personal email for registration. You registration request will be declined without further explanation.
• Q. Can I participate in more than one challenge? Do I need to register separately for each challenge?
  A. Yes, and yes. You can participate in all three challenges but you need to register separately for each. Winners for each challenge will be announced and there will be no 'overall' winner across challenges.
• Q. Can I get additional submission limits to debug my file format?
  A. No. Please check your format in advance. We do not offer additional allowance for submission failures.
• Q. Can I participate in the challenge but not submit a report describing my method?
  A. We do not allow that option. Entries to the challenge will only be considered if a technical report is submitted on time. This should not affect later publications of your method if you restrict your report to 4 pages including references.
• Q. Should I disclose the team's name on the public leaderboard?
  A. Yes, you need to have a team name that represents your institution before the server's closing time.
• Q. What happens after the server closes?
  A. We will close the test server after the deadline and until the workshops, but open it again later for normal submissions of future papers.
• Q. Are there any prizes given?
  A. No. You will be issued a certificate should you be one of our top-3 winners in any of the three challenges.
• Q. Can I add other members to my team?
  A. Yes you can.
• Q. Is the submission limit for the user or for the team?
  A. For the team.
• Q. Can you give me access to features of pre-trained models of baselines?
  A. No, we are not giving pre-trained models for this version of the challenge.