- Public Test: This phase evaluates algorithms on the REFinD public test set where the references are available.
A submission needs to consist of results on the entire public test set to be considered as a valid submission.
The leaderboard for the public test set is hosted here on Codalab.
- Private Test: This phase evaluates algorithms on the REFinD private test set with all references heldout.
A submission needs to consist of results on the entire test set to be considered as a valid submission.
This phase is aimed at the final evaluation of the model and one is not allowed to create multiple submissions using multiple teams.
The final evaluation of the model will be based on the results on the private test set.
Please first submit your results to both leaderboards.
To be eligible for result archives and consideration for awards, we kindly request you to send the following information to akshat.x.gupta@jpmorgan.com using your main contact email:
- Team name.
- Team members.
- The username used in CodaLab submissions.
- The forum link to your paper submission on Openreview and the link to your arxiv submission.
Dual Sumbission: We also allow submissions that are under review in other venues or have preprint versions. But please make sure to follow dual submission policies from other venues.
Non-Archival: The paper submission will be non-archival. The winners can present their work at the workshop.
Anonymity Period: We do not enforce an anonymity period. We allow preprint servers such as arXiv at any point of time.
Submission Format and Link: All submissions must be in PDF format and follow the current
ACM two-column conference format, i.e. it should be no longer than 4 pages(including references, proofs, and appendixes). Submission will be accepted via
Microsoft CMT. Please submit non-anonymised versions of the paper to the provided submission link.
