Timeline
Working Note Paper Instructions

Timeline

  • 07 Oct 2021: Release of first lab flyer and Call for Participation.
  • 15 Nov 2021: Lab registration opens (link).
  • 15 Nov 2021 - 6 May 2022: Evaluation Campaign.
  • 06 Dec 2021: First sample data released.
  • 15 Feb 2022: Release of train and dev data.
  • 22 Apr 2022: Lab registration closes.
  • 26 Apr 2022, 10:00 CEST: Test data release for task bundles 1 to 4.
  • 29 Apr 2022, 23:59 CEST: Task bundles 1 to 4 system responses due.
  • 04 May 2022, 10am: Test data release for bundle 5 (i.e. mention boundaries).
  • 06 May 2022, noon: Transmission of results to each participating team for bundles 1-4.
  • 06 May 2022, 23:59-> 09 May 2022, 6pm: Task bundle 5 system responses due.
  • 10 May 2022, 12:00-> 11 May 2022, noon: Transmission of bundle 5 results to teams.
  • 11 May 2022, 12:00-> 12 May 2022, noon: Publication of results and of test data.
  • 27 May 2022, 23:59->30 May 2022, 23:59: Submission of participant Working Note.
  • 27 May – 13 June 2022: Review process of WN papers.
  • 06 June 2022, 23:59: Submission of condensed lab overview (by organisers).
  • 13 June 2022: Notification of acceptance (WN and condensed lab overview).
  • 20 June 2022, 23:59: Camera-ready copy of condensed lab overview (by organisers).
  • 01 July 2022, 23:59: Camera-ready copy of WN (part.) and extended lab overview (org.).
  • 18-22 July 2022: WN paper preview for checking by authors and lab organizers.
  • 05-08 Sept 2022: CLEF 2022 Conference.

All times are CEST.

Working Note Paper Instructions

As with all CLEF 2022 Labs, HIPE-2022 Working Note papers will be published in the CEUR-WS.org proceedings.

Complete instructions for authors are now posted on the CLEF-20222 website, and we highlight the main points below.

About

Working note papers are technical reports written in English which describe your system and the conducted experiments. They should provide, at least, the following information:

  • Title, Authors, Affiliations, Email addresses of all authors.
    • Body of text. This should contain information on:
    • tasks performed
    • main objectives of experiments
    • approach(es) used and progress beyond baselines or state-of-the-art
    • resources employed
    • results obtained. Please report on test sets, and if suitable also on dev sets. The organizer’s overview paper will focus on the best run per team. Your system paper might report on your individual runs in more detail.
    • analysis and discussion of the results
    • perspectives for future work
  • In order to support replicability, we encourage you - whenever possible - to publish:
    • your code on a public repository with associated license
    • any additional resource you might have used.

Bibliographic references for the datasets, the HIPE-2022 introduction, and previous HIPE 2020 publications can be found here: https://github.com/hipe-eval/HIPE-2022-data#references.

For an example of Working Note papers, see e.g. the HIPE-2020 papers.

Formatting

The papers must be formatted according to http://127.0.0.1:4000/HIPE-2022/ available at here, either using Word or Latex one column templates. These templates are pre-filled with the copyright box with the appropriate information about CLEF 2022.

http://127.0.0.1:4000/HIPE-2022/: no upper page limit is set, as papers are published only electronically, but experience teaches that overwhelmingly long papers are not effective. We would expect something between 6 to 10 pages (excluding references).

Submission

Submission of papers is to be done electronically at: https://easychair.org/conferences/?conf=clef2022.
When submitting, select the HIPE track; in case you participated in both NERC and EL tasks, just select one (no matter which).

The metadata of easychair submission will be used for preparing final Working Notes. Please pay attention to insert correct information at submission time in easychair. All the data inserted in Easychair should match exactly the data in the PDF of the paper (correct and complete author names, authors listed in the correct order, and a correct paper title).

The copyright form can be downloaded here. Please note that it is mandatory to print the form, sign it by hand, and upload a scan of the signed physical copyright form.

BACK TO TOP