CheckThat! 2025 - Task 1 on Subjectivity Detection: Instructions for Annotators

Official repository containing information for instructing annotators on subjectivity detection on news articles

Objective

Our objective is to collect and annotate sentences from news articles to build a secret test set for the CLEF shared task on subjectivity detection.

We need you!

We kindly invite you and your team to help us collect and annotate a small dataset (~300 sentences) in a specific language where you have proficiency (e.g. your native one).

Where to start?

• Read documents/Instructions.pdf for collecting data for annotation.
• Read documents/Guidelines.pdf for annotation.

How to contribute?

Contact our team via email (see Contact section) and specificy how many annotators you have available and the language you aim to cover. Please, use the following template to contact us:

To: [email protected]; [email protected]; [email protected]
Subject: [CheckThat! 2025 - Task 1] Annotation Proposal

Body:

Dear organizers,
We would like to contribute to the shared task as follows:

Language: XXX
Team: 
	Name Surname Affiliation
	Name Surname Affiliation
	...

Best,
Your signature

Important Dates

Internal deadline for corpus annotation: 17 March 2025. CheckThat! 2025 deadline for test data release: Mid-April 2025.

Support

If you have no experience in crawling news articles or programming, send us an email with the list of identified news articles and their URL. We will provide you with the crawled news articles for annotation.

Contact

• Federico Ruggeri
• Katerina Korre
• Arianna Muti