Resources

We are leading Task 1 on Subjectivity Detection at CheckThat! Lab, located in CLEF 2025.
See the previous edition for more information: https://checkthat.gitlab.io/clef2024/task2/

We invite you to participate in Task 1 (as well as other tasks in CheckThat!)!

• Task 1a: Multilingual Subjectivity Detection

  The task is to develop a binary classification system for subjectivity detection that covers several languages.

• Task 1b: Zero-shot Subjectivity Detection

  The classification model developed for Task 1a is evaluated on unseen languages.

There are many other international challenges held every year. Developing models and techniques to tackle past or ongoing challenges may be good proposals for project works.

• EVALITA

  Suite of tasks in Italian language. Examples: hate speech detection, sentiment analysis, identification of memes, "la ghigliottina" game.

• CLEF Labs

  The CLEF conference includes many multi-lingual and multi-modal activity proposals.
  Examples: math question answering, prediction of mental health issues, text simplification of scientific topics, retrieval of arguments, fact checking.

• Competition on Legal Information Extraction and Entailment (COLIEE)

  A set of tasks and challenges regarding NLP and legal documents.
  The intention is to build a community of practice regarding legal information processing and textual entailment, so that the adoption and adaptation of general methods from a variety of fields is considered, and that participants share their approaches, problems, and results.
  The tasks change every year.

• CliC-it Italian Conference on Computational Linguistics

  The spirit of the conference is inclusive. Recognizing the multifaceted nature of language phenomena and the need for interdisciplinary expertise, CLiC-it aims to bring together researchers from different fields including Computational Linguistics and Natural Language Processing, Linguistics, Cognitive Science, Machine Learning, Computer Science, Knowledge Representation, Information Retrieval, and Digital Humanities. CLiC-it welcomes contributions focusing on all languages, with a particular emphasis on Italian.

• SemEval International Workshop on Semantic Evaluation

  SemEval is a series of international natural language processing (NLP) research workshops whose mission is to advance the current state of the art in semantic analysis and to help create high-quality annotated datasets in a range of increasingly challenging problems in natural language semantics. Each year's workshop features a collection of shared tasks in which computational semantic analysis systems designed by different teams are presented and compared.