ARDUOUS 2025 : 9th International Workshop on Annotation of Real World Data for Artificial Intelligent Systems
Link: https://arduous.eu
When October 25 – 30, 2025 (exact date TBA)
Where ECAI’25, Bologna, Italy
Submission Deadline May 20, 2025
Notification Due July 11, 2025
Final Version Due July 24, 2025
The field of Artificial Intelligence (AI) has seen a rapid development in the last years with a huge increase in the consumption of data and in the recognition of its influence on the developed AI systems. To address this shift from knowledge-based to data-driven AI systems development, the ARDUOUS workshop series explore various topics in data annotation for AI applications. Well-annotated data powers developments in many fields of AI such as training models in machine learning, computer vision, and natural language processing, learning representations in knowledge representation and reasoning or planning and search, and plays an important role in validating knowledge-based systems. Furthermore, ensuring the involvement of the relevant stakeholders increases the fairness, ethics and trust in the annotations and ultimately in the resulting AI systems.
We aim to bring together researchers from the AI community who work on topics addressing the challenges involved in producing reliable and quality-assured annotation. We encourage researchers within the community to share their experience of 1) the role and impact of annotations in designing and validating AI applications, 2) the process of labelling, and the requirements to produce high quality annotations for diverse settings and tasks, 3) innovative tools, interfaces and automated methods for annotating data, 4) methods for standardisation and normalisation in annotation practices, and 5) novel topics and approaches in this field.
Relevant topics include but are not limited to:
- processes of and best practices in annotating data for AI systems
- AI methods towards automation of the annotation process
- experiences of the development, validation and sharing of data annotation protocols
- ensuring compliance with relevant legislation and best practice when building or applying ground truths
- human-centred and human-in-the-loop approaches to designing and deploying AI systems
- low-resource annotation workflows
- the role of annotation and its effects in ensuring fairness, ethics and trust in AI
- annotation evaluation metrics: inter-indexer consistency, similarity, bias and subjectivity
Submission guidelines:
The proceedings will be published in the Communications in Computer Science and Information Science Springer series: https://www.springer.com/series/7899
Format:
For your submission you should use one of the following dedicated templates:
- (.doc format) https://resource-cms.springernature.com/springer-cms/rest/v1/content/19238706/data/v5
- (LaTex) https://resource-cms.springernature.com/springer-cms/rest/v1/content/19238648/data/v8
The papers should not exceed the following page limits including references:
- Full paper: 12 pages
- Short paper: 8 pages
- Poster and demo paper: 3 to 5 pages
Submission: through the EasyChair submission system [Link TBA]
Review process: the review process will be double blind
Important dates:
Submission deadline: May 11, 2025
Notification: July 11, 2025
Camera ready version: July 24, 2025
Workshop: October 25 – 30, 2025 (exact data TBA)
The 9th International Workshop on Annotation of Real World Data for Artificial Intelligent Systems is held as part of the European Conference on Artificial Intelligence (ECAI) 2025 in Bologna, Italy https://ecai2025.org/workshops/
Organising committee:
Gregory Tourte, University of Oxford, UK
Kristina Yordanova, University of Greifswald, DE
Emma Tonkin, University of Bristol, UK
If you have any questions, please, do not hesitate to contact us at organizers@arduous.eu