Birds of a Feather: ACL 2025

En esta sesión presentaremos SomosNLP, la comunidad dedicada a crear y compartir recursos que impulsan y aceleran el desarrollo del PLN en lenguas de Iberoamérica. Iberoamérica se refiere a los países de América donde se habla español o portugués, e incluye también a España y Portugal. Nuestro objetivo es conectar con personas de la comunidad para explorar de forma colaborativa los retos actuales del campo. Nuestro objetivo es crear un espacio dinámico para compartir conocimientos, aprender de experiencias diversas y diseñar soluciones innovadoras en conjunto. ¡Queremos que nos acompañes en esta misión! Las personas que hablan lenguas menos representadas son especialmente bienvenidas a sumarse y contribuir a este diálogo multilingüe y emocionante. ¡Estamos deseando conocerte! ✨

Nesta sessão, vamos apresentar a SomosNLP, a comunidade dedicada a criar e compartilhar recursos que impulsionam e aceleram o desenvolvimento do PLN em línguas ibero-americanas. No uso cotidiano, Ibero-América refere-se aos países das Américas onde se fala espanhol ou português, incluindo também a Espanha e Portugal. Nosso objetivo é conectar pessoas da região para, de forma colaborativa, explorar os desafios atuais da área. Estamos criando um espaço dinâmico para compartilhar conhecimento, aprender com experiências diversas e construir soluções inovadoras em conjunto. Queremos que você se junte a nós nessa missão! Falantes de línguas menos representadas são especialmente bem-vindos para contribuir com este diálogo multilingue e vibrante. Estamos ansiosos para te conhecer! ✨

Main

• “ConLoan: A Contrastive Multilingual Dataset for Evaluating Loanwords”,Sina Ahmadi, Micha David Hess, Elena Álvarez-Mellado, Alessia Battisti, Cui Ding, Anne Göhring, Yingqiang Gao, Zifan Jiang, Andrianos Michail, Peshmerge Morad, Joel Niklaus, Maria Christina Panagiotopoulou, Stefano Perrella, Juri Opitz, Anastassia Shaitarova, Rico Sennrich

• “Evaluating Multimodal Language Models as Visual Assistants for Visually Impaired Users”,Antonia Karamolegkou, Malvina Nikandrou, Georgios Pantazopoulos, Danae Sanchez Villegas, Phillip Rust, Ruchira Dhar, Daniel Hershcovich, Anders Søgaard

• “Evaluating Sequence Labeling on the basis of Information Theory”,Enrique Amigo, Elena Álvarez-Mellado, Julio Gonzalo, Jorge Carrillo-de-Albornoz

• “La Leaderboard: A Large Language Model Leaderboard for Spanish Varieties and Languages of Spain and Latin America”,María Grandury, Javier Aula-Blasco, Júlia Falcão, Clémentine Fourrier, Miguel González Saiz, Gonzalo Martínez, Gonzalo Santamaria Gomez, Rodrigo Agerri, Nuria Aldama García, Luis Chiruzzo, Javier Conde, Helena Gomez Adorno, Marta Guerrero Nieto, Guido Ivetta, Natàlia López Fuertes, Flor Miriam Plaza-del-Arco, María-Teresa Martín-Valdivia, Helena Montoro Zamorano, Carmen Muñoz Sanz, Pedro Reviriego, Leire Rosado Plaza, Alejandro Vaca Serrano, Estrella Vallecillo-Rodríguez, Jorge Vallego, Irune Zubiaga

• “Learning to Reason Over Time: Timeline Self-Reflection for Improved Temporal Reasoning in Language Models”,Adrián Bazaga, Rexhina Blloshmi, Bill Byrne, Adrià de Gispert

• “Robust Estimation of Population-Level Effects in Repeated-Measures NLP Experimental Designs”,Alejandro Benito-Santos, Adrian Ghajari, Víctor Fresno

• “Rolling the DICE on Idiomaticity: How LLMs Fail to Grasp Context”,Maggie Mi, Aline Villavicencio, Nafise Sadat Moosavi

• “Rubrik’s Cube: Testing a New Rubric for Evaluating Explanations on the CUBE dataset”,Diana Galvan-Sosa, Gabrielle Gaudeau, Pride Kavumba, Yunmeng Li, Hongyi gu, Zheng Yuan, Keisuke Sakaguchi, Paula Buttery

• “Truth Knows No Language: Evaluating Truthfulness Beyond English”,Blanca Calvo Figueras, Eneko Sagarzazu, Julen Etxaniz, Jeremy Barnes, Pablo Gamallo, Iria de-Dios-Flores, Rodrigo Agerri

• “Using Humor to Bypass Safety Guardrails in Large Language Models”,Pedro Cisneros-Velarde

Findings

• “Biases in Opinion Dynamics in Multi-Agent Systems of Large Language Models: A Case Study on Funding Allocation”,Pedro Cisneros-Velarde

• “Dynamic Knowledge Integration for Evidence-Driven Counter-Argument Generation with Large Language Models”,Anar Yeginbergen, Maite Oronoz, Rodrigo Agerri

• “Metaphor and Large Language Models: When Surface Features Matter More than Deep Understanding”,Elisa Sanchez-Bayona, Rodrigo Agerri

• “Multilingual Definition Modeling”,Edison Marrese-Taylor, Erica K. Shimomoto, A. Solano, Enrique Reid

• “When AI Writes Like Humans: Capturing the Emergent Patterns of Literary Judgment via Intrinsic Textual Metrics”,Guillermo Marco, Julio Gonzalo, Víctor Fresno, Juan-Luis Suárez

CL

• “Investigating Idiomaticity in Word Representations”,Wei He, Tiago Kramer Vieira, Marcos Garcia, Carolina Scarton, Marco Idiart, Aline Villavicencio

GEM2 Workshop: Generation, Evaluation & Metrics

• “Psycholinguistic Word Features: a New Approach for the Evaluation of LLMs Alignment with Humans”,Javier Conde, Miguel González Saiz, María Grandury, Pedro Reviriego, Gonzalo Martínez, Marc Brysbaert

Student Research Workshop

• “Beyond the Gold Standard in Analytic Automated Essay Scoring”,Gabrielle Gaudeau (mentored by Diana Galvan-Sosa)

Workshop on Gender Bias in Natural Language Processing (GeBNLP)

• “Colombian Waitresses y Jueces canadienses: Gender and Country Biases in Occupation Recommendations from LLMs”,Elisa Forcada Rodríguez, Olatz Perez-de-Viñaspre, Jon Ander Campos, Dietrich Klakow, Vagrant Gautam

• “Introducing MARB — A Dataset for Studying the Social Dimensions of Reporting Bias in Language Models”,Tom Södahl Bladsjö, Ricardo Muñoz Sánchez

Workshop on Online Abuse and Harms (WOAH)

• “Are You Trying to Convince Me or Are You Trying to Deceive Me? Using Argumentation Types to Identify Deceptive News”,Ricardo Muñoz Sánchez, Emilie Francis, Anna Lindahl

Workshop on Fact Extraction and Verification (FEVER)

• “Portuguese Automated Fact-checking: Information Retrieval with Claim Extraction”,Juliana Gomes, Eduardo Garcia, Arlindo R. Galvão Filho

The 19th Workshop on Semantic Evaluation (Semeval-2025)

• “LATE-GIL-NLP at SemEval-2025 Task 11: Multi-Language Emotion Detection and Intensity Classification Using Transformer Models with Optimized Loss Functions for Imbalanced Data”,Jesus Vázquez-Osorio, Helena Gómez-Adorno, Gerardo Sierra, Vladimir Sierra-Casiano, Diana Canchola-Hernández, José Tovar-Cortés, Roberto Solís-Vilchis, Gabriel Salazar