Games4NLP: Using Games and Gamification for Natural Language Processing

Symposium description

Games4NLP is an independent symposium co-located with the 15th European Chapter of the Association for Computational Linguistics (EACL) Conference that will take place on April 3-7, 2017 in Valencia, Spain.

The Games4NLP symposium aims to promote and explore the possibilities for research and practical applications of using games and gamification for Natural Language Processing (NLP). The main objective is to provide a forum for researchers and practitioners to discuss and share ideas regarding how the NLP research community can benefit from using game/gamification strategies. For example, games can be used to collect large numbers of annotations of human language provided that there are sufficient numbers of players who are motivated to play, and these annotations, when aggregated, can be used as labels that replace or compliment the effort of expert annotators. The symposium welcomes the participation of both academics and industry practitioners interested in the use of games and gamification for NLP.

This symposium is aimed at researchers interested in using games and gamification to collect language data and to connect a community who are already developing and maintaining such games.

Attendance to the workshop if free; however, all attendees must register using the Eventbrite page. Registration to EACL is not required.

The potential topics of interest include, but are not limited to:

The symposium will feature presentations of works-in-progress and best practice from researchers using games and gamification for Natural Language Processing tasks. Workshop presentations will be grouped into themes such as player motivation, game design, using data generated by games and measuring game performance. Key note speakers to be announced soon.


Games4NLP will be held in the Las Arenas/El Perellonet rooms (2nd floor) of the Sercotel Sorolla Palace Hotel in Valencia, Spain. Map.


1030-1100 Coffee

1100-1110 Welcome - Massimo Poesio

1110-1230 Games under development (Session chair: Jon Chamberlain)
uComp Language Quiz - A Game with a Purpose for Multilingual Language Resource Acquisition (Arno Scharl and Michael Föls)
Testing game mechanics in games with a purpose for NLP applications (Chris Madge, Udo Kruschwitz, Jon Chamberlain, Richard Bartle and Massimo Poesio)
Curating an Open Information Extraction Knowledge Base Using Games with a Purpose (Kevin Forand and Philippe Langlais)

1230-1250 Panel - Challenges of Games for NLP

1250-1400 Lunch and Demos

1400-1520 Player motivation (Session chair: Pontus Stenetorp)
Who wants to play Zombie? A survey of the players on ZOMBILINGO (Karën Fort, Bruno Guillaume and Nicolas Lefebvre)
Why do we Need Games? Analysis of the Participation on a Crowdsourcing Annotation Platform (Alice Millour and Karën Fort)
An Exploratory Study of Data Quality and Participation in a Games-for-Science Game Community (Jason Radford and David Lazer)

1520-1550 Coffee break and Demos

1550-1710 Game evaluation (Session chair: Massimo Poesio)
Making NLP games fun to play using Free to Play mechanics: RoboCorp case study (Dagmara Dziedzic and Wojciech Włodarczyk)
Metrics of games-with-a-purpose for NLP applications (Jon Chamberlain, Richard Bartle, Udo Kruschwitz, Chris Madge and Massimo Poesio)
Towards a Word Sheriff 2.0: Lessons learnt and the road ahead (Galen Han, Mark Menezes, Leah Halaseh, Jędrzej Stuczyński, Daniele Menara, Sebastian Riedel and Pontus Stenetorp)

1710-1730 Panel - Future directions for Games for NLP

1730-1740 Closing comments - Jon Chamberlain



Program committee:


The symposium is inviting extended abstract submissions (2 pages maximum, including references) of proposals for talks, demos and posters.

Submissions must be in PDF, and must conform to the official style guidelines for EACL 2017. Submissions do not need to be anonymised. We ask you to use the EACL-2017 LaTeX template or adapt the Overleaf template for those less familiar with LaTex.

Accepted submissions will be made available electronically on this website.

Please email your submission to by Monday 27 February 2017.