7 May 2018, Phoenix Seagaia Resort, Miyazaki (Japan)
It is our pleasure to announce the Games and Gamification for NLP (Games4NLP) workshop hosted at the 11th edition of the Language Resources and Evaluation Conference (LREC), 7-12 May 2018, Miyazaki (Japan).
The Games4NLP workshop aims to promote and explore the possibilities for research and practical applications of using games and gamification for the creation of language resources for Natural Language Processing. The main objective is to provide a forum for researchers and practitioners to discuss and share ideas regarding how the NLP research community can benefit from using game and gamification strategies.
The potential topics of interest include, but are not limited to:
- Games for collecting data useful for NLP (games in planning, under development, or deployed);
- Games for under-resourced languages such as many Asian languages;
- Analysis of game data from established games;
- Gamification of NLP tasks (techniques, best practice and evaluation of gamification strategies);
- Player motivation and experience (strategies for recruitment/retention and player profiling);
- Game design (conceptual design elements and reports of success and/or failure of designs);
- Processing NLP game data (aggregation methods and strategies for minimising noise and cheating);
- Use of NLP game data (how game-generated data has been used for NLP applications);
- Evaluation of games for NLP (metrics for evaluating game performance, evaluating player performance, motivation and bias, and evaluating task difficulty);
- Directive strategies that attempt to use game metrics in real-time.
The workshop will be an interactive and dynamic full-day event that will be a mix of keynotes, paper and demo presentations as well as discussion sessions. The workshop will be held on Monday 7 May 2018 in the Phoenix Seagaia Resort, Miyazaki (Japan).
** Workshop Fee Waiver **We can offer a fee waiver to one student attendee to the workshop. To qualify, please email you name, course, university, and a short paragraph why you would like to attend the workshop to firstname.lastname@example.org, we will inform the successful applicant by the end of April.
09:00-09:10 Introduction by Workshop Chair 09.10-10.30 Session 1 (Chair: Karën Fort) Invited talk: Did you also spend the last weekend playing your NLP game? (Ivan Habernal) Faseeh: A Serious Game for Arabic Syn-onym Acquisition (Hend Al-Khalifa, Hadil Faisal and Rawan N. Al-Matham) Testing TileAttack with Three Key Audiences (Chris Madge, Massimo Poesio, Udo Kruschwitz and Jon Chamberlain) 10:30-10.50 Coffee break 10.50-11.50 Session 2 (Chair: Jon Chamberlain) LieCatcher: Game Framework for Collecting Human Judgments of Deceptive Speech (Sarah Ita Levitan, James Shin, Ivy Chen and Julia Hirschberg) Cheap, fast and good! Voting Games with a Purpose (Karën Fort, Mathieu Lafourcade and Nathalie Le Brun) The JeuxDeMots Project is 10 Years Old: what Assessments? (Alain Joubert, Mathieu Lafourcade and Nathalie Le Brun) 12.30-12.50 Project Updates enetCollect COST Action (Verena Lyding and Lionel Nicolas) Lingo Boingo (Christopher Cieri) 12.50-13.00 Concluding Remarks by Workshop Chair
Invited talk: Did you also spend the last weekend playing your NLP game? (Dr Ivan Habernal)
Serious games for NLP are believed to be a win-win situation: people enjoy playing a game and NLP researchers get their annotated data for free. But how come that only few of them succeed and hit their target audience even though they are elaborated and well-designed? In this talk, I will first review the landscape of current games for NLP and will present our attempt for a game from the perspective of the shoemaker's children who go barefoot. However, I will try to show that "pivoting" the product, starting asking the right questions, and leveraging human natural abilities might be a game changer! What if the answers are already out there but not yet in our Games4NLP community?
Dr Ivan Habernal is a postdoctoral researcher at UKP, Technische Universität Darmstadt. His main research interests are computational argumentation and argument mining, as well as Web corpora, serious games, and sentiment analysis. He has published numerous papers at major NLP venues (ACL, EMNLP, NAACL, LREC, Computational Lingustics) and recently co-chaired the 4th Workshop on Argument Mining co-located with EMNLP'17 in Copenhagen. Currently, he is the main organizer of the SemEval 2018 Task: The Argument Reasoning Comprehension Task, co-located with NAACL'18.
Submissions will be in the form of an extended abstract of a maximum 4 pages length (references excluded) and be formatted as a PDF. The submissions are NOT anonymous, in other words, there will be NO blind review.
When submitting a paper from the START page, authors will be asked to provide essential information about resources (in a broad sense, i.e. also technologies, standards, evaluation kits, etc.) that have been used for the work described in the paper or are a new result of your research. Moreover, ELRA encourages all LREC authors to share the described LRs (data, tools, services, etc.) to enable their reuse and replicability of experiments (including evaluation ones)
Describing your LRs in the LRE Map is now a normal practice in the submission procedure of LREC (introduced in 2010 and adopted by other conferences). To continue the efforts initiated at LREC 2014 about "Sharing LRs" (data, tools, web-services, etc.), authors will have the possibility, when submitting a paper, to upload LRs in a special LREC repository. This effort of sharing LRs, linked to the LRE Map for their description, may become a new "regular" feature for conferences in our field, thus contributing to creating a common repository where everyone can deposit and share data.
As scientific work requires accurate citations of referenced work so as to allow the community to understand the whole context and also replicate the experiments conducted by other researchers, LREC 2018 endorses the need to uniquely Identify LRs through the use of the International Standard Language Resource Number (ISLRN, www.islrn.org), a Persistent Unique Identifier to be assigned to each Language Resource. The assignment of ISLRNs to LRs cited in LREC papers will be offered at submission time.
Accepted papers will be a maximum 8 pages long (references excluded) and be published in LREC'18 proceedings.
Important datesEXTENDED DEADLINE: 22 January 2018 (11:59pm Hawaii Standard Time)
Notification of acceptance: 8 February 2018
Final program: 2 March 2018
Workshop date: Monday 7 May 2018
For all enquiries, please contact email@example.com
- Jon Chamberlain (University of Essex, UK)
- Udo Kruschwitz (University of Essex, UK)
- Karën Fort (Université Paris-Sorbonne, France)
- Chris Cieri (Linguistic Data Consortium, University of Pennsylvania, US)
- Richard Bartle (University of Essex, UK)
- Johan Bos (University of Groningen, Netherlands)
- Eric de la Clergerie (INRIA, France)
- James Fiumara (Linguistic Data Consortium, University of Pennsylvania, US)
- Bruno Guillaume (Inria Nancy Grand Est, France)
- Ivan Habernal (Technische Universität Darmstadt, Germany)
- Frank Hopfgartner (University of Glasgow, UK)
- Michael Meder (TU Berlin, Germany)
- Mathieu Lafourcade (LIRMM, France)
- Verena Lyding (EURAC, Italy)
- Lionel Nicolas (EURAC, Italy)
- Massimo Poesio (Queen Mary University, UK)
- Pontus Stenetorp (University College London, UK)
Games4NLP held an independent symposium co-located with the 15th European Chapter of the Association for Computational Linguistics (EACL) Conference in April 2017 in Valencia, Spain.