DSM evaluation

Large-Scale Evaluation of Distributional Semantic Models

A research project by Gabriella Lapesa (U Stuttgart, FAU Erlangen-Nürnberg, U Osnabrück) and Stefan Evert (FAU Erlangen-Nürnberg).

Lapesa, Gabriella and Evert, Stefan (2014). A large scale evaluation of distributional semantic models: Parameters, interactions and model selection. Transactions of the Association for Computational Linguistics 2, 531–545.
☞ supplementary materials (PDF)
Lapesa, Gabriella and Evert, Stefan (2017). Large-scale evaluation of dependency-based DSMs: Are they worth the effort? In Proceedings of the 15th Annual Meeting of the European Association for Computational Linguistics (EACL 2017): Volume 2, Short Papers, pages 394–400, Valencia, Spain.
☞ supplementary materials (PDF)
Evert, Stefan (2014). Distributional semantics in R with the wordspace package. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: System Demonstrations, pages 110–114, Dublin, Ireland.
☞ R package – tutorial & data sets

Santus, Enrico; Gladkova, Anna; Evert, Stefan; Lenci, Alessandro (2016). The CogALex-V shared task on the corpus-based identification of semantic relations. In Proceedings of the 5th Workshop on Cognitive Aspects of the Lexicon (CogALex-V), pages 69–79, Osaka, Japan.
☞ CogALex-V shared task
Lapesa, Gabriella; Schulte im Walde, Sabine; Evert, Stefan (2014). Judging paradigmatic relations: A collection of ratings for English. Poster at Architecture and Mechanisms of Language Processing (AMLAP-2014), Edinburgh, UK.

Evert, Stefan (2016). CogALex-V shared task: Mach5 – a traditional DSM approach to semantic relatedness. In Proceedings of the 5th Workshop on Cognitive Aspects of the Lexicon (CogALex-V), pages 92–97, Osaka, Japan.
☞ implementation & experiments
Lapesa, Gabriella; Evert, Stefan; Schulte im Walde, Sabine (2014). Contrasting syntagmatic and paradigmatic relations: Insights from distributional semantic models. In Proceedings of the Third Joint Conference on Lexical and Computational Semantics (*SEM 2014), pages 160–170, Dublin, Ireland.
Lapesa, Gabriella and Evert, Stefan (2014). NaDiR: Naive distributional response generation. In Proceedings of the 4th Workshop on Cognitive Aspects of the Lexicon (CogALex), pages 50–59, Dublin, Ireland.
Lapesa, Gabriella and Evert, Stefan (2013). Evaluating neighbor rank and distance measures as predictors of semantic priming. In Proceedings of the ACL Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2013), pages 66–74, Sofia, Bulgaria.

Evert, Stefan and Lapesa, Gabriella (2017). Modelling free associations with co-occurrence data. Invited presentation in the symposium From computational modelling to behavior via multimodal corpus data: integrative approaches to the study of semantic representation and processing at ICPS 2017, Vienna, Austria.
Lapesa, Gabriella; Schulte im Walde, Sabine; Evert, Stefan (2014). Judging paradigmatic relations: A collection of ratings for English. Poster at Architecture and Mechanisms of Language Processing (AMLAP-2014), Edinburgh, UK.