Abstract
A core research activity in many scientific domains concerns gathering data via questionnaire-based surveys. Meanwhile, annotation projects, that require input by field specialists, are invaluable in various research areas. Surveys and annotation projects share inherent similarities, since they both depend on participants who are prompted to answer a set of questions referring to particular artifacts (e.g., text segments). Both tasks are hindered by their dependence on volunteering, often requiring participants of a particular background, thus burdening research conductors to seek suitable ones. In this paper, we present SurvAnnT, a platform that facilitates the creation and management of surveys and annotation projects. SurvAnnT goes beyond existing tools offering customizable gamification aspects to motivate participation, as well as expert finding mechanisms to facilitate the identification of suitable participants.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
SurvAnnT: http://survannt.athenarc.gr.
- 2.
Source code: https://github.com/athenarc/SurvAnnT.
- 3.
Simple questionnaires are represented by null resources.
- 4.
Qualtrics Survey: https://www.qualtrics.com/.
- 5.
Amazon MTurk: https://www.mturk.com.
- 6.
Premise: https://www.premise.com/.
- 7.
Prolific: https://www.prolific.co/.
- 8.
Doccano: https://doccano.herokuapp.com/.
- 9.
Stall catchers: https://stallcatchers.com/about.
References
Allen, I.E., Seaman, C.A.: Likert scales and data analyses. Qual. Prog. 40(7), 64–65 (2007)
Chatzopoulos, S., Vergoulis, T., Dalamagas, T., Tryfonopoulos, C.: VeTo+: improved expert set expansion in academia. Int. J. Digit. Lib. 23(1), 57–75 (2021). https://doi.org/10.1007/s00799-021-00318-7
Jaradeh, M.Y., et al.: Open research knowledge graph: next generation infrastructure for semantic scholarly knowledge. In: Proceedings of the 10th International Conference on Knowledge Capture, K-CAP 2019, Marina Del Rey, CA, USA, 19–21 November 2019, pp. 243–246 (2019). https://doi.org/10.1145/3360901.3364435
Manghi, P., Bardi, A., Atzori, C., Baglioni, M., Manola, N., Schirrwagen, J., Principe, P.: The OpenAIRE research graph data model (2019). https://doi.org/10.5281/zenodo.2643199
Munro, R., et al.: Crowdsourcing and language studies: the new generation of linguistic data. In: NAACL Workshop on Creating Speech and Language Data With Amazon’s Mechanical Turk, pp. 122–130. Association for Computational Linguistics (2010)
Nidy, D.R.: QuickData: online survey creation and data collection. In: EdMedia+ Innovate Learning, pp. 3493–3498. Association for the Advancement of Computing in Education (AACE) (2005)
Nugent, J.: Game for good with stall catchers citizen science. Sci. Scope 42(7), 10–13 (2019). https://www.jstor.org/stable/26898936
Symonds, E.: A practical application of SurveyMonkey as a remote usability-testing tool. Lib. Hi Tech (2011)
Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., Su, Z.: ArnetMiner: extraction and mining of academic social networks. In: Proceedings of the 14th ACM SIGKDD, pp. 990–998. ACM (2008)
Williams, M., Peterson, G.M., Tenni, P.C., Bindoff, I.K.: A clinical knowledge measurement tool to assess the ability of community pharmacists to detect drug-related problems. Int. J. Pharm. Pract. 20(4), 238–248 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Tzerefos, A., Kanellos, I., Chatzopoulos, S., Dalamagas, T., Vergoulis, T. (2022). SurvAnnT: Facilitating Community-Led Scientific Surveys and Annotations. In: Silvello, G., et al. Linking Theory and Practice of Digital Libraries. TPDL 2022. Lecture Notes in Computer Science, vol 13541. Springer, Cham. https://doi.org/10.1007/978-3-031-16802-4_61
Download citation
DOI: https://doi.org/10.1007/978-3-031-16802-4_61
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16801-7
Online ISBN: 978-3-031-16802-4
eBook Packages: Computer ScienceComputer Science (R0)