Skip to content
BY-NC-ND 4.0 license Open Access Published by De Gruyter Open Access July 25, 2018

Automated testing environment and assessment of assignments for Android MOOC

  • Matej Madeja EMAIL logo and Jaroslav Porubän
From the journal Open Computer Science

Abstract

This paper describes the design of a testing environment for massive assessment of assignments for Android application programming courses. Specific testing methods and tool suggestions are continuously consulted with Wirecard company, dedicated to the development of mobile applications. The paper also analyzes the most common mistakes of students and suggests ways to uncover them through tests. Based on these, it creates tests, compares the performance of the emulator and real device tests, and the proposed tools are partially retrospectively tested on assignments from the previous run of a particular Android application programming course. From partial results the paper suggests changes for the course in relation to the testing environment and deploys it in the background of the course alongside the manual evaluation. It describes testing experience, analyzes the results and suggests changes for the future

References

[1] Meeker M., INTERNET TRENDS 2017, Technical report, CODE CONFERENCE, 2017Search in Google Scholar

[2] StatCounter, Operating System Market Share Worldwide, 2017, http://gs.statcounter.com/os-market-share#monthly-201101-201708Search in Google Scholar

[3] Esposito J., et al., Mobile Application Development, volume 3, DZone, 2016Search in Google Scholar

[4] Cook M., The 50 Most Popular MOOCs of All Time, 2015, http://www.onlinecoursereport.com/the-50-most-popularmoocs-of-all-time/Search in Google Scholar

[5] Coursera Inc., Courses and Specializations, 2017, https://www.coursera.org/courses?fifacetfichanged_=true&domains=computer-science&languages=en&query=androidSearch in Google Scholar

[6] edX Inc., Android Courses Search, 2017, https://www.edx.org/ course?search_query=androidSearch in Google Scholar

[7] Madeja M., Innovative approaches in introductory programming courses, Master’s thesis, Technical university of Košice, 2015Search in Google Scholar

[8] Domin C., Pohl H., Krause M., Improving plagiarism detection in coding assignments by dynamic removal of common ground, In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’16), ACM, New York, NY, USA, 2016, 1173-1179, DOI 10.1145/2851581.289251210.1145/2851581.2892512Search in Google Scholar

[9] Mann S., Frew Z., Similarity and Originality in code: plagiarism and normal variation in student assignments, In: Proceedings of the 8th Australasian Conference on Computing Education - Volume 52, ACE ’06, Australian Computer Society, Inc., Darlinghurst, Australia, Australia, 2006, 143-150Search in Google Scholar

[10] Munir H., Wnuk K., Petersen K., Moayyed M., An experimental evaluation of test driven development vs. test-last development with industry professionals, In: Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering (EASE ’14), ACM, New York, NY, USA, 2014, 50, 1- 50:10, DOI 10.1145/2601248.260126710.1145/2601248.2601267Search in Google Scholar

[11] Madeja M., Porubän P., Automatic assessment of assignments for Android application programming courses, In: Novitzká V., Korecko Š., Szakál A. (Eds.), 2017 IEEE 14th International Stientific Conference on Informatics, IEEE, 2017, 232-23710.1109/INFORMATICS.2017.8327252Search in Google Scholar

[12] Mondal S., Vrushabendrappa L., Android Application Development, 2017, https://www.springboard.com/learning-paths/android/Search in Google Scholar

[13] Schmidt D. C., et al., Launch your Android app development career, 2017, https://www.coursera.org/specializations/androidapp- developmentSearch in Google Scholar

[14] Catalán A., Branagan N., Anzueto F., Professional Android app development, 2017, https://www.edx.org/course/professionalandroid- app-development-galileox-caad003xSearch in Google Scholar

[15] Pecinovský R., Zadávání a vyhodnocování úkolů pri výuce OOP, in Počítačve škole 2007, Amaio Technologies, Inc, Pocítac ve škole, Nové Mesto na Morave, Czech Rep., 2007, 1-4Search in Google Scholar

[16] Sugrue J., et al., Automated testing, volume 1, DZone, 2017Search in Google Scholar

[17] Souce Labs, Mobile app testing: Main challenges, different approaches, one solution, DZone, 2017Search in Google Scholar

[18] Adamsen C. Q., Mezzetti G., Møller A., Systematic execution of Android test suites in adverse conditions, In: Proceedings of the 2015 International Symposium on Software Testing and Analysis (ISSTA 2015), ACM, New York, NY, USA, 2015, 83-93, DOI 10.1145/2771783.277178610.1145/2771783.2771786Search in Google Scholar

[19] Amen B., Mahmood S., Lu J., Mobile application testing matrix and challenges, Computer Science & Information Technology, 2015, 5Search in Google Scholar

[20] Akourm M., Falah B., Al-Zyoud A. A., Bouriat S., Alemerien K., Mobile software testing: thoughts, strategies, challenges, and experimental study, International Journal of Advanced Computer Science and Applications, 2016, 7(6), DOI 10.14569/IJACSA.2016.07060210.14569/IJACSA.2016.070602Search in Google Scholar

[21] Wang Y., Alshboul Y., Mobile security testing approaches and challenges, 2015 First Conference on Mobile and Secure Services (MOBISECSERV), IEEE, 2015, DOI 10.1109/MOBISECSERV. 2015.707288010.1109/MOBISECSERV.2015.7072880Search in Google Scholar

[22] Muccini H., Francesco A. D., Esposito P., Software testing of mobile applications: Challenges and future research directions, In: 2012 7th International Workshop on Automation of Software Test (AST), 2012, 29-35, DOI 10.1109/IWAST.2012.622898710.1109/IWAST.2012.6228987Search in Google Scholar

[23] Gupta S., Dubey S. K., Automatic assessment of programming assignment, In: Meghanathan N., et al (Eds.), ITCS, SIP, JSE- 2012, CS & IT 04, 2012, 315-323, DOI 10.5121/csit.2012.212910.5121/csit.2012.2129Search in Google Scholar

[24] Wilcox C., Testing strategies for the automated grading of student programs, In: Proceedings of the 47th ACM Technical Symposium on Computing Science Education (SIGCSE ’16), ACM, New York, NY, USA, 2016, 437-442, DOI 10.1145/2839509.284461610.1145/2839509.2844616Search in Google Scholar

[25] Rajala T., Kaila E., Lindén R., Kurvinen E., Lokkila E., Laakso M. J., Salakoski T., Automatically assessed electronic exams in programming courses, In: Proceedings of the Australasian Computer Science Week Multiconference (ACSW’16), ACM, New York, NY, USA, 2016, 11, 1-11:8, DOI 10.1145/2843043.284306210.1145/2843043.2843062Search in Google Scholar

[26] Akahane Y., Kitaya H., Inoue U., Design and evaluation of automated scoring: Java programming assignments, International Journal of Software Innovation, 2015, 3(4), 18-32, DOI 10.4018/IJSI.201510010210.4018/IJSI.2015100102Search in Google Scholar

[27] guru99.com, Complete Guide to Android Testing & Automation, 2017, https://www.guru99.com/why-android-testing.htmlSearch in Google Scholar

[28] Wasserman A. I., Software engineering issues for mobile application development, In: Proceedings of the FSE/SDP Workshop on Future of Software Engineering Research (FoSER ’10), ACM, New York, NY, USA, 2010, 397-400, DOI 10.1145/1882362.188244310.1145/1882362.1882443Search in Google Scholar

[29] Lewis W. E., Software Testing and Continuous Quality Improvement, Third Edition, Auerbach Publications, Boston, 3rd edition, 2008Search in Google Scholar

[30] Greb C., The 3 tiers of the Android test pyramid, 2016, https://medium.com/android-testing-daily/the-3-tiers-of-theandroid- test-pyramid-c1211b359acdSearch in Google Scholar

[31] Google Inc., Test Your App, 2017, https://developer.androidcom/studio/test/index.htmlSearch in Google Scholar

[32] Madeja M., Testing of applications for OS Android,Master’s thesis, Technical University of Košice, 2017Search in Google Scholar

[33] Smith R., Tang T., Warren J., Rixner S., An Automated system for interactively learning software testing, In: Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE ’17), ACM, New York, NY, USA, 2017, 98-103, DOI 10.1145/3059009.3059022.10.1145/3059009.3059022Search in Google Scholar

Received: 2018-02-23
Accepted: 2018-05-30
Published Online: 2018-07-25

© 2018 Matej Madeja and Jaroslav Porubän, published by De Gruyter

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Downloaded on 2.6.2024 from https://www.degruyter.com/document/doi/10.1515/comp-2018-0007/html
Scroll to top button