Introduction

Whereas reported educational statistics show a gap between non-native (EFL) and native (non-EFL) English speakers’ literacy and numeracy test performance (Department of the Prime Minister and Cabinet 2018; National Assessment Program 2015; The Nation’s Report Card 2015), recent research in linguistics underscores the misleading nature of such comparisons. While native speakers as a group usually outperform non-native speakers (Somers 2017; Fleckenstein et al. 2016), there is high intragroup variability (Dąbrowska 2019; Hulstijn 2019). EFL students’ proficiency in social, economic and academic English literacy makes them competitive against native English speakers in the global job market (Fleckenstein et al. 2016). Consequently, most of the differences in academic performance observed in both native and EFL speakers can be attributed to education (Dąbrowska 2019).

This research sought to explore pedagogical practices that could bridge the gap in native and EFL speakers’ disciplinary literacy in science, technology, engineering and mathematics (STEM) disciplines. This is because STEM subjects pose additional challenges for both EFL and non-EFL students. Specifically, the complexity of the academic language and lack of authentic learning experiences frequently prevent students from drawing connections between school and their everyday life (González-Howard and McNeill 2016; González-Howard et al. 2017; Grandinetti et al. 2013; Stevenson 2015; Zhang 2016).

The current Kyrgyzstani study explored how a digital storytelling (DST) or video-production (Angay-Crowder et al. 2013; Rubino et al. 2018) teaching approach might enhance EFL students’ learning and promote their astronomy (STEM-A) disciplinary literacy acquisition. It was the extension of the Australian study, the Indigenous Sky Stories (ISS) program, conducted with Australian primary school students aged 10–12 years (Ruddell et al. 2016). In the ISS program, astronomy served as a context for learning where local Indigenous and western scientific perspectives were brought together in the classroom to create a cultural ‘middle ground’ (Aikenhead 1996; Nakata 2018; Ruddell et al. 2016). This study demonstrated how an integrated curriculum could engage students in scientific inquiry and encourage active shared knowledge construction (Ruddell et al. 2016). The Kyrgyzstani study was conducted with EFL students aged 10–16 years and used the same astronomy teaching materials as the ISS program (Ruddell et al. 2016), but also included a collaborative videomaking educational technology intervention.

This article compares differences in astronomy disciplinary literacy acquisition between Kyrgyzstani students who had DST as part of an educational technology enhanced design with Australian students who completed the same astronomy course intervention, but were not engaged in making videos. The guiding research questions for this analysis were: Does DST influence the EFL students’ astronomy disciplinary literacy development in English? If “yes”, how does this happen?

Bridging literacy and science education

Several decades of studying the role of a language in learning and teaching across various content areas have resulted in a ‘cross-border dialogue’ that bridges literacy and science education research internationally (Díaz Pérez et al. 2018; Fujimoto-Adamson and Adamson 2018; Morton 2018; Tang et al. 2018). The acknowledgment of the role of disciplinary literacy in science triggered the emergence of English for Specific Purposes (ESP) courses. ESP courses required English language teachers to deliver STEM content-related English (Yang 2016). However, language teachers struggled with adopting this approach as they did not have enough understanding of the disciplinary discourse related to the subject content knowledge (Arno-Macia and Mancho-Bares 2015; Morton 2018).

Consequently, Content and Language Integrated Learning (CLIL) programmes emerged. Initially, CLIL programmes were responding to the needs of the globalised job market and addressed the growing diversity of students in modern classrooms around the globe (Madrid and Cañado 2018; Yang 2016). It resulted in CLIL becoming a broad term referring to any classroom setting where a subject was taught in a language other than the students’ native language (Díaz Pérez et al. 2018; Yang 2016). CLIL programmes were readily embraced in North America and many European countries (Tang et al. 2018; Yang 2016) and enabled the content instructors in these countries to adopt the teaching approaches developed by the language instructors (Díaz Pérez et al. 2018; Jendrych 2013).

In general, CLIL research has reported positive outcomes (Somers 2017). However, a recent large-scale CLIL program evaluation in Spain revealed a lack of key egalitarianism or social inclusion principals essential to CLIL education (Cañado 2018). CLIL materials and teaching resources were also criticised for their lack of authenticity and scarce integration of technology (Cañado 2018), highlighting the importance of inclusiveness and authenticity in teaching content knowledge to EFL students (Cañado 2018; Darío 2014).

Disciplinary literacy in science as a social practice

One of the main criticisms of science lessons is that students can not establish a link between lessons and their everyday real life contexts (Aikenhead 1998; González-Howard and McNeill 2016; Meyer and Crawford 2015). Conventional science education usually adheres to didactic or knowledge transmission pedagogies and does not prioritise students’ engagement in learning (González-Howard and McNeill 2016; González-Howard et al. 2017; Haydock 2011; Meyer and Crawford 2015; Zhang 2016), whereas research suggests that EFL students’ literacy development requires students to question their current knowledge and extend and adapt it to other contexts (Angay-Crowder et al. 2013).

The interdisciplinary collaboration encouraged by the CLIL programmes faciliatated a shift towards the recognition of literacy as a ‘form of social practice’ rather than the linguistic medium for delivering scientific concepts to students (Díaz Pérez et al. 2018; Tang et al. 2018). Recognising disciplinary literacy as a sociocultural phenomenon implies that learning is the outcome of engagement in various activities contextualised within social settings. Tytler et al. (2018) argue that science literacy development requires students to explore diverse representations of scientific concepts. By creating and critiquing various representations of science concepts such as a model to represent the cause of day and night, students develop a meta-representational competence and deepen their awareness about the concept (Tytler et al. 2018).

When working in groups, students exchange their interpretations of a given phenomenon and thus construct shared knowledge (Van Aalst 2009). Hence, social interactions and ongoing negotiation of concepts within the ‘community of practice’ results in a deeper understanding of a concept (Lave and Wenger 1991; Mercieca 2017; Wegner and Nückles 2015).

Indigenous sky stories project

The Journey through Space and Time (JTST) resource package was designed as a remedy for disengaged primary school students and their teachers in learning science (McKinnon and Geissinger 2002). This educational package (McKinnon 2013) contained support resources for teaching astronomy, differentiated for teachers’ diverse experience and content knowledge in the area. The JTST became the key component for the Australian educational project Indigenous Sky Stories (ISS) (Ruddell et al. 2016). Besides supplying the participating schools with an 8-inch reflecting telescope, an iPad mini with preinstalled Stellarium planetarium software, inquiry-based learning and teaching resources, and professional training with ongoing support for the teachers to assist with project implementation, ISS also provided access to an Aboriginal storyteller to share Indigenous stories about the sky (Ruddell et al. 2016). The school and community collaboration encouraged students to share their own sky stories that they had learned from their families. The analysis of students’ interviews showed that their participation in this ISS project allowed them to establish strong connections between their cultural stories and concepts presented in western science (Ruddell et al. 2016).

Participation in the ISS project resulted in students’ attainment of the curricular goals combined with gaining a first-hand learning experience and developing a scientific understanding of the real-life phenomena (McKinnon and Geissinger 2002). Additionally, engagement with this project helped students to identify and replace their alternative conceptions about various astronomy phenomena. The scaffolding activities allowed students to comprehend more advanced mathematical concepts such as scale models (McKinnon and Geissinger 2002).

Digital storytelling and science disciplinary literacy development

Advances in technology have led to the digitalisation of storytelling and have resulted in the emergence of digital storytelling (DST), a multi-literacy practice of storytelling mediated by digital tools. In most cases DST results in the creation of a video output (Angay-Crowder et al. 2013; Castañeda et al. 2018; Ohler 2013; Rubino et al. 2018; Teehan 2006; Zellner 2018). Zellner (2018) piloted a DST intervention with her college students enrolled in an introductory astronomy course. Participation in this intervention empowered them to assume ownership of their learning process because they could explore the astronomical topics that aligned with their personal interests (Smith et al. 2018). Zellner (2018) reported that the DST intervention supported her students’ development of creativity and extended their astronomy content knowledge. Additionally, Zellner’s students developed additional skills that were transferrable beyond the astronomy disciplinary context, for example collaboration and use of technology.

The integration of DST in various formal educational contexts, including Kindergarten-Grade 12, higher education and professional education (Rossiter and Garcia 2010; Rubino et al. 2018) has highlighted that DST interventions facilitated collaborative writing for all students, including EFL/ESL students (Angay-Crowder et al. 2013; Papadopoulou and Vlachos 2014; Rubino et al. 2018). DST creates a middle ground for EFL students to explore and combine their multiple literacies and social identities (Angay-Crowder et al. 2013) enhanced through multiple representations. For example, making videos about scientific phenomena creates a context for a disciplinary discourse and, with careful guidance, could facilitate and maintain students’ science disciplinary literacy development (Bell et al. 2009).

Despite some early evidence of successful learning outcomes and positive experiences in reported interventions (Pirbhai-Illich 2010; Pirbhai-Illich et al. 2009), DST is still an emerging trend in STEM education. Teachers remain cautious about including DST in their classroom practices because of curriculum and time constraints (Pirbhai-Illich et al. 2009). However, the well-planned integration of videomaking projects does not take significant time away from curriculum implementation and has a positive impact on students’ learning (Morgan 2015; Zellner 2018) as evidenced by the concomitant reports of improvement in students’ presentation and writing skills (Niemi et al. 2018).

Other research also highlights the potential of DST for integrating multiple disciplines so that students could develop their higher order thinking skills (Anderson et al. 2018). Additionally, Anderson et al. (2018) emphasise that DST is effective in drawing students’ attention to their language use while being engaged in the creation and sharing of their personalised stories (Andersone et al. 2018). However, there is a gap in understanding the impact of DST on the development of foreign or community languages as most DST research has been conducted in students’ mother tongue, usually English (Anderson et al. 2018).

Therefore, there is a need to further explore the role of DST in multilingual contexts, with the overarching goal of developing students’ STEM-A disciplinary literacy in English. This need has emerged from problems related to students’ language development (Anderson et al. 2018) exacerbated by the increasing role of English in STEM areas (Plo-Alastrué et al. 2015) as well as the economic divide between EFL and non-EFL speakers (Fleckenstein et al. 2016). Previous research has shown a positive impact of DST in teaching astronomy (Ruddell et al. 2016; Zellner 2018). Therefore, this research sought to explore the impact of DST on disciplinary literacy acquisition of EFL astronomy students.

Method

Adopting Yin’s (2014) research design classification, this project was conducted as a type IV embedded multiple-case study. Embedded designs involve multiple units of analysis, including quantitative and qualitative measures derived from students’ tests and field notes (Yin 2014). Such designs also use multiple cases. In this investigation there were two cases: an Australian case (Case 1) and a Kyrgyzstani case (Case 2). The focus of each of these cases was slightly different. The aim of the Australian case was to improve non-EFL students’ astronomy content knowledge and the aim of the Kyrgyzstani case was to improve EFL students’ astronomy disciplinary literacy. However, there are three reasons why comparisons can be made. First, both cases used the same content in their intervention (outlined in research background). Second, they used the same instrumentation to measure students’ content knowledge (outlined in data collection instrumentation). Third, the length of the intervention (in hours) was similar between the two cases (outlined in research background).

There were also two key differences between the cases that allowed using the data from the Australian case as a baseline data. First, unlike the Australian case, the Kyrgyzstani case enhanced the intervention with DST. Second, there was a difference in participants’ language background: the Australian study included non-EFL learners, but the Kyrgyzstani participants were all EFL learners. Consequently, analysis of the two cases was conducted to answer the research questions: Does the DST approach influence the EFL students’ STEM-A disciplinary literacy development in English? If “yes”, how does this happen?

Research background

Both cases used resources from the JTST educational package (McKinnon 2013), which was developed within a constructivist theoretical framework to encourage students’ learning through active inquiry (McKinnon 2013). This resource package was developed to support Australian primary and secondary teachers and therefore was aligned with the Australian science curriculum standards (Australian Curriculum, Assessment and Reporting Authority [ACARA] 2018).

The data for the first case study (Case 1) was extracted from the Western Australian research project known as Cultural Sky Stories (CSS), which is an extension of the ISS project (Ruddell et al. 2016). The aim of CSS was to improve the astronomy content knowledge of students, aged 10–12 years, by integrating culturally-grounded knowledge (including Indigenous stories) with western scientific understandings about the sky (Slater et al. 2018). In this integrated approach, the emphasis was on creating a cultural middle ground to engage a diverse range of students in learning science (Aikenhead 1996; Nakata 2018).

The Kyrgyzstani case (Case 2) also used the JTST astronomy package (McKinnon 2013) to explore how a DST pedagogical approach might promote STEM-A disciplinary literacy acquisition in a foreign language. The study was conducted with students aged 10–16 years in both an educational centre and in regular school settings through extracurricular courses. While all Case 2 participants experienced engagement with DST, there were a number of embedded cases where the intervention processes were refined during the research.

Kyrgyzstani embedded case studies were conducted in two research sites: educational centre (Groups 1–3) and a school (Group 4). The intervention for Groups 1 and 2 started with the exploration of the scale models of the Solar System and concluded with the exploration of the reasons for day and night, Moon phases, and seasons. Groups 3 and 4, experienced the reversed course sequence, which started with the exploration of the reasons for day and night, Moon phases, and seasons, and then completed with the exploration of the Solar System and the construction of scale models. Consequently, throughout the course, Groups 1 and 2 were focused on making videos about the individual planets of the Solar System, using various Internet resources as their references, while Groups 3 and 4 were making videos about Moon phases with their videos based on the knowledge and experience they gained through exploration and inquiry. The Australian students were not involved in DST, but they participated in the same inquiry activities as Kyrgyzstani sudents. For the Australian case the JTST was integrated into their regular science lessons at school and sequenced in the same way as for Kyrgyzstani Groups 1 and 2.

Australian participants from the CSS project (Slater et al. 2018) worked through the JTST astronomy package (McKinnon 2013) for approximately two hours per week over one school term (i.e., approximately 20 h). Based on a 2017 Kyrgyzstani pilot (Chubko et al. 2019), the length of intervention lessons for the Kyrgyzstani participants (Case 2) was reduced from 150 to 120 min implemented over 10 days to fit with other extracurricular courses provided by the participating educational centre. Consequently, both the Australian and the Kyrgyzstani interventions were 20 h in length.

All four groups in Kyrgyzstan were taught by the first author who received the same professional development as the classroom teachers participating in CSS (Slater et al. 2018) who delivered the astronomy course in Australia. Additionally, the teacher for the Kyrgyzstani case (Case 2) had a Teaching English to the Speakers of Other Languages (TESOL) qualification. Prior to the intervention, the first author received training in DST and the use of video-editing software, including iMovie (the video editor used for this intervention).

Sample

The sample for this analysis comprised 30 Kyrgyzstani students who learned English as a foreign language (EFL) and 325 non-EFL Australian students. Groups 1–3 from Kyrgyzstan spoke Russian as their first language (L1), while the majority of students from Group 4 used Kyrgyz as their L1. The teacher (first author) was fluent in Russian, but she had only a basic proficiency in Kyrgyz. The Kyrgyzstani sample contained two participants from Group 1 who could speak only Russian. The other Kyrgyzstani participants’ (28) level of English proficiency ranged from elementary (A2-B1) to intermediate (B1-B2) according to the Common European Framework of Reference for Languages (Council of Europe, 2018). Groups 1–3 had access to online dictionaries on their personal mobile devices or the mini-iPads provided by the teacher throughout the course. Group 4 could not use their personal mobile devices and did not have any internet connection on the mini-iPads provided by the teacher during the course because of restricted access to the internet in the school.

The first three groups from Kyrgyzstan (Groups 1–3) were mixed-gender groups enrolled in the same educational centre and were taught on the same premises during the summer vacation in 2018. Group 4 were female students enrolled in a Muslim school with separate classes for boys and girls. The girls were invited by their school principal to join the after-school astronomy course in October, 2018, during the first term of the school year. The Australian students were recruited from four mixed-gender schools. While it is likely that some students in this sample were multilingual, their schooling was conducted in English and students were considered to have English as their L1. The Australian sample is labelled as Group 5.

The participants from both countries were aged between 10 and 16 years. In addition to being engaged with inquiry activities about astronomy from the JTST (McKinnon 2013), all four groups from Kyrgyzstan were exposed to the DST intervention that required the students to participate in making videos in English about the astronomy concepts they were learning during the course.

Informed consent Informed consent was obtained from all individual participants included in the study as well as from their parents as required by the Ethics in Human Research Committee at the university where the first author was enrolled as a PhD student.

Data collection instruments

Textual data were collected from the written responses to the Astronomy Diagnostic Test (ADT) included in the JTST resource package (McKinnon 2013), which was administered at the beginning and again at the end of the course. That is to say, the design was a repeated measures pre-post enterprise. All Kyrgyzstani students and most of the Australian students (N = 200) completed the 15-question version of the ADT. However, the rest of the Australian sample completed a slightly shorter 11-question version with four of the 15 questions being removed. In both versions, the first four questions asked students to draw a picture to explain a particular phenomenon and to write their reasoning for their answer. The remaining questions asked students to select their answer from multiple-choice options and to write their reasoning for selecting each answer.

Importantly, as the aim of this research was to identify the shift in EFL students’ astronomy disciplinary literacy in English, Kyrgyzstani groups were not directly instructed to use English when providing reasons for their answers to the ADT questions. It was assumed that by giving EFL students the choice of language it would enhance the authenticity of their argumentation rather than drawing their attention to language. Additional data from the Kyrgyzstani sample also included a number of videos produced by the students in the DST approach and the researcher’s field notes.

Data analysis

Due to the significant difference between Australian (325) and Kyrgyzstani (30) sample sizes, an Analysis of Variance (ANOVA) with repeated measures on the occasion of testing was computed using Group membership as the independent variable to test the ability to compare these two groups. To verify that the distributions of the data met the mathematical assumptions of the statistical approach, the homogeneity of the covariance matrices was computed to ensure that both the individual and joint distributions of the groups were normally distributed. Box’s test of the equality of the covariance matrices was used to test the null hypothesis that the observed covariance matrices of the dependent variables were equal across groups. The Box’s M statistic was not significant (Box’s M = 16.309, F (12,1739.32) = 1.170, p = 0.299); thus, statistical results could be interpreted with confidence despite the difference in sample sizes.

The written responses provided by the students were assessed against the Structure of the observed learning outcome (SOLO) taxonomy (Biggs and Collis 1982). The coding employed was: ‘1’ for a response at the pre-conceptual level of thinking; ‘2’ for a unistructural response; ‘3’ for a multistructural response; ‘4’ for a response establishing relationships among the components of a concept; and ‘5’ for a response related to a bigger idea or an overarching theory. If no entry was made a response was scored as a ‘0’.

Both versions of the ADT test had four questions about Moon phases. Groups 3 and 4 of Kyrgyzstani case made videos about the Moon phases, while the other Kyrgyzstani participants did not make videos about the Moon phases. Therefore, the analysis examined students’ written responses to these four questions alone to investigate any differential effects of the DST intervention on EFL students’ disciplinary literacy development in English.

Consequently, a scale of SOLO performance was investigated for reliability. Cronbach’s alpha on the pre-occasion of testing was 0.649. On the post-occasion, Cronbach’s alpha was 0.740. The analysis showed that the four items could be added to produce a summed scale. Tukey’s estimate of the power to which observations should be raised to achieve additivity was 0.906. This value is close enough to 1 to allow the individual scores to be added without further mathematical transformation. The higher value of Cronbach’s alpha on the post-occasion of testing is not surprising given that the students had investigated aspects of the phenomenon and knew more about what causes Moon phases. Analysis of the data was conducted using the Statistical Package for Social Sciences (SPSS) version 23.

Since there were a few Kyrgyzstani students who provided some or all of their written answers in Russian, and the focus of this research was on the disciplinary literacy in English it was decided that the responses in Russian could be assigned a very small value of 0.0001 that had a minimal effect on the mean scores employed in the repeated measures analysis. This was done to maximise the number of cases in the paired analyses in the pre-post design. This small value should not be confused with the ‘0’ value assigned for a non-response. This approach allowed all of the students’ data to be employed in computing a SOLO scale total while simultaneously allowing an analysis of the frequency of Russian language use in their total scores.

Results

Table 1 shows the mean SOLO scores and standard deviation for each of the five groups on both the pre- and the post-testing occasions. All groups increased their mean SOLO scores for the four questions related to the Moon phases from the pre- to the post-ADT testing occasion (shown in Table 1).

Table 1 Pre- and Post- ADT SOLO total mean scores for the four Moon phases questions

The two Kyrgyzstani groups who made videos about Moon phases (Groups 3 and 4) showed the greatest gains in SOLO mean scores. The remaining two Kyrgyzstani groups (Groups 1 and 2), who did not make videos about the Moon phases, demonstrated lower level gains.

Table 2 shows that there is a significant main effect due to the occasion of testing (F (1, 353) = 18.720, p < 0.001). There is also a significant first-order occasion-by-groups interaction (F (5,353) = 5.838, = p < 0.001). This interaction indicates that the different groups are behaving in significantly different ways between the pre- and post-test occasions.

Table 2 Summary output of the ANOVA with repeated measures by Group membership

In order to interpret the significant first-order interaction between occasion of testing and group membership, the mean scores of each group are plotted in Fig. 1. This shows that Groups 1, 2 and 5 increased their mean scores in a modest fashion while Groups 3 and 4 had much larger gains shown by the steeper gradients.

Fig. 1
figure 1

Pre- and post- ADT SOLO total mean scores for the four Moon phases questions by Group

Figure 1 also shows that the two EFL groups who focused on the Moon phases video production (Groups 3 and 4) outperformed the Australian non-EFL students (Group 5) and the other two EFL groups (Groups 1 and 2) in their ability to express their ideas in English. It is likely that this significant first-order interaction is due to the marked differences in gradients representing the pre- and the post-occasion mean SOLO scores. Importantly, the different treatments appeared to have significant effects on students’ ability to explain their reasoning in English, especially when English was not their native language.

As an example, below are the pre- and the post- test answer excerpts of a student who did not make a video about Moon phases (Excerpt 1). Excerpt 2 presents the answer to the same question given by the student who participated in a video production about Moon phases. Both students used Russian to answer this question during the pre-test and then swapped to English in their post-test. Students’ entries are included as verbatim transcripts.

Table 3 Excerpt 1
Table 4 Excerpt 2

While the first student basically translated her earlier idea from Russian to English, the second student adopted the whole new approach to the question as well as supplementing her answer with visualisation (her drawing of the model), one of the attributes of the science disciplinary literacy (Goldman et al. 2016; Shanahan and Shanahan 2008; Spires et al. 2018).

Excerpt 3 provides an example from another student, who was working on a Moon phases video and was initially more proficient in English than the students whose examples were given above. The transition from Level 3 to Level 4 on SOLO taxonomy is evident as in the post-test the student demonstrated a more concise use of language via the effective use of terminology and exclusion of redundancy (Excerpt 3). Whereas in her pre-test answer this student wrote an additional sentence that simply restated the idea of the previous sentence and did not provide any new information. This example suggests that the student possessed an alternative conception about the phases of the Moon on the pre-occasion. This alternative conception is commonly called the “eclipse conception” or “shadow of the Earth” and this appears to have been changed to the correct and concise explanation in the post-test response. Conciseness is another feature of science disciplinary literacy (Spires et al. 2018). Indeed, this is what most of the students attained in these two Groups scoring a 4 or 5 on the SOLO taxonomy in their post-test answers.

Table 5 Excerpt 3

Table 3 shows that the total of written responses for the four Moon phases questions in English by the end of the intervention in the Kyrgyzstani case increased from 49 to 63 while the total of written responses in Russian remained the same (34). Overall, the number of non-responses reduced from 37 to 23.

Table 3 Frequency of occurrence of Kyrgyzstani students’ responses by language

Discussion

The aim of the current research was to explore how a DST intervention within a STEM-A course impacted EFL students’ astronomy disciplinary literacy acquisition in English. It can be concluded that the DST educational technology covaried with a positive influence on EFL students’ astronomy disciplinary literacy development in English and on their disciplinary knowledge. By the end of the course, all of the research participants demonstrated a positive change in their post-ADT written responses, often shifting from unistructured to multistructural or relational levels of thinking (Biggs and Collis 1982). The largest gains were obtained by the two Kyrgyzstani groups who were engaged in making videos about Moon phases (Groups 3 and 4). These findings contribute to the research on the role of DST in the enhancement of students’ writing (Angay-Crowder et al. 2013; Papadopoulou and Vlachos 2014; Rubino et al. 2018) and STEM disciplinary literacy development (Niemi et al. 2018).

Within this study, scientific inquiry has a positive effect on students’ learning. However, students who were engaged in inquiry tasks that did not include DST about Moon phases (Groups 1, 2, and 5) did not achieve the same magnitude of the gains as students who were engaged in making videos about Moon phases (Groups 3 and 4). As shown in Fig. 1, students’ concept acquisition covaried significantly with the use of DST.

In their responses, all participants attempted to answer more questions in their ADT on the post-test occasion than during the pre-test. There was an increase in English language use by Kyrgyzstani students, while the number of responses in Russian remained the same and the number of questions with no response reduced. This is an unexpected outcome since the research participants in the Kyrgyzstani groups were not directly instructed to answer the ADT questions in English.

The observed rare use of L1 in EFL students’ responses implies two outcomes which require further exploration. First, EFL students had a positive attitude about learning in English and were not worried about attempting responses in English. Second, EFL students developed disciplinary literacy in English and therefore wrote their answers in English to compensate for the lack of knowledge of terminology in their L1.

In order to explore the differences in disciplinary literacy between EFL and native English speakers, SOLO responses from the Kyrgyzstani and Australian samples were compared. The results confirmed the performance gap between native and non-native speakers as a group (Dąbrowska 2019; Hulstijn 2019; Menken 2013), but also revealed that course design could bridge the learning outcomes of students with various levels of target language proficiency. The groups of EFL students making videos about Moon phases attained a significantly higher SOLO scores on their ADT post-test than the Australian and Kyrgyzstani students who participated only in the inquiry activities about Moon phases.

The positive outcomes of two Kyrgyzstani groups (Groups 3 and 4) suggest that a DST intervention supports EFL students’ disciplinary literacy acquisition in English. Of a particular interest in the context of EFL pedagogy are the improvements made by the EFL students (Group 4) with the lowest target language proficiency at the beginning of the course. Group 4 slightly outperformed Group 3, despite both groups being exposed to the same course structure. Group 4 students made the largest improvement in their SOLO scores, even though the participants did not receive any explicit literacy instruction throughout the course. It is possible that this outcome is related to the change of the educational context as Groups 1–3 were enrolled by the educational centre, but Group 4 was recruited by the school. Therefore, while Groups 1–3 met each other only during the intervention, Group 4 students knew each other prior to the intervention. It is possible that Group 4 students might have had more trust in each other due to the strong sense of collaboration and a well-established community of practice (Lave and Wenger 1991) in their school. This may have increased the amount of time they spent on sharing concepts rather than on negotiating collaboration or on developing relationships. Additionally, all Group 4 students were female students, which could have affected their classroom interaction style and reinforced the establishment of the community of practice (Lave and Wenger 1991).

The research outcomes could also be a result of the amount of time spent on video production. Group 4 students worked on their videos throughout the whole course, for approximately 10 out of the 20 h of the course. Groups1-3 spent only three to five hours on the video component of the course. It is also possible that Group 4′s results could be linked to prior knowledge about the Moon, as the Muslim religion follows the lunar calendar; however, this was not explicitly measured in the current research.

The DST educational technology establishes a meaningful and inclusive multimodal learning context (Angay-Crowder et al. 2013; Madrid and Cañado 2018; Cañado 2018; Rubino et al. 2018) that facilitates a community of practice formation (Lave and Wenger 1991; Wegner and Nückles 2015). Since EFL students might have different life experiences and sociocultural backgrounds as well as different proficiencies in the target language, DST becomes a middle ground (Aikenhead 1996; Nakata 2018; Ruddell et al. 2016) for the EFL students’ negotiation of the concepts being studied. The videomaking process encourages students to construct shared knowledge (Van Aalst 2009) in order to present their personal conceptual understandings. By assigning EFL students to make a video to explain their understanding of a specific astronomical phenomenon, a teacher is empowering students to own their learning by giving them autonomy and when assigned as a group task, DST creates a context for collaboration among students.

To improve students’ conceptual understanding their prior knowledge needs to be adapted to a new context (Wegner and Nückles 2015). In the current study, DST served as a tool for adapting EFL students’ prior beliefs and assumptions about STEM-A to a video format. In addition, DST reinforces the development of a community of practice (Lave and Wenger 1991; Wegner and Nückles 2015) by encouraging EFL students to acquire new knowledge from their inquiry experiences and collaboration with other students.

Limitations

Even though this research overall had a reasonable number of participants from Kyrgyzstan, the number of students in each of the intervention groups was low. Therefore, the main limitation of this research is the small sample size that was treated with a multiple case-study design. There were some differences in the interventions as well, which limits the interpretation from the comparison of the two cases. Additionally, the option to use their L1 in the ADT was necessary to maximise paired-cases, but this has implications for the interpretation of differences between responses written in EFL students’ L1 compared to English. Finally, the impact of students’ gender was not considered in the current data analysis; however, given that the highest gains were attained by Group 3, which predominantly contained female students, and female-only Group 4, further research is needed to incorporate students’ gender as an independent variable within the data analysis.

Conclusions

This study exemplifies how DST could be integrated within STEM-A as an effective educational technology for enhancing EFL students’ disciplinary literacy, as this teaching approach has not yet been examined within an EFL context. One of the positive aspects of this study was the relationship building and collaboration among the EFL students that covaried with a shared knowledge construction. Over time, this collaboration evolved into a community of practice. In this study, technology was used as a vehicle to encourage students to communicate and to provide an authentic context for learning.

Implications and further research

In contrast to some CLIL programmes (Lucietto 2008; Cañado 2018; Yang 2016), the DST intervention emphasises a collaborative learning environment that intentionally shifts the focus from teachers’ expertise in subject knowledge to an active inquiry approach that involves students in a construction of shared knowledge. The DST pedagogical approach is a student-centred approach that provides a middle ground for shared knowledge construction between students, which also could be accommodated in CLIL programmes. Therefore, the teacher should be ready to enter a community of practice with their students and engage in disciplinary knowledge construction together with the students. The multimodal nature of the DST educational technology aligns with the integration of technology in STEM-A, and thus has the potential to be used in order to create an authentic learning context for all students, regardless of their background.

Further research is needed to explore the effect of the DST intervention on disciplinary literacy development with native-speakers of English. The role of students’ gender in DST collaboration is also unclear and requires further investigation. Finally, this research poses a question of disciplinary literacy transferability between EFL students’ native and foreign languages.