http://orcid.org/0000-0001-9887-2250
Figures
Abstract
Background
The flipped classroom (FC) is a pedagogical approach that means that the activities that have traditionally taken place within the classroom are carried out outside the classroom. Fundamentally it implies the way in which the student studies the subject. This change of perspective in teaching—learning has raised many questions regarding its effectiveness and student satisfaction in the university studies in the degree of Social Work.
Objective
The main objective of this study was to evaluate the effectiveness of a Flipped Classroom methodology in the academic performance of students of the Social Work Degree.
Methods
An educational study, with two parallel groups was developed. The randomization was carried out by class groups. Group 1 was assigned an active teaching methodology of Flip Teaching and it was implemented during theoretical teaching hours. The other group of students, Group 2, was assigned a traditional lecturer-based learning (LB) methodology. The participants were all the students of the morning shift who studied the subject Social Work with Groups of the Social Work Degree during the academic year 2017–2018. The sample was composed of 110 subjects, with 60 subjects who developed an active teaching methodology and 50 subjects who received a LB.
Results
In terms of the academic performance result variable, the FT group had a mean of 6.56 (SD: 1.58) and the LB group had a mean of 5.42 (SD: 1.97) (p-value: 0.002). The FT group also had a higher percentage of students receiving merit and outstanding scores (34.5% and 6.9% respectively) and a lower percentage of students who failed (19%) as compared to the LB group in which 20.9% and 2.3% of the students received merit or outstanding grades and 46.5% failed (p-value = 0.025). No significant differences were found with regards to satisfaction with the subject and the methodology used, long-term learning and time spent preparing for the exam.
Citation: Oliván Blázquez B, Masluk B, Gascon S, Fueyo Díaz R, Aguilar-Latorre A, Artola Magallón I, et al. (2019) The use of flipped classroom as an active learning approach improves academic performance in social work: A randomized trial in a university. PLoS ONE 14(4): e0214623. https://doi.org/10.1371/journal.pone.0214623
Editor: Andrew R. Dalby, University of Westminster, UNITED KINGDOM
Received: December 25, 2018; Accepted: March 15, 2019; Published: April 4, 2019
Copyright: © 2019 Oliván Blázquez et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: As for the study’s database repository, it was decided that it shall be available upon request, since, upon locating the university, the degree and course in which the students are registered as well as the academic course year, we believe that it would be relatively simple to identify the students and violate their confidentiality. The data underlying the results presented in the study are available from Faculty of Labour Science, University of Zaragoza. A non-author point of contact is: Dr Ruth Vallejo Lacosta, Dean of Faculty of Social and Labour Sciences. E-mail: decanato.sociz@unizar.es.
Funding: The study has been financed by the University of Zaragoza (call for teaching innovation PIIDUZ_1_137).
Competing interests: The authors have declared that no competing interests exist.
Introduction
In Europe, higher education has been modified in the last decades thanks to the creation of the European Higher Education Area (EES) developed through the Bologna Declaration [1], the Prague Declaration [2], the European Union Council Meeting [3] and the Lisbon Declaration [4]. The European Higher Education Area transfers the emphasis in the teaching-learning process from a model of knowledge transfer by teachers to a learning model based on student-centered competences. Therefore, it has been necessary to include active learning methodologies that entail a greater degree of involvement on the part of the student, a greater dynamism in learning and a greater interaction with the contents [5–6].
An active learning methodology is the so-called Flipped Classroom (FC), which is consistent with a competency-based model [7].
According to the principles of FC teaching methodology, learning is at the center of the educational process, the student having a very active role, with the teacher guiding and facilitating the learning process. Fundamentally it implies the reorganization of activities according to the place where they are executed, that is, what was traditionally taught in the classroom, as this methodology is used outside the classroom.
Recent studies [8,9] consider FC as a pedagogical model that includes interactive and group learning activities within the classroom, since it is in this place that the processes of acquisition and practice of theoretical knowledge are enhanced. Another component is the transfer of individual learning outside the classroom. In fact, authors such as Chen et al. [10] define FC as a hybrid approach that combines on-line autonomous learning and face-to-face activities in the classroom. The students engage in content learning before class, thereby maximizing in-class time for active learning.
Although modern versions of FC appeared over ten years ago, it is generally popular in education, higher education and specially sciences and medical education [11]. Over the last few years studies of the effectiveness of FC in the training of medical degrees in various areas including [12–15], pharmacy [16–17], nursing [18–21], physiotherapy [22], veterinary [23], chemistry [24], engineering, and physics [25–27], have been developed.
The studies carried out on the effectiveness of FC in the field of social sciences [28–29]and specifically in social work degrees are more scarce [30–31].
Innovation in the education of social work, which encompasses multiple functions including teaching, research, and practice, is constrained by the limits of current social work approaches and methods. Increasing social work's impact in the real world requires the clarification of the complexities of reciprocal forces between human lives and the environment [32].
This means that innovative and active teaching methodologies can be developed through reflective journalism [30], readings accompanied by online tools that promote learning communities and prompt further reflection, etc. [31].
The FC method has shown greater academic achievement than traditional lecturer-based learning (LB), and this fact has been more evident in recent years [10] mainly due to the development of technological resources such as Google Drive, YouTube, Vimeo, Google Classroom, etc. [7]. However, results should be interpreted with caution because of the high methodological diversity, statistical heterogeneity and risk of bias in the studies carried out. It has been stated that future studies should have higher methodological rigor, a standardized FC format and utilize assessment tools evaluating higher cognitive learning process instead of an exam [10].
Given the scarcity of work in social sciences and specifically in SW, and the heterogeneity of studies published with high risk of bias, the development of a study that provides scientific evidence through a randomized trial methodology, thereby minimizing the risk of bias, is proposed.
The main objective of this study is to evaluate the effectiveness of a Flipped Classroom methodology in the academic performance of students of the Social Work Degree.
The aim is also to evaluate the effectiveness of FC regarding satisfaction with the subject and the methodology used, with respect to the hours of study spent on preparation for the exam, with respect to the short-term learning of each theoretical topic and, lastly, with respect to the perceived difficulty of each theoretical topic.
The alternative hypotheses for this study are the following:
- H1: Students who develop an active methodology of FC-based learning obtain higher levels of academic performance, valued both quantitatively and qualitatively with respect to students who develop a traditional methodology.
- H2: Students who develop an active methodology of FC-based learning are more satisfied with the subject and the methodology used with respect to students who develop a traditional methodology.
- H3: Students who develop an active FC-based learning methodology spend less time preparing for the exam than students who develop a traditional methodology.
- H4: Students who develop an active FC-based learning methodology acquire more short-term learning from each theoretical topic compared to students who develop a traditional methodology.
- H5: Students who develop an active FC-based learning methodology acquire greater long-term learning from each theoretical topic compared to students who develop a traditional methodology.
- H6: Students who develop an active FC-based learning methodology regard each theoretical topic as less difficult when compared to students who develop a traditional methodology.
Material and methods
Design of the study
An educational study (randomized trial), with two parallel groups was developed. The randomization was carried out by class groups. Group 1 was assigned an active teaching methodology of Flip Teaching and it was implemented during theoretical teaching hours. The other group of students, Group 2, was assigned a traditional methodology, a master class. These methodologies were developed for the subject Social Work with Groups, in the Social Work degree at the University of Zaragoza (Spain).
The Social Work degree at the University of Zaragoza consists of 240 ECTS credits, distributed over four years. It includes core, compulsory, optional and external practice courses (presential and research), as well as an Undergraduate Dissertation. In the core, compulsory and optional courses consisting of 5 or 6 ECTS, there are some hours of theoretical training, practical education and a mentored project. The study plans may be viewed at the following link: https://estudios.unizar.es/estudio/asignaturas?anyo_academico=2018&estudio_id=20180110¢ro_id=108&plan_id_nk=274&sort=curso.
The Social Work with Groups course is a compulsory course offered during the second quarter of the second course year. It includes two parts: a first part that is taught from a social psychology perspective, consisting of group psychology (five subjects of the course curriculum); and a second part that is taught from a Social Work and Social Services perspective, which specifically covers the handling of groups from the social work perspective (four subjects of the course curriculum). The bibliography used for the course may be viewed at the following website: http://psfunizar7.unizar.es/br13/egAsignaturas.php?codigo=26115.
Participants and sample size
The population consisted of students registered in the Social Work with Groups course at the University of Zaragoza (Spain) during the 2018–2019 course year. During this academic year, 171 subjects were registered and 160 attended the theoretical and practical sessions on an ongoing basis. Given the population size of 160 subjects, assuming an error of 5% and a probability of success of 95%, with a confidence level of 95% and a precision of 5%, and adding 10% for potential abandoning of the intervention, at least 56 students were necessary. Since the intervention was conducted by class groups, 110 students participated in the study, exceeding the necessary sample size.
The participants were all the students of Group 1 and 2 of the morning shift who studied the subject Social Work with Groups of the Social Work Degree and who attended continuously both the theoretical and practical classes during the academic year 2017–2018. The sample was composed of 110 subjects, with 60 subjects who developed an active teaching methodology and 50 subjects who received a master class methodology. Randomization by cluster was carried out by means of a randomization computer program by an independent investigator in the study.
Interventions
The teaching methodology was developed over six weeks during the months of February and March of 2018, during which five subjects of the course curriculum that belong to the area of knowledge of Social Psychology are taught. These topics address the following contents: 1) definition and types of groups; 2) group development processes; 3) group structure; 4) leadership; and 5) other aspects of groups—communication, empathy, obedience. There were four teaching hours a week, two of theoretical content and another two hours of practical content, and one hour of tutored group work.
The intervention was carried out in the hours dedicated to the theoretical content. The same teacher was used for both groups and performed the same activities in the practical classes and in the tutored group work. This teacher has five years of teaching experience in this subject.
In the intervention group where the Flip Teaching methodology was implemented, the students had to work on the contents previously to the theoretical classes that were to be taught.
To ensure this methodology was well-accepted among the students, the recommendations of Rotellar & Cain [33] were followed. To do this, the students were provided with written documentation and videos prepared through the Active Presenter program by the teacher of the subject.
Both the documentation and the videos were about each of the topics that were taught. In addition, the students had to answer questions that the teachers raised regarding each topic. During class time, the discussion was about the answers to the questions that had been answered outside of class time.
In the control group a traditional lecturer-based learning (LB) was developed, consisting of the teacher explaining the theoretical contents in the class without any previous work by the students on those theoretical contents.
In order to establish that both groups had the same teaching load throughout the six weeks that the teaching was given, ten teaching hours of theoretical class were established for the group that followed the FC teaching methodology, since they were working at home, and twelve teaching hours of theoretical class were established for the control group.
Measurement instruments
Primary outcomes.
The outcome variable of this educational study was the academic performance, evaluated by the grade obtained in a theoretical exam on the subject. This exam consisted of 35 multiple-choice questions with three response options, taking into account the chance factor (so the erroneous answers were discounted in the grade). The exam contained nine questions referring to group definition and types; seven questions referring to group development processes; nine questions referring to group structure; seven questions referring to leadership; and three questions referring to other group aspects—communication, empathy. The quantitative rating can range between 0 and 10, with a higher score denoting a higher percentage of success in the answers. The qualitative grading is fail (between 0 and 4.9), pass (between 5.0 and 6.9), merit (between 7.0 and 8.9) and outstanding (between 9.0 and 10).
Secondary outcomes.
The secondary variables were: Student satisfaction with the subject and teaching methodology used, approximate number of study hours in the preparation for the exam, short-term learning of each subject taught and perceived difficulty of each topic.
To measure the secondary variable "student satisfaction with the subject and the methodology used", a self-made questionnaire consisting of seven questions was used, which are answered on a Likert scale from 0 to 4, with 0 being not at all and 4 being to a great extent. The questions were as follows: the methodology used has promoted new knowledge; it has favored a deep learning; it has helped me to think more critically; it has helped me to apply theoretical content to practice; it has helped me to apply theoretical content to evaluation; it has helped me to better understand concepts; and I think it is a good teaching methodology. An open section was also considered so that students could express their opinion freely. Another secondary variable that was collected was the number of approximate study hours spent in preparation for the exam. To measure "the short-term learning of each subject taught" secondary variable, the teacher proceeded as follows: at the end of each theoretical topic, a small test was carried out with between five and ten questions, depending on the size and difficulty of each topic, with four answer options, to assess the learning accomplished on the subject. This learning variable at the end of each topic was assessed on a scale between 0 and 10, with a greater number of correct answers giving a higher score. The computer application Kahoot was used to evaluate this variable.
The "long-term learning" variable was also measured. To do this, the students were summoned eight months later to take a test on the subject. This was asked through the class delegates, one day in advance, requesting their participation, explaining the purpose of the activity, and asking that they not review the subject as it was a test to assess their memory. A test of ten test questions was developed, with three response options. Only the correct answers were counted. These 10 questions were different from those responded to in the course assessment, corresponding to two questions per each of the 5 areas taught: 1. group definition and types; 2. group development processes; 3. group structure; 4. leadership; and 5. other group aspects—communication, empathy, obedience and group thinking. Questions referred to the basic and fundamental aspects of each of these areas.
Finally, at the end of each theoretical topic, the “perceived difficulty” variable in understanding the topic was also measured on a scale of 0 to 10, with 0 being not at all difficult and 10 extremely difficult.
The main variable and the satisfaction and the hours of study dedicated to preparation for the exam were collected after the seven weeks of teaching. The short-term learning of each theoretical topic and the perceived difficulty of each topic were collected at the end of each theoretical topic. The flowchart and the n of each variable are shown in Fig 1.
The following variables were also collected: gender, age, university entrance mark, number of ECTS credits registered throughout the degree and number of credits passed. These variables were collected in order to analyze if the groups of students were equivalent at the beginning of the study.
An analysis of the distribution of the variables was carried out in order to establish the type of statistics to be used; all quantitative variables had a non-normal distribution except for the marks.
It was decided to use non-parametric statistics in the analysis of all quantitative variables with the exception of the variable quantitative grading, which used parametric statistics. Subsequently, a comparison analysis of the groups was performed for the variables gender, age, university entrance mark, number of ECTS credits registered throughout the degree and number of credits passed, to determine if the groups were initially comparable in the study.
Chi-square and Mann-Whitney U statistics were used, depending on whether the variable was qualitative or quantitative. To analyze the effectiveness of FC versus traditional LB learning, both groups were compared with respect to the main variable and secondary variables using the Mann-Whitney U statistic and Student's T based on their distribution.
Statistical analyses were performed with SPSS 19.0 statistical software package, with p-values below 0.05 considered to be significant.
Ethical aspects
This research project was evaluated and financed by the University of Zaragoza (call for teaching innovation PIIDUZ_1_137). The study has received the approval of the ethical committee of the vice-rector for academic policy of the University of Zaragoza. Approval number–PIIDUZ 17 137. However, the University of Zaragoza has not intervened in the analysis and dissemination of the results. At the beginning of the study, the teaching methodology that was to be developed in each group of students was explained, and all the students gave their verbal informed consent and agreed to participate.
Results
Initially, a description was made of the variables of gender, age, university admittance mark and credits passed up to the time of the global sample and by groups (to ensure comparability by analyzing the p-value). As can be seen in Table 1, the total sample consists mainly of women (90.1%), with an average age of 20.5 years (SD: 3.27), who entered university to study the degree with an average score of 8.11 (SD: 1.35) and have been approved so far for an average of 57.90 ECTS credits. Table 2 shows that there are no significant differences between the two groups concerning the variables collected. In both tables the values of the mean and standard deviation, median, Q25 and Q27 are shown.
Regarding the comparison of the groups in terms of the academic performance result variable, this was collected by the quantitative grading obtained in the exam. As shown in Table 3, there was a significant difference in both qualitative and quantitative exam scores, with the group that had developed the FC methodology having a higher mean in the exam grade, as well as a higher percentage of students who passed, or received merit and outstanding grades. In addition, in the FC group, exam attendance was greater, since two people failed to take the exam, while in the control group, seven people did not attend.
Regarding the comparison of the groups in the "satisfaction" variable, the results obtained show that there were no significant differences in satisfaction between both groups of students, obtaining in general a good result in both groups. Regarding the hours dedicated to the study of the subject for the exam, there was no significant difference between the two groups. There were significant differences in the perceived difficulty and short-term learning of some topics, with the FC group finding them less difficult with the exception of the first topic, but there was also worse short-term learning in some subjects in the FC group.
Regarding the qualitative assessment of student satisfaction, both groups considered that the theory of the subject Social Work with Groups is interesting, and it was imparted in a dynamic way, but in the group of students who had followed the FC methodology, they added a greater percentage of comments on the effectiveness of the teaching methodology that, according to their criteria, helped them to understand, further their knowledge and update themselves on the subject.
Discussion
In relation to the hypotheses proposed at the beginning of the study, it has been verified that the students who developed an active methodology of FC-based learning achieved a higher academic performance (quantitative and qualitative), and a lower perception of difficulty of the content with respect to the students who developed their learning through a traditional methodology. But it was not shown that the students who developed an active methodology of FC-based learning took greater satisfaction from the subject and the methodology used, achieved better long-term learning or that they spent less time in preparation for the exam.
Regarding the academic performance variable, the results obtained are in line with the existing bibliography. A meta-analysis that analyzed 41 studies comparing the effectiveness in the examination score of FC versus LB, found no statistically significant differences in five studies (with values of standardized mean difference between -0.66 and -0.02) but in the rest of the 36 studies, there were statistically significant differences (with values of standardized mean difference between 0.09 and 2.49).
The total value of the standardized mean difference obtained was 0.47 (CI: 0.31, 0.63). It must be taken into account, however, that of the 41 studies reporting examination scores, seven were before-after studies and provided pre-post score changes. In Chen's study [10], all examination score outcomes were evaluated according to Kirkpatrick's level 2 measurement (learning) [34], but in this study, level of change was additionally evaluated. Studies in social work [30–31] did not assess academic performance specifically.
The Holmes study [31] was conducted with master’s students, and they used Google for teaching resources, while the study by Sage & Sele [30] evaluated student preparation and engagement through a survey.
With regards to the study time used for preparation for the exam, no statistically significant differences were found, since the students invested an average of 14.87 (SD: 10.26) and 15.11 (SD: 11.56) hours in the FC and LB groups respectively. However, taking into account the results obtained in the grading, it could be said that with the same study time, the students who followed an FC methodology achieved a better grade, results that are in line with the Baepler et al. study [24]. On the other hand, it could also be considered that social desirability has influenced student responses.
The satisfaction and positive feelings towards this teaching methodology and against LB have been demonstrated in several research studies [19, 35–37], but there are also studies in which student satisfaction does not differ between both teaching strategies [38–39].
Among the reasons found in the literature, higher workload stands out [38], although in this study, to minimize the bias of the extra workload, students who followed the FC methodology had two hours less class. The explanation in our study can be linked to the fact that in both groups a high satisfaction level was obtained (scores of around 3 points out of 4 in all items), since, according to students' feedback generally and over a number of years, they consider the subject of Social Work with Groups to be interesting and show high motivation towards it, besides considering it useful for their professional future. With regard to short-term learning, significant differences were obtained in two of the five subjects studied, obtaining a worse score in the FC group, with results contrary to those that might have been initially predicted. This may be because topics 3 and 4, the subjects in which a significant difference was obtained, are those that may be considered more difficult or with a larger content, since they are related to the theory of the group structure that covers the concept of structure, status, roles, norms, and group culture, and which contain theories of leadership. It may be that when the content is complicated, more time needs to be invested in class to correctly assimilate the contents, or a mixed methodology of FC and LB needs to be developed. Regarding long-term learning, this study found that both groups obtained results without significant differences.
A study by van Vliet et al. [40] evaluated the effect of the FC teaching methodology after five months with respect to the variables of learning and motivation strategies using the Motivated Strategies for Learning Questionnaire, and compared to the traditional methodology, obtaining results that the values of critical-thinking, task value, and peer instruction had decreased to similar levels of those in the traditional learning group.
Results in this study coincide with those of the study carried out by van Vliet et al. [40]. Learning was assessed through a test-type questionnaire having three response options but different from those used to evaluate academic performance, and it was found that learning was maintained equally in both groups. However, these results should be viewed with caution since the number of students taking the test at eight months was small in both groups. Furthermore, having viewed the results, it is possible that the test did not sufficiently distinguish between the level of in-depth learning, since ten questions were used that included both basic and fundamental theoretical content aspects. Perhaps a more complex test or more complex questions would have allowed for the discerning of more in-depth learning.
The first topic, which addresses the definition of groups and types of groups, could be considered to not involve too much difficulty, but the FC group perceived it to be significantly more difficult. This may be due to the fact that the learners were initially being exposed to the concept of flipped classrooms and as the onus on learning was shifted towards them, they perceived the workload to be greater, or they were anxious about potential classroom disruption [28, 33, 41]. Once the FC dynamic was established and they adapted, in the rest of the topics, the perceived difficulty was always greater in the LB group, becoming significant in the last topic.
This study presents both strengths and limitations. Among the strengths can be highlighted the contribution of this study to evidence concerning this active teaching methodology in the social sciences, since studies are scarce in these disciplines, as well as the methodological rigor, since a randomized methodology was developed using clusters with two groups in parallel. This methodology provides great scientific evidence if all biases have been controlled [42].
In addition, to ensure the aforementioned methodological and intervention quality, the recommendations of Rotellar & Cain [33] were followed. And finally, secondary variables were collected, both from study hours and from the effect of short-term and long-term learning that may shed light on the effectiveness of this teaching methodology compared to the traditional LB methodology.
On the other hand, this study also has certain limitations. The main limitation lies in the fact that the study was carried out in one university, with only two class groups, which were randomized. Although these groups are comparable in sex, age, credits registered for and received and degree entrance score, there may be other confounding factors that were not considered, such as income and work history. At the University of Zaragoza (Spain) in the 2017–2018 course year, three student groups took the Social Work with Groups course, distributed over two morning groups and one afternoon group. It was decided that the afternoon group would not be included in the randomization, mainly because this course was taught by a faculty member that was different from the one teaching the morning groups and also because the student profile for this group is different, having a higher percentage of older students and individuals that work during the morning hours. Therefore, it was believed that significant biases could possibly arise if this third group was included in the study.
Another limitation of this study lies in the assessment of the long term learning (at 8 months), since the sample size of the participants in this assessment was small and a large percentage participated anonymously. Therefore the data has been analyzed as a group (mean, median and quartiles). Another limitation is the sample size. The sample consists of 110 subjects, but in order to establish greater scientific evidence, it would be necessary to increase the sample size. Another potential limitation is that the evaluator who assessed the study variables was not blind to the assignment, although he/she could not interfere in the results, since they were collected from a test or using a numerical scale ranging from 1 to 4 or 0 to 10. And finally, the social desirability bias may have influenced the measurement of the hours of study preparing for the exam variable.
Conclusions
The FC teaching methodology in comparison with the LB methodology has shown itself to be a more effective tool regarding academic performance evaluated in a quantitative and qualitative way with regards to Social Work education at university level. It has also been evaluated more positively in terms of the perception of difficulty of the content. However, no significant differences have been found regarding satisfaction with the subject and the methodology used, long-term learning and the time spent preparing for the exam.
Acknowledgments
We wish to thank the University of Zaragoza, the Research Group B21_R17 of the Department of Research, Innovation and University of the Government of Aragon (Spain), and Feder Funds "Another way to make Europe" for their support in the development of the study.
References
- 1.
European Council. Bologna Declaration. The European Space for Higher Education. [Internet]. 1999. Available from: http://www.uma.es/eees/index.php?option=com_content&task=blogcategory&id=16&Itemid=36
- 2.
European Council. Declaration of Prague. Towards the European Higher Education Area. [Internet]. 2001. Available from: http://www.uma.es/eees/index.php?option=com_content&task=blogcategory&id=16&Itemid=36
- 3.
European Council. Extract of the conclusions of the Presidency. 2000.
- 4.
European Council. Declaration of Lisbon. Youth opinion on educational inclusion [Internet]. 2007. Available from: http://www.european-agency.org/publications/flyers/lisbon-declaration-
- 5. Graeff TR. Strategic Teaching for Active Learning. Mark Educ Rev [Internet]. Routledge; 2010 Oct 8 [cited 2018 Nov 5];20(3):265–78. Available from: https://www.tandfonline.com/doi/full/10.2753/MER1052-8008200307
- 6.
Kober L. Reaching Students: What Research Says About Effective Instruction in Undergraduate Science and Engineering [Internet]. Washington, D.C.: National Academies Press; 2015 [cited 2018 Nov 5]. Available from: http://www.nap.edu/catalog/18687
- 7. Basso-Aránguiz M, Bravo-Molina M, Castro-Riquelme A, Moraga-Contreras C. Propuesta de modelo tecnológico para Flipped Classroom (T-FliC) en educación superior. Rev Electrónica Educ [Internet]. 2018 Feb 15 [cited 2018 Oct 17]; 22(2):1. Available from: http://www.revistas.una.ac.cr/index.php/EDUCARE/article/view/8523
- 8. McDonald K, Smith CM. The Flipped Classroom for Professional Development: Part I. Benefits and Strategies. Billings DM, Kowalski K, editors. J Contin Educ Nurs [Internet]. SLACK Incorporated; 2013 Oct 1 [cited 2018 Oct 26];44(10):437–8. Available from: pmid:24098988
- 9. Bergmann J, Sams A. Flip your classroom: reach every student in every class every day [Internet]. International Society for Technology in Education; 2012 [cited 2018 Nov 5]. 112 p. Available from: https://www.iste.org/resources/product?ID=2285
- 10. Chen K-S, Monrouxe L, Lu Y-H, Jenq C-C, Chang Y-J, Chang Y-C, et al. Academic outcomes of flipped classroom learning: a meta-analysis. Med Educ [Internet]. 2018 Sep [cited 2018 Oct 17];52(9):910–24. Available from: http://doi.wiley.com/10.1111/medu.13616
- 11. Chen F, Lui AM, Martinelli SM. A systematic review of the effectiveness of flipped classrooms in medical education. Med Educ [Internet]. 2017 Jun [cited 2018 Oct 17];51(6):585–97. Available from: pmid:28488303
- 12. Heitz C, Prusakowski M, Willis G, Franck C. Does the Concept of the "Flipped Classroom" Extend to the Emergency Medicine Clinical Clerkship? West J Emerg Med [Internet]. 2015 Nov 12 [cited 2018 Oct 26];16(6):851–5. Available from: http://escholarship.org/uc/item/2q83j70b pmid:26594277
- 13. Bonnes SL, Ratelle JT, Halvorsen AJ, Carter KJ, Hafdahl LT, Wang AT, et al. Flipping the Quality Improvement Classroom in Residency Education. Acad Med [Internet]. 2017 Jan [cited 2018 Oct 26];92(1):101–7. Available from: pmid:27680317
- 14. Tune JD, Sturek M, Basile DP. Flipped classroom model improves graduate student performance in cardiovascular, respiratory, and renal physiology. Adv Physiol Educ [Internet]. 2013 Dec [cited 2018 Oct 26];37(4):316–20. Available from: pmid:24292907
- 15. Wu J-C, Chi S-C, Wu C-C, Kang Y-N. Help from flipped classroom in learning suturing skill: The medical students’ perspective. Persano Adorno D, editor. PLoS One [Internet]. 2018 Oct 2 [cited 2018 Oct 17];13(10):e0204698. Available from: pmid:30278060
- 16. Pierce R, Fox J. Vodcasts and active-learning exercises in a "flipped classroom" model of a renal pharmacotherapy module. Am J Pharm Educ [Internet]. 2012 Dec 12 [cited 2018 Oct 26];76(10):196. Available from: pmid:23275661
- 17. Bossaer JB, Panus P, Stewart DW, Hagemeier NE, George J. Student Performance in a Pharmacotherapy Oncology Module Before and After Flipping the Classroom. Am J Pharm Educ [Internet]. American Association of Colleges of Pharmacy; 2016 Mar 25 [cited 2018 Nov 5];80(2):31. Available from: http://www.ncbi.nlm.nih.gov/pubmed/27073284 pmid:27073284
- 18. Geist MJ, Larimore D, Rawiszer H, Sager AW Al Flipped Versus Traditional Instruction and Achievement in a Baccalaureate Nursing Pharmacology Course. Nurs Educ Perspect [Internet]. 2015 Mar [cited 2018 Oct 26]; 36(2):114–5. Available from: http://insights.ovid.com/crossref?an=00024776-201503000-00009 pmid:29194136
- 19. Presti CR. The Flipped Learning Approach in Nursing Education: A Literature Review. J Nurs Educ [Internet]. 2016 May 1 [cited 2018 Oct 26]; 55(5):252–7. Available from: pmid:27115451
- 20. Njie-Carr VPS, Ludeman E, Lee MC, Dordunoo D, Trocky NM, Jenkins LS. An Integrative Review of Flipped Classroom Teaching Models in Nursing Education. J Prof Nurs [Internet]. 2017 Mar [cited 2018 Oct 26]; 33(2):133–44. Available from: https://linkinghub.elsevier.com/retrieve/pii/S8755722316300849 pmid:28363388
- 21. Betihavas V, Bridgman H, Kornhaber R, Cross M. The evidence for “flipping out”: A systematic review of the flipped classroom in nursing education. Nurse Educ Today [Internet]. 2016 Mar [cited 2018 Oct 26]; 38:15–21. Available from: https://linkinghub.elsevier.com/retrieve/pii/S026069171500516X pmid:26804940
- 22. Deprey SM. Outcomes of Flipped Classroom Instruction in an Entry-Level Physical Therapy Course. J Phys Ther Educ [Internet]. 2018 Sep [cited 2018 Nov 5]; 32(3):289–94. Available from: http://insights.ovid.com/crossref?an=00001416-201809000-00012
- 23. Moffett J, Mill AC. Evaluation of the flipped classroom approach in a veterinary professional skills course. Adv Med Educ Pract [Internet]. 2014 Nov [cited 2018 Oct 26]; 5:415–25. Available from: http://www.dovepress.com/evaluation-of-the-flipped-classroom-approach-in-a-veterinary-professio-peer-reviewed-article-AMEP pmid:25419164
- 24. Baepler P, Walker JD, Driessen M. It’s not about seat time: Blending, flipping, and efficiency in active learning classrooms. Comput Educ [Internet]. Elsevier Limited; 2014 Sep 1 [cited 2018 Nov 5]; 78:227–36. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0360131514001390
- 25. Sein-Echaluce ML; Fidalgo-Blanco A; Esteban-Escano J; Garcia-Penalvo FJ; Conde M. Using Learning Analytics to Detect Authentic Leadership Characteristics in Engineering Students. International J Eng Educ [Internet]. Tempus Publications; 2018 [cited 2018 Oct 26]; 34(3):851–64. Available from: http://apps.webofknowledge.com.cuarzo.unizar.es:9090/full_record.do?product=WOS&search_mode=GeneralSearch&qid=39&SID=D63BWMzLgncrDd1UJxv&page=1&doc=3
- 26. Weinstein RD. Improved performance via the inverted classroom. Chem Eng Educ. 2015; 49(3):141–8.
- 27. Sahin A, Cavlazoglu B, Zeytuncu YE. Flipping a College Calculus Course: A Case Study [Internet]. Journal of Educational Technology & Society. International Forum of Educational Technology & Society; 2015 [cited 2018 Nov 5]. p. 142–52. Available from: https://www.jstor.org/stable/jeductechsoci.18.3.142
- 28. Roach T. Student perceptions toward flipped learning: New methods to increase interaction and active learning in economics. Int Rev Econ Educ [Internet]. Elsevier; 2014 Sep 1 [cited 2018 Oct 30]; 17:74–84. Available from: https://www.sciencedirect.com/science/article/abs/pii/S1477388014000280
- 29. Albert M, Beatty BJ. Flipping the Classroom Applications to Curriculum Redesign for an Introduction to Management Course: Impact on Grades. J Educ Bus [Internet]. Routledge; 2014 Nov 17 [cited 2018 Nov 5]; 89(8):419–24. Available from: http://www.tandfonline.com/doi/abs/10.1080/08832323.2014.929559
- 30. Sage M, Sele P. Reflective Journaling as a Flipped Classroom Technique to Increase Reading and Participation with Social Work Students. J Soc Work Educ [Internet]. 2015 Oct 2 [cited 2018 Oct 26]; 51(4):668–81. Available from: https://www.tandfonline.com/doi/full/10.1080/10437797.2015.1076274 pmid:27672301
- 31. Holmes MR, Tracy EM, Painter LL, Oestreich T, Park H. Moving from Flipcharts to the Flipped Classroom: Using Technology Driven Teaching Methods to Promote Active Learning in Foundation and Advanced Masters Social Work Courses. Clin Soc Work J [Internet]. 2015 Jun 3 [cited 2018 Oct 26]; 43(2):215–24. Available from: http://link.springer.com/10.1007/s10615-015-0521-x
- 32. Balestrery JE. Social Work Education without Walls: Ethnography as a Lens for Transformative Learning. Soc Work Educ [Internet]. 2016 Aug 17 [cited 2018 Oct 26]; 35(6):615–31. Available from: https://www.tandfonline.com/doi/full/10.1080/02615479.2016.1151490
- 33. Rotellar C, Cain J. Research, Perspectives, and Recommendations on Implementing the Flipped Classroom. Am J Pharm Educ [Internet]. 2016 Mar [cited 2018 Oct 26]; 80(2):34. Available from: pmid:27073287
- 34. Kirkpatrick Donald L, Kirkpatrick JD. Evaluating training programs. The four levels. J Am Soc Train Dir. 1959; 13:3–9.
- 35. Burnham KD, Mascenik J. Comparison of student performance and perceptions of a traditional lecture course versus an inverted classroom format for clinical microbiology. J Chiropr Educ [Internet]. 2018 Oct [cited 2018 Nov 5]; 32(2):90–7. Available from: pmid:29873245
- 36. McLaughlin JE, Roth MT, Glatt DM, Gharkholonarehe N, Davidson CA, Griffin LM, et al. The flipped classroom: a course redesign to foster learning and engagement in a health professions school. Acad Med [Internet]. 2014 Feb [cited 2018 Nov 5]; 89(2):236–43. Available from: pmid:24270916
- 37. Beom JH, Kim JH, Chung HS, Kim SM, Ko DR, Cho J. Flipped-classroom training in advanced cardiopulmonary life support. Lepelletier D, editor. PLoS One [Internet]. 2018 Sep 5 [cited 2018 Nov 5]; 13(9):e0203114. Available from: pmid:30183739
- 38. Lombardini C, Lakkala M, Muukkonen H. The impact of the flipped classroom in a principles of microeconomics course: evidence from a quasi-experiment with two flipped classroom designs. Int Rev Econ Educ [Internet]. 2018 Sep [cited 2018 Nov 5]; 29:14–28. Available from: https://linkinghub.elsevier.com/retrieve/pii/S1477388016300500
- 39. Moyse Steinberg D. Some Findings from a Study on the Impact of Group Work Education on Social Work Practitioners’ Work with Groups. Soc Work Groups [Internet]. Taylor & Francis Group; 1993 Oct 4 [cited 2018 Nov 5]; 16(3):23–39. Available from: http://www.tandfonline.com/doi/abs/10.1300/J009v16n03_03
- 40. van Vliet EA, Winnips JC, Brouwer N. Flipped-Class Pedagogy Enhances Student Metacognition and Collaborative-Learning Strategies in Higher Education But Effect Does Not Persist. Wenderoth MP, editor. CBE—Life Sci Educ [Internet]. 2015 Sep [cited 2018 Oct 30]; 14(3):ar26. Available from: pmid:26113628
- 41. Smith JD. Student attitudes toward flipping the general chemistry classroom. Chem Educ Res Pr [Internet]. 2013 [cited 2018 Oct 30]; 14(4):607–14. Available from: http://xlink.rsc.org/?DOI=C3RP00083D
- 42. Manterola C, Zavando D. Cómo interpretar los Niveles de Evidencia en los diferentes escenarios clínicos. Rev Chil cirugía [Internet]. Sociedad de Cirujanos de Chile; 2009 Dec [cited 2018 Oct 30]; 61(6):582–95. Available from: http://www.scielo.cl/scielo.php?script=sci_arttext&pid=S0718-40262009000600017&lng=en&nrm=iso&tlng=en