Abstract
We discuss the findings of an analysis of cognitive orientation of 4,953 mathematical tasks (representing all bookwork, worksheets, and exams) used by five instructors teaching Calculus I in a two-year college in the United States over a one-semester period. This study uses data from one of 18 cases from the Characteristics of Successful Programs in College Calculus. We found differences in the cognitive orientation by type of course work assigned (graded vs. ungraded) and differences by the instructors who assigned the course work. We discuss implications for practice and propose some areas for further exploration.
Similar content being viewed by others
Notes
In our setting, the majority of tasks are not done in class, so looking at tasks as written is our best approximation of cognitive demand.
The cognitive demand of a task can be decreased through regular practice, memorization of specific routines, following examples superficially, or cheating.
Section 3.2.3 describes optimization problems that are not Apply Understanding.
We do not have labs and quizzes from one instructor.
Cohen’s κ allows assessing inter-rater reliability when there are two coders and the variables have several categories. This coefficient calculates agreement taking into account chance agreement. For that reason it is more stringent than calculating the rate of agreements to the total of agreements and disagreements. According to Landis and Koch (1977), κ = 0.40–0.59 reflects moderate inter-rater reliability, 0.60–0.79 substantial reliability, and 0.80 or greater outstanding reliability.
This process included the development of a system that included five other dimensions besides cognitive orientation. For details on the development of this framework see White et al. (2013).
Recall that our categorization includes an extra category not accounted for in the Tallman et al.’s analysis. Our Rich Task category is a subset of their category “required students to demonstrate an understanding of an idea or procedure.” This means that our proportions of Rich Tasks are conservative estimates of what their framework would produce.
References
Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Wittrock, M. C. (Eds.). (2001). A taxonomy for learning, teaching, and assessing. New York, NY: Longman.
Blair, R. (Ed.). (2006). Beyond crossroads: Implementing mathematics standards in the first two years of college. Memphis, TN: American Mathematical Association of Two Year Colleges.
Bloom, B. S., & Krathwohl, D. R. (1956). Taxonomy of educational objectives: the classification of educational goals. Handbook I: cognitive domain. New York, NY: Longmans, Green.
Bressoud, D. M., Carlson, M. P., Mesa, V., & Rasmussen, C. (2013). The calculus student: insights from the Mathematical Association of America national study. International Journal of Mathematical Education in Science and Technology, 44, 685–698. doi:10.1080/0020739X.2013.798874.
Charalambous, C. Y., Delaney, S., Hsu, H.-Y., & Mesa, V. (2010). A comparative analysis of the addition and subtraction of fractions in textbooks from three countries. Mathematical Thinking and Learning, 12(2), 117–151. doi:10.1080/10986060903460070.
Doyle, W. (1983). Academic work. Review of Educational Research, 53(2), 159–199.
Doyle, W. (1988). Work in mathematics classes: the context of students’ thinking during instruction. Educational Psychologist, 23, 167–180.
Fan, L., Zhu, Y., & Miao, Z. (2013). Textbook research in mathematics education: development status and directions. ZDM—The International Journal on Mathematics Education, 45, 633–646. doi:10.1007/s11858-013-0539-x.
Herbst, P., & Chazan, D. (2011). Research on practical rationality: studying the justification of actions in mathematics teaching. Montana Mathematics Enthusiast, 8, 405–462.
Krathwohl, D. R. (2002). A revision of Bloom’s taxonomy. Theory into Practice, 41, 212–218. doi:10.1207/s15430421tip4104.
Landis, J. R., Koch G. G (1977). The Measurement of Observer Agreement for Categorical Data. Biometrics, 33(1), 159–174.
Lattuca, L. R., & Stark, J. (2009). Shaping the college curriculum: Academic plans in action. San Francisco: Jossey-Bass.
Lee, V. E., Croninger, R. G., & Smith, J. B. (1997). Course-taking, equity, and mathematics learning: testing the constrained curriculum hypothesis in US secondary schools. Educational Evaluation and Policy Analysis, 19, 99–121.
Li, Y. (2011). A comparison of problems that follow selected content presentations in American and Chinese mathematics textbooks. Journal for Research in Mathematics Education, 31, 234–241.
Lithner, J. (2000). Mathematical reasoning in task solving. Educational Studies in Mathematics, 41, 165–190.
Lithner, J. (2004). Mathematical reasoning in calculus textbook exercises. The Journal of Mathematical Behavior, 23, 405–427. doi:10.1016/j.jmathb.2004.09.003.
Mesa, V., Gomez, P., & Cheah, U. (2013). Influence of international studies of student achievement on mathematics teaching and learning. In A. J. Bishop, C. Keitel, J. Kilpatrick, & F. K. Leung (Eds.), Third international handbook of mathematics education (pp. 861–900). New York, NY: Springer.
Mesa, V., & Griffiths, B. (2012). Textbook mediation of teaching: an example from tertiary mathematics instructors. Educational Studies in Mathematics, 79(1), 85–107.
Mesa, V., & Lande, E. (in press). Methodological considerations in the analysis of classroom interaction in community college trigonometry. In Y. Li, E. A. Silver & S. Li (Eds.), Transforming math instruction: Multiple approaches and practices. The Netherlands: Springer.
National Council of Teachers of Mathematics. (2000). Principles and standards for school mathematics. Reston, VA: National Council of Teachers of Mathematics.
Piaget, J. (1968). Six psychological studies. Trans. A. Tenzer. New York, NY: Crown Publishing Group/Random House.
Rico, L., Castro, E., Castro, E., Coriat, M., & Segovia, I. (1997). Bases teóricas del currículo de matemáticas en educación secundaria [Theoretical basis for mathematics curriculum in secondary education]. Madrid: Editorial Síntesis.
Smith, G., Wood, L., Coupland, M., Stephenson, B., Crawford, K., & Ball, G. (1996). Constructing mathematical examinations to assess a range of knowledge and skills. International Journal of Mathematical Education in Science and Technology, 27, 65–77.
Stein, M. K., & Lane, S. (1996). Instructional tasks and the development of student capacity to think and reason: an analysis of the relationship between teaching and learning in a reform mathematics project. Educational Research and Evaluation, 2, 50–80.
Stein, M. K., Smith, M. S., Henningsen, M. A., & Silver, E. A. (Eds.). (2000). Implementing standards-based mathematics instruction: a casebook for professional development. New York, NY: Teachers College Press.
Stewart, J. (2012). Calculus: early transcendentals (7th ed.). Stamford, CT: Brooks/Cole Cengage Learning.
Tallman, M., & Carlson, M. P. (2012). A characterization of calculus I final exams in U.S. colleges and universities. In proceedings of the 15th annual conference on research in undergraduate mathematics education (pp. 217–226). Portland, OR: Portland State University.
Valverde, G. A., Bianchi, L. J., Houang, R. T., Schmidt, W. H., & Wolfe, R. G. (2002). According to the book: using TIMSS to investigate the translation from policy to pedagogy in the world of textbooks. Dordrecht: Kluwer.
Watson, A., & Shipman, S. (2008). Using learner generated examples to introduce new concepts. Educational Studies in Mathematics, 69(2), 97–109.
White, N. J., Blum, C., & Mesa, V. (2013). A task analysis protocol for coursework for the Characteristics of Successful Programs in College Calculus. [Manuscript in Preparation]. School of Education, University of Michigan, Ann Arbor.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was partially funded by the National Science Foundation under Grant No. 0910240. The opinions expressed do not necessarily reflect the views of the Foundation. The Undergraduate Research Opportunity Program at the University of Michigan also provided funding for this project. We thank Cameron Blum who assisted with coding.
Rights and permissions
About this article
Cite this article
White, N., Mesa, V. Describing cognitive orientation of Calculus I tasks across different types of coursework. ZDM Mathematics Education 46, 675–690 (2014). https://doi.org/10.1007/s11858-014-0588-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11858-014-0588-9