assessment in computing

The Assessment of Computing for Elementary Students (ACES) is a measure of computational thinking for upper-elementary students. The assessment currently focuses on loops and sequences, with block-based and Bebras-style questions. We published on creating and piloting the assessment and are currently working on further validation and expansion of the ACES. A video of our SIGCSE 2021 conference presentation can be found here.

Parker, M.C., Kao, Y.S., Saito-Stehberger, D., Franklin, D., Krause, S., Richardson, D., and Warschauer, M. 2021. Development and Preliminary Validation of the Assessment of Computing for Elementary Students (ACES). In SIGCSE ’21: The 52nd ACM Technical Symposium on Computer Science Education, March 17 – 21, 2021, Toronto, Canada. ACM, New York, NY, USA, 7 pages. https://doi.org/10.1145/1122445.1122456

Parker, M.C., Garcia, L., Kao, Y.S., Franklin, D., Krause, S., Warschauer, M. 2022. A Pair of ACES: An Analysis of Isomorphic Questions on an Elementary Computing Assessment. In Proceedings of the 2022 ACM Conference on International Computing Education Research V.1 (ICER 2022), August 7–11, 2022, Lugano and Virtual Event, Switzerland. ACM, New York, NY, USA, 13 pages. https://doi.org/10.1145/3501385.3543979

The Second CS1 Assessment (SCS1) is a validated, pseudocode-based assessment for introductory computing. We shared our process of replicating a previously validated assessment and validating the replication. SCS1 can be used to measure student learning in various research interventions and to build and improve other CS assessments. We also conducted a retrospective of SCS1 five years after its release, remarking on how the computing education community has used and adapted the assessment, as well as an analysis of whether there are subscales within SCS1 that can be independently used to measure CS1 concepts.

If you’re interested in using the SCS1 in your classroom or research, please click here for more information.

Parker, M. C., Guzdial, M., & Engleman, S. (2016, August). Replication, validation, and use of a language independent CS1 knowledge assessment. In Proceedings of the 2016 ACM conference on international computing education research (pp. 93-101). ACM.

Parker, M.C., Guzdial, M., Tew, A.E. "Uses, Revisions, and the Future of Validated Assessments in Computing Education: A Case Study of the FCS1 and SCS1." ICER 2021.

Parker, M.C., Davidson, M. J., Kao, Y. S., Margulieux L. E., Tidler, Z. R., Vahrenhold, J. “Toward CS1 Content Subscales: A Mixed-Methods Analysis of an Introductory Computing Assessment.” Koli Calling 2023.


Achievement in computing

Socioeconomic status (SES) is correlated with academic achievement, including computer science achievement. We explored the relationship between SES and CS achievement via mediating variables, namely spatial reasoning and access to computing. We found further evidence to support the relationship between spatial reasoning and SES and CS, which is promising for future efforts to minimize achievement gaps for low-SES students in CS.

Parker, M. C., Solomon, A., Pritchett, B., Illingworth, D. A., Marguilieux, L. E., & Guzdial, M. (2018, August). Socioeconomic Status and Computer Science Achievement: Spatial Ability as a Mediating Variable in a Novel Model of Understanding. In Proceedings of the 2018 ACM Conference on International Computing Education Research (pp. 97-105). ACM.

Big-O analysis can be an incredibly difficult topic for undergraduates learning computer science. What is it about runtime analysis that make it hard for students to understand? We found that logarithms are a critical piece of the puzzle.

Parker, M., & Lewis, C. (2014). What makes big-O analysis difficult: understanding how students understand runtime analysis. Journal of Computing Sciences in Colleges, 29(4), 164-174.


Access to computing

The crux of my dissertation work focused on the supports and barriers to accessing computing at the school level. I explored the relationship between public high schools in Georgia offering computer science and possible predictive variables at the school, district, and county levels. I followed this with building case studies of select schools that personify different aspects of the computer science landscape, to investigate esoteric variables that aren’t currently gathered in large, publicly-available data sets.

Parker, M. C., & Hendrickson, K. A. (2022). Capacity-related factors associated with computer science access and participation in Georgia public high schools. Policy Futures in Education, 14782103221081920.

Parker, M. C. (2022). Barriers and Supports to Offering Computer Science in High Schools: A Case Study of Structures and Agents. ACM Transactions on Computing Education.

Parker, M.C. (2019). An Analysis of Supports and Barriers to Offering Computer Science in Georgia Public High Schools (Doctoral dissertation, Georgia Institute of Technology).

Elementary Computing for All (ECforALL) is an NSF- and DOE-funded project centered around a weekly Scratch-based curriculum for all elementary students to learn computational thinking. Built on a research-practice partnership with Santa Ana Unified School District in Orange County, California, ECforALL uses linguistic scaffolding, inquiry-based learning methods, and culturally responsive pedagogy to support multilingual students.

Jacob, S. R., Parker, M. C., Warschauer, M. (2022, January). Integration of Computational Thinking Into English Language Arts. In Computational Thinking in PreK-5: Empirical Evidence for Integration and Future Directions. ACM.

As computer science grows, teachers need resources for learning the content and pedagogical content knowledge needed to teach their students. Our work has focused on building browser-based eBooks for computer science, especially for AP CS Principles. Even though both teacher and students are learning the material for the first time, our research provides evidence that teachers use the eBook differently than their students.

Check out our eBook for students in CS Principles here.

Ericson, B. J., Rogers, K., Parker, M., Morrison, B., & Guzdial, M. (2016, August). Identifying design principles for CS teacher Ebooks through design-based research. In Proceedings of the 2016 ACM Conference on International Computing Education Research (pp. 191-200). ACM.

Parker, M. C., Rogers, K., Ericson, B. J., & Guzdial, M. (2017, August). Students and Teachers Use An Online AP CS Principles EBook Differently: Teacher Behavior Consistent with Expert Learners. In Proceedings of the 2017 ACM Conference on International Computing Education Research (pp. 101-109). ACM.