Journal Papers


Roll, I., Holmes, N. G., Day, J., & Bonn, D. (accepted). On Guided Invention Activities that Support Scientific Reasoning and Domain Learning. To appear in Instructional Science.

Roll, I., Aleven, V., McLaren, B.M., & Koedinger, K.R. (2011). Improving students' help-seeking skills using metacognitive feedback in an intelligent tutoring system. Learning and Instruction, 21, 267-280.

Aleven, V., Roll, I., McLaren, B.M., & Koedinger, K.R. (2010). Automated, unobtrusive, action-by-action assessment of self-regulation during learning with an intelligent tutoring system. Educational Psychologist, 45(4), 224-233.

Baker, R. S. J. d., Corbett, A. T., Roll, I., & Koedinger, K. R. (2008). Developing a generalizable detector of when students game the system. User Modeling and User-Adapted Interaction, 18(3), 287-314.

Baker, R., Walonoski, J., Heffernan, N., Roll, I., Corbett, A., & Koedinger, K. R. (2008). Why students engage in "gaming the system" behavior in interactive learning environments. Journal of Interactive Learning Research, 19(2), 185-224.

Roll, I., Aleven, V., McLaren, B. M., & Koedinger, K. R. (2007). Designing for metacognition - applying cognitive tutor principles to the tutoring of help seeking. Metacognition and Learning, 2(2), 125-140.

Aleven, V., McLaren, B.M., Roll, I., & Koedinger, K.R. (2006). Toward meta-cognitive tutoring: A model of help seeking with a Cognitive Tutor. International Journal of Artificial Intelligence in Education (16), 101-130.

Book Chapters


Baker, R. S. J. d., Corbett, A. T., Roll, I., Koedinger, K. R., Cocea, M., Hershkovitz, A., et al. (to appear). Modeling and studying gaming the system with educational data mining. In R. Azevedo, & V. Aleven (Eds.), International Handbook of Metacognition and Learning Technologies. Berlin: Springer.

Koedinger, K. R., & Roll, I. (to appear). Learning to think: Cognitive mechanisms of knowledge transfer. In K. J. Holyoak, & R. G. Morrison (Eds.), The cambridge handbook of thinking and reasoning (2nd ed.). New York: Cambridge University Press.

Aleven, V., Roll, I., & Koedinger, K. R. (to appear). Progress in assessment and tutoring of lifelong learning skills: An intelligent tutor agent that helps students become better help seekers. In P. J. Durlach, & A. M. Lesgold (Eds.), Adaptive technologies for training and education. New York: Cambridge University Press.

Koedinger, K. R., Aleven, V., Roll, I., & Baker, R. S. J. d. (2009). In vivo experiments on whether supporting metacognition in intelligent tutoring systems yields robust learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of metacognition in education (pp. 383-412). New York: Routledge.

Strictly Refereed Conference Full Papers (in parenthesis - acceptance rate)


Roll, I., Aleven, V., & Koedinger, K. R. (2011). Metacognitive practice makes perfect: Improving students’ self-assessment skills with an intelligent tutoring system. In G. Biswas (Ed.), Proceedings of the International conference on artificial intelligence in education (pp. 288-295). Berlin: Springer Verlag. (32%)

Roll, I., Aleven, V., & Koedinger, K. R. (2011). Outcomes and mechanisms of transfer in invention activities. In L. Carlson, C. Hölscher, & T. Shipley (Eds.), Proceedings of the 33rd Annual Conference of the Cognitive Science Society (pp. 2824-2829). Austin, TX: Cognitive Science Society. (32%)

Roll, I., Aleven, V., & Koedinger, K. R. (2010). The invention lab: Using a hybrid of model tracing and constraint-based modeling to offer intelligent support in inquiry environments. In V. Aleven, J. Kay, & J. Mostow (Eds.), Proceedings of the international conference on intelligent tutoring systems (pp. 115-24). Berlin: Springer Verlag. (30%)

Roll, I., Aleven, V., & Koedinger, K. R. (2009). Helping students know 'further' - increasing the flexibility of students' knowledge using symbolic invention tasks. In N. A. Taatgen, & H. van Rijn (Eds.), Proceedings of the 31st annual conference of the cognitive science society (pp. 1169-1174). Austin, TX: Cognitive Science Society. (32%)

Roll, I., Aleven, V., McLaren, B. M., & Koedinger, K. R. (2007). Can help seeking be tutored? Searching for the secret sauce of metacognitive tutoring. In R. Luckin, K. R. Koedinger, & J. Greer (Eds.), Proceedings of the international conference on artificial intelligence in education (pp. 203-210). Amsterdam: IOS Press. (30%)

Roll, I., Aleven, V., McLaren, B. M., Ryu, E., Baker, R. S., & Koedinger, K. R. (2006). The help tutor: Does metacognitive feedback improve students' help-seeking actions, skills and learning? In M. Ikeda, K. D. Ashley, & T. W. Chan (Eds.), Proceedings of the 8th international conference on intelligent tutoring systems (pp. 360-369). Berlin: Springer Verlag. (35%)

Baker, R.S.J.d., Corbett, A.T., Koedinger, K.R., & Roll, I. (2006) Generalizing detection of gaming the system across a tutoring curriculum. In M. Ikeda, K. D. Ashley, & T. W. Chan (Eds.), Proceedings of the 8th international conference on intelligent tutoring systems (pp. 402-411). Berlin: Springer Verlag. (35%)

Baker, R.S.J.d., Corbett, A.T., Koedinger, K.R., Evenson, E., Roll, I., Wagner, A.Z., et al. (2006) Adapting to when students game an intelligent tutoring system. In M. Ikeda, K. D. Ashley, & T. W. Chan (Eds.), Proceedings of the 8th international conference on intelligent tutoring systems (pp. 392-401). Berlin: Springer Verlag. (35%)

Roll, I., Baker, R.S., Aleven, V., McLaren, B., & Koedinger, K. (2005). Modeling students’ metacognitive errors in two intelligent tutoring systems. In L. Ardissono, P. Brna and A. Mitrovic (Eds.), Proceedings of the 10th International Conference on User Modeling (pp. 379-388). Berlin: Springer Verlag. (23%)

Aleven, V., Roll, I., McLaren, B., Ryu, E.J., & Koedinger, K.R. (2005). An architecture to combine meta-cognitive and cognitive tutoring: Pilot testing the Help Tutor. In C. K. Looi, G. McCalla, B. Bredeweg, & J. Breuker (Eds.), Proceedings of the 12th International Conference on Artificial Intelligence in Education (pp. 17-24). Amsterdam, IOS Press. (31%)

Baker, R.S., Roll, I., Corbett, A.T., & Koedinger, K.R. (2005) Do performance goals lead students to game the system? In C. K. Looi, G. McCalla, B. Bredeweg, & J. Breuker (Eds.), Proceedings of the 12th International Conference on Artificial Intelligence in Education (pp. 57-64). Amsterdam, IOS Press. (31%)

Aleven, V., McLaren, B., Roll, I., & Koedinger, K. (2004). Toward tutoring help seeking: Applying cognitive modeling to meta-cognitive skills. In J. C. Lester, R. M. Vicario, & F. Paraguaçu (Eds.), Proceedings of Seventh International Conference on Intelligent Tutoring Systems (pp. 227-239). Berlin: Springer Verlag. (39%)

Other Refereed Conference, Symposium, Workshop, or Poster Presentations.


Roll, I. (accepted). Adaptive support and task generation in exploratory learning environments. To appear in the annual meeting of the American Education Research Association (AERA) 2012.

Roll, I. (accepted). Co­evolution of qualitative and symbolic reasoning in invention activities. To appear in the annual meeting of the American Education Research Association (AERA) 2012.

Aleven, V., Roll, I., McLaren, B. M., & Koedinger, Kenneth R. (accepted). Assessing Self-Regulated Learning: A (Meta)Cognitive Modeling Approach. To appear in the annual meeting of the American Education Research Association (AERA) 2012.

Roll, I., (2011, August). Assessments that matter. The 8th Annual Conference of the Alternative Education Resource Organization (AERO). Portland, OR.

Roll, I., Aleven, V., & Koedinger, K. R. (2011, April). The relationships between data mining, cognitive modeling, and learning theories: assessing and improving help-seeking skills. In P. Blikstein (Chair), Computing what the eye cannot see: Educational data mining, learning analytics, and computational techniques for detecting and evaluating patterns in learning. Symposium conducted at the annual meeting of the American Education Research Association (AERA). New Orleans, LA.

Roll, I. (2010, June). Scaffold and feedback in scientific inquiry environments: The case of the invention lab. In I. Roll, M. Mavrikis, & S. G. Santos (Chairs.), the 3rd Workshop on Intelligent Support in Exploratory Environments (ISEE), in conjunction with the 9th International Conference of the Learning Sciences (ICLS), Chicago, IL.

Roll, I., Aleven, V., & Koedinger, K. R. (2010, June). Analysis of students' actions during online invention activities - seeing the thinking through the numbers. In R. S. J. d. Baker & J. D. Gobert (Chairs), Qualitative, Quantitative, and Data Mining Methods for Analyzing Log Data to Characterize Students' Learning Strategies and Behaviors. Symposium conducted at the 9th International Conference of the Learning Sciences (ICLS) (pp. 45-52). Chicago, IL.

Roll, I., Aleven, V., & Koedinger, K.R. (2008). Designing structured invention tasks to prepare for future learning [abstract]. In B. C. Love, K. McRae, & V. M. Sloutsky (Eds.), Proceedings of the 30th annual conference of the cognitive science society. Austin, TX: Cognitive Science Society.

Roll, I., Aleven, V., & Koedinger, K.R. (2008). Instruments and challenges in assessing help-seeking knowledge and behavior. In I. Roll, & V. Aleven (Eds.), Proceedings of the Workshop on Metacognition and Self-Regulated Learning in Educational Technologies (SRL@ET), in conjunction with the International Conference on Intelligent Tutoring Systems (ITS) (pp. 41-50). Montreal, Canada.

Kao, Y. S., Roll, I., & Koedinger, K. R. (2007). Sources of difficulty in multi-step geometry area problems. In D. S. McNamara, & J. G. Trafton (Eds.), Proceedings of the 29th annual conference of the cognitive science society (pp. 1145-50). Austin, TX: Cognitive Science Society.

Koedinger, K.R., Aleven, V., Baker, R.S.J.d., & Roll, i. (2007). Toward understanding when tutoring meta-cognition enhances domain learning. In I. Roll, & V. Aleven (Eds.), Proceedings of the workshop for metacognition and self-regulated learning in intelligent tutoring systems (SRL@ET), in conjunction with the International Conference on Artificial Intelligence in Education, LA, CA.

Roll, I., Ryu, E., Sewall, J., Leber, B., McLaren, B. M., Aleven, V., et al. (2006). Towards teaching metacognition: Supporting spontaneous self-assessment. In Proceedings of the international conference on intelligent tutoring systems (pp. 738-740). Berlin: Springer Verlag.

Baker, R.S., Corbett, A.T., Koedinger, K.R., & Roll, I. (2005). Detecting when students game the system, across tutor subjects and classroom cohorts. In L. Ardissono, P. Brna, & A. Mitrovic (Eds.), User modeling 2005. Berlin: Springer-Verlag.

Roll, I., Aleven, V., & Koedinger, K. R. (2004). Promoting effective help-seeking behavior through declarative instruction. In J. C. Lester, R. M. Vicario, & F. Paraguaçu (Eds.), Proceedings of 7th International Conference on Intelligent Tutoring Systems (ITS) (pp. 854-6). Berlin: Springer-Verlag.

Roll, I., Baker, R.S., Aleven, V., & Koedinger, K.R. (2004). A metacognitive ACT-R model of students’ learning strategies in intelligent tutoring systems. In J. C. Lester, R. M. Vicario, & F. Paraguaçu (Eds.), Proceedings of 7th International Conference on Intelligent Tutoring Systems (ITS) (pp. 854-6). Berlin: Springer-Verlag.

Roll, I., Baker, R.S., Aleven, V., & Koedinger, K.R. (2004). What goals do students have when choosing the actions they perform? In M. Lovett, C. Schunn, C. Lebiere, & P. Munro (Eds.), Sixth International conference on cognitive modeling. (pp. 380-1). Mahwah, NJ: Lawrence Erlbaum.