Artificial Intelligence in Medicine
Volume 38, Issue 1 , Pages 25-46 , September 2006

An intelligent tutoring system that generates a natural language dialogue using dynamic multi-level planning

  • Chong Woo Woo

      Affiliations

    • School of Computer Science, Kookmin University, 861-1 Chongnung-Dong, Sungbuk-Ku, Seoul, Republic of Korea
  • ,
  • Martha W. Evens

      Affiliations

    • Computer Science Department, Illinois Institute of Technology, Room 236, 10 West 31st Street, Chicago, IL 60616, USA
    • Corresponding Author InformationCorresponding author. Tel.: +1 312 567 5153; fax: +1 312 567 5067.
  • ,
  • Reva Freedman

      Affiliations

    • Northern Illinois University, De Kalb, IL 60115, USA
  • ,
  • Michael Glass

      Affiliations

    • Valparaiso University, Valparaiso, IN 46383, USA
  • ,
  • Leem Seop Shim

      Affiliations

    • HS Tech, Inc., 26500 Agoura Road, Suite #108, Calabasas, CA 91302, USA
  • ,
  • Yuemei Zhang

      Affiliations

    • Wells Fargo - N9301-01J, 255 Second Avenue South, Minneapolis, MN 55479, USA
  • ,
  • Yujian Zhou

      Affiliations

    • WebEx Communications, Inc., 3979 Freedom Circle, Santa Clara, CA 95054, USA
  • ,
  • Joel Michael

      Affiliations

    • Department of Molecular Biophysics and Physiology, Rush Medical College, 1750 West Harrison, Chicago, IL 60612, USA

Received 16 February 2005 ,Revised 14 October 2005 ,Accepted 21 October 2005.

References 

  1. Rovick AA, Brenner L. HEARTSIM: a cardiovascular simulation with didactic feedback. The Physiologist. 1983;26:236–239
  2. Rovick AA, Michael JA. CIRCSIM: An IBM PC computer teaching exercise on blood pressure regulation, paper given at XXX IUPS Congress. Vancouver: IUPS; 1986;
  3. Hunink M, Glasziou P, Siegel J, Weeks J, Pliskin J, Elstein A, et al. Decision making in health and medicine: integrating evidence and values. Cambridge: Cambridge University Press; 2001;
  4. Michael JA, Rovick AA, Evens MW, Kim N. A smart tutor based on a qualitative causal model. In: Proceedings of the AAAI spring symposium on knowledge-based environments for learning and teaching. Menlo Park, CA: AAAI; 1990;p. 112–117
  5. Forbus KD. Qualitative process theory. Artif Intell. 1984;24:85–168
  6. Forbus KD. Articulate software for science and engineering education. In:  Forbus KD,  Feltovich PJ editor. Smart machines in education. Cambridge: MIT Press; 2001;p. 349–375
  7. Kuipers B. Commonsense reasoning about causality: deriving behavior from structure. Artif Intell. 1984;24:169–203
  8. Anderson JR. The expert module. In:  Polson MC,  Richardson JJ editor. Foundations of intelligent tutoring systems. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988;p. 21–53
  9. Rovick AA, Michael JA. The predictions table: a tool for assessing students’ knowledge. Am J Physiol. 1992;263:S33–S36
  10. Kim N. CIRCSIM–Tutor: an intelligent tutoring system for circulatory physiology. Unpublished doctoral dissertation, Chicago, IL: Illinois Institute of Technology; 1989.
  11. Kim N, Evens MW, Michael JA, Rovick AA. CIRCSIM–TUTOR: an intelligent tutoring system for circulatory physiology. In:  Mauer H editors. Proceedings of the international conference on computer assisted learning. Berlin: Springer-Verlag; 1989;p. 254–266
  12. Evens MW, Michael JA. One-on-one tutoring by humans and computers. Mahwah, NJ: Lawrence Erlbaum Associates; 2005;
  13. Chi MTH, de Leeuw N, Chiu MH, LaVancher C. Eliciting self-explanations improves understanding. Cognit Sci. 1994;18:439–477
  14. Fox Tree JE. Listening in on monologues and dialogues. Discourse Process. 1999;27:35–53
  15. Fox B. The human tutorial dialogue project. Hillsdale, NJ: Lawrence Erlbaum Associates; 1993;
  16. Carbonell JR. AI in CAI: an artificial intelligence approach to computer-aided instruction, IEEE Transactions on Man–Machine Systems. MMS. 1970;11:190–202
  17. Carr B, Goldstein IP. Overlays: a theory of modeling for computer aided instruction. MIT AI Memo 406. Cambridge: AI Laboratory; 1977;
  18. Burton RR, Brown JS. Toward a natural language capability for computer-assisted instruction. In:  O’Neill H editors. Procedures for instructional systems development. New York: Academic Press; 1979;p. 272–313
  19. Collins AM, Stevens AL. Goals and strategies of inquiry teachers. In:  Glaser R editors. Advances in instructional psychology. vol. 2:Hillsdale, NJ: Lawrence Erlbaum Associates; 1982;p. 65–119
  20. Wilensky R, Arens Y, Chin D. Talking to Unix in English. Commun Assoc Comput Mach. 1984;27:574–593
  21. Wilensky R, Chin D, Luria M, Martin J, Mayfield J, Wu D. The Berkeley Unix Consultant project. Comput Linguistics. 1988;14:35–84
  22. Woolf BP. Context dependent planning in a machine tutor. Unpublished doctoral dissertation, University of Massachusetts, Amherst, MA, 1984.
  23. Woolf BP. 20 years in the trenches: what have we learned?. In:  Goettl B,  Halff H,  Redfield C,  Shute VJ editor. Proceedings of the intelligent tutoring systems, ITS. Berlin: Springer; 1988;p. 33–39
  24. Cawsey A. Explanation and interaction: the computer generation of explanatory dialogues. Cambridge: MIT Press; 1992;
  25. Freedman R, Rosé CP, Ringenberg M, VanLehn K. ITS tools for natural language dialogue: a domain-independent parser and planner. In:  Gauthier G,  Frasson C,  VanLehn K editor. Proceedings of the Intelligent Tutoring Systems, ITS-2000. Berlin: Springer; 2000;p. 433–442
  26. Rosé CP, Jordan P, Ringenberg M, Siler S, VanLehn K, Weinstein A. Interactive conceptual tutoring in Atlas-Andes. In:  Moore JD,  Redfield CL,  Johnson WL editor. Proceedings of the artificial intelligence in education. Amsterdam: IOS Press; 2001;p. 256–266
  27. Freedman R. Using a reactive planner as the basis for a dialogue agent. In:  Etheredge J,  Manaris B editor. Proceedings of the 13th Florida artificial intelligence research symposium. Menlo Park, CA: AAAI Press; 2000;p. 52–59
  28. Rosé CP, Bhembe D, Roque A, Siler S, Srivastava R, VanLehn K. A hybrid language understanding approach for robust selection of tutoring goals. In:  Cerri SA,  Gouardères G,  Paraguaçu F editor. Proceedings of the intelligent tutoring systems, ITS 2002. Berlin: Springer; 2002;p. 552–561
  29. Jordan P, Makatchev M, VanLehn K. Abductive theorem proving for analyzing student explanations. In:  Verdego F,  Kay J,  Pain H,  Aleven V editor. Proceedings of the artificial intelligence in education. Amsterdam: IOS Press; 2003;p. 73–80
  30. Jordan P, Makatchev M, VanLehn K. Combining competing language understanding approaches in an intelligent tutoring system. In:  Lester JC,  Vicari RM,  Paraguaçu F editor. Proceedings of the intelligent tutoring systems, ITS 2004. Berlin, Germany: Springer-Verlag; 2004;p. 346–357
  31. Graesser AC, Wiemer-Hastings K, Wiemer-Hastings P, Kreuz R. And the tutoring research group, AutoTutor: a simulation of a human tutor. J Cognit Syst Res. 1999;1:35–51
  32. VanLehn K, Jordan PW, Rosé CP, Bhembe D, Bottner M, Gaydos A, et al. The architecture of Why2-Atlas: A coach for qualitative physics essay writing. In:  Cerri SA,  Gouardères G,  Paraguaçu F editor. Proceedings of the intelligent tutoring systems, ITS 2002. Berlin: Springer; 2002;p. 158–167
  33. Graesser AC, Jackson GT, Mathews EC, Mitchell HH, Olney A, Ventura M, Chipman P, Franceschetti PD, Hu X, Louwerse MM, Person NK, TRG, 2003. Why/AutoTutor: a test of learning gains from a physics tutor with natural language dialog, in: Alterman R, Hirsh D, editors, Proceedings of the 25th annual conference of the cognitive science society (Lawrence Erlbaum Associates, Hillsdale, NJ, 2003) p. 1–5.
  34. VanLehn K, Bhembe D, Chi M, Lynch C, Schulze K, Shelby R, et al. Implicit vs. explicit learning of strategies in a non-procedural cognitive skill. In:  Lester JC,  Vicari RM,  Paraguaçu F editor. Intelligent tutoring systems, ITS 2004. Berlin: Springer; 2004;p. 521–530
  35. Lane HC, VanLehn K. Teaching the tacit knowledge of programming to novices with natural language tutoring, in: Fitzgerald S, Guzdial M, editors, special issue of Computer Science Education.
  36. Aleven V. Using background knowledge in case-based legal reasoning: A computational model and an intelligent learning environment. Artif Intell. 2003;150:183–237
  37. Ashley K, Desai R, Levine JM. Teaching case-based argumentation concepts using dialectic arguments vs. didactic explanations. In:  Cerri SA,  Gouardères G,  Paraguaçu F editor. Proceedings of the ITS 2002. Berlin: Springer; 2002;p. 585–595
  38. Di Eugenio B, Fossati D, Yu D, Haller S, Glass M. Aggregation improves learning: experiments in natural language generation for intelligent tutoring systems. In: Proceedings of the annual meeting of the association for computational linguistics. East Stroudsburg, PA: ACL; 2005;p. 50–57
  39. Moore JD, Foster ME, Lemon O, White M. Generating tailored, comparative descriptions in spoken dialogue. In:  Barr B,  Markov Z editor. Proceedings of the 17th international Florida artificial intelligence research society conference. Menlo Park, CA: AAAI Press; 2004;p. 917–922
  40. Moore JD, Porayska-Pomsta K, Varges S, Zinn C. Generating tutorial feedback with affect. In:  Barr V,  Markov Z editor. Proceedings of the 17th international florida artificial intelligence research society conference. Menlo Park, CA: AAAI Press; 2004;p. 923–928
  41. Rosé CP, Torrey C, Aleven V, Robinson A, Wu C, Forbus K. CycleTalk: Toward a dialogue agent that guides design with an articulate simulator. In:  Lester JC,  Vicari RM,  Paraguaçu F editor. Proceedings of the intelligent tutoring systems, ITS 2004. Berlin: Springer; 2004;p. 401–411
  42. Litman DJ, Rosé CP, Forbes-Riley K, VanLehn K, Bhembe D, Silliman S. Spoken versus typed human and computer dialogue tutoring. In:  Lester JC,  Vicari RM,  Paraguaçu F editor. Proceedings of the intelligent tutoring systems (ITS 2004). Berlin: Springer; 2004;p. 368–379
  43. Bratt EO, Clark B, Thomsen-Gray Z, Peters S, Treeratpituk P, Pon-Barry H, et al. Model-based reasoning for tutorial dialogue in shipboard damage control. In:  Cerri SA,  Gouardères G,  Paraguaçu F editor. Proceedings of the ITS 2002. Berlin: Springer; 2002;p. 63–69
  44. Khuwaja RA, Rovick AA, Michael JA, Evens MW. Knowledge representation for an intelligent tutoring system based on a multilevel causal model. In:  Frasson C,  Gauthier G,  McCalla GI editor. Proceedings of the intelligent tutoring systems (ITS 1992). Berlin: Springer; 1992;p. 217–224
  45. Hume G, Michael JA, Rovick AA, Evens M. Hinting as a tactic in one-on-one tutoring. J Learn Sci. 1996;5:23–47
  46. Michael JA, Rovick AA, Evens MW, Shim L, Woo CW, Kim N. The uses of multiple student inputs in modeling and lesson planning in CAI and ICAI programs. In:  Tomek I editors. Proceedings of the international conference on computer assisted learning. Berlin: Springer; 1992;p. 441–452
  47. Elsom-Cook M. Using multiple teaching strategies in an ITS. In:  Goettl B,  Halff H,  Redfield C,  Shute VJ editor. Proceedings of the intelligent tutoring systems (ITS-88). Berlin: Springer; 1988;p. 286–290
  48. Zhang Y, Knowledge-based discourse generation for an intelligent tutoring system, unpublished PhD Dissertation, Illinois Institute of Technology, Chicago, IL, 1991.
  49. Zhou Y, Freedman R, Glass M, Michael JA, Rovick AA, Evens MW. Delivering hints in a dialogue-based intelligent tutoring system. In: Proceedings of the 17th national conference on artificial intelligence. Menlo Park, CA: AAAI Press; 1999;p. 128–134
  50. Michael JA, Rovick AA, Glass MS, Zhou Y, Evens MW. Learning from a computer tutor with natural language capabilities. Interact Learn Environ. 2003;11:233–262
  51. Heller LJ, Mohrman D. Cardiovascular physiology. Stamford, CT: McGraw-Hill/Appleton and Lange; 1981;
  52. Kearsley G. Artificial intelligence and instruction: application and methods. Reading, MA: Addison-Wesley; 1987;
  53. Wenger E. Artificial intelligence and tutoring systems. Los Altos, CA: Morgan Kaufmann; 1987;
  54. Woo CW. Instructional planning in an intelligent tutoring system: combining global lesson plans with local discourse control. Unpublished doctoral dissertation, Illinois Institute of Technology, Chicago, IL, 1991.
  55. Woo CW, A multi-level dynamic instructional planner for an intelligent tutoring system, ONR Technical Report, 1992.
  56. Norman DA. The design of everyday things. New York: Doubleday; 1990;
  57. Norman DA, Draper SW. User centered system design: new perspectives on human–computer interaction. Hillsdale, NJ: Lawrence Erlbaum Associates; 1986;
  58. Shneiderman B. Response time and display rate in human performance with computers. ACM Comput Surv. 1984;16:265–285
  59. Murray WR. Control for intelligent tutoring systems: a blackboard-based dynamic instructional planner. In:  Bierman D,  Breuker J,  Sandberg J editor. Proceedings of the fourth international conference on artificial intelligence in education, AI-ED 89. Amsterdam: IOS Press; 1989;p. 150–168
  60. Brecht B, McCalla G, Greer J, Jones M. Planning the content of instruction. In:  Biermann D,  Breuker J,  Sandberg J editor. Proceedings of the fourth international conference on AI and education. Amsterdam: IOS Press; 1989;p. 32–41
  61. Derry SJ, Hawkes LW, Ziegler U. A plan-based opportunistic architecture for intelligent tutoring. In:  Goettl B,  Halff H,  Redfield C,  Shute VJ editor. Proceedings of the intelligent tutoring systems (ITS-88). Berlin: Springer; 1988;p. 116–123
  62. Peachey DR, McCalla GI. Using planning techniques in intelligent tutoring systems. Int J Man-Mach Stud. 1986;24:77–88
  63. Russell DM. IDE: the interpreter. In:  Psotka J,  Massey LD,  Mutter SA editor. Intelligent tutoring systems: lessons learned. Hillsdale, NJ: Lawrence Erlbaum Publishers; 1988;p. 323–349
  64. Vassileva J. Dynamic course generation on the WWW. In:  du Boulay B,  Mizoguchi R editor. Proceedings of the eighth world conference of the artificial intelligence in education society. Amsterdam: IOS Press; 1997;p. 498–505
  65. Woo CW, Choi J, Evens MW. Web-based ITS for training system managers on the computer intrusion. In:  Cerri SA,  Gouardères G,  Paraguaçu F editor. Proceedings of the intelligent tutoring systems, ITS 2002. Berlin: Springer; 2002;p. 311–319
  66. Woo CW, Evens MW, Michael JA, Rovick AA. Dynamic instructional planning for an intelligent physiology tutoring system. In: Proceedings of the fourth IEEE symposium on computer-based medical systems. Piscataway, NJ: IEEE; 1991;p. 226–233
  67. Lee CH, Evens MW, Glass MS. Looking at the student input to a natural language-based tutoring system. In:  Heffernan N,  Wiemer-Hastings P editor. Proceedings of the ITS 2004 workshop on dialogue-based tutoring systems. Berlin: Springer; 2004;p. 15–22
  68. Sanders G. Generation of explanations and multi-turn discourse structures in tutorial dialogue based on transcript analysis. Unpublished doctoral dissertation, Illinois Institute of Technology, Chicago, IL, 1995.
  69. Wielinga BJ, Breuker JA. Models of expertise. Int J Intell Syst. 1990;5:497–509
  70. Winkels R, Breuker J, Sandberg J. Didactic discourse in intelligent help systems. In:  Goettl B,  Halff H,  Redfield C,  Shute VJ editor. Proceedings of the intelligent tutoring systems, ITS-88. Berlin: Springer; 1988;p. 279–285
  71. Lee CH, Seu JH, Evens MW. Building an ontology for CIRCSIM–Tutor. In: Proceedings of the MAICS 2002. Chicago: IIT; 2002;p. 161–168
  72. Zhang Y, Evens MW, Michael JA, Rovick AA. Knowledge compiler for an expert physiology tutor. In: Proceedings of the ESD/SMI conference on expert systems. Dearborn, MI: ESD; 1987;p. 153–169
  73. Zhang Y, Evens MW, Michael JA, Rovick AA. Extending a knowledge base to support explanations. In: Proceedings of the third annual IEEE symposium on computer-based medical systems. Piscataway, NJ: IEEE; 1990;p. 259–266
  74. Clancey WJ. Intelligent tutoring systems: A tutorial survey. Report No. STAN-CS-87-1174, Stanford, CA, 1987.
  75. Brandle SS. Using joint actions to explain acknowledgments in tutorial discourse: application to intelligent tutoring systems. Unpublished doctoral dissertation, Illinois Institute of Technology, Chicago, IL, 1998.
  76. Clark HH. Using language. Cambridge, UK: Cambridge University Press; 1996;
  77. Zhou Y, Evens M. Practical student model in an intelligent tutoring system. In: Proceedings of the 11th IEEE international conference on tools with artificial intelligence. Piscataway, NJ: IEEE Press; 1999;p. 13–18
  78. Zhou Y, Freedman R, Glass M, Michael JA, Rovick AA, Evens MW. What should the tutor do when the student cannot answer a question?. In:  Kumar A,  Russell I editor. Proceedings of the 12th international Florida AI research society conference (FLAIRS-99). Menlo Park, CA: AAAI Press; 1999;p. 187–191
  79. Elmi M, Evens M. Spelling correction using context. In: Proceedings of the 17th international conference on computational linguistics. East Stroudsburg, PA: ACL; 1998;p. 360–364
  80. Lee YH. Handling ill-formed natural language input for an intelligent tutoring system. Unpublished doctoral dissertation, Illinois Institute of Technology, Chicago, 1990.
  81. Lee YH, Evens MW. Natural language interface for an expert system. Expert Syst Int J Knowledge Eng. 1998;15:233–239
  82. Glass MS. Broadening input understanding in a language-based intelligent tutoring system. Unpublished doctoral dissertation, Illinois Institute of Technology, Chicago, 1999.
  83. Glass M. Processing language input in the CIRCSIM–Tutor intelligent tutoring system. In:  Moore JD,  Redfield CL,  Johnson WL editor. Proceedings of the artificial intelligence in education. Amsterdam: IOS Press; 2001;p. 210–221
  84. Roche E, Schabes Y. Finite state devices for natural language processing. Cambridge: MIT Press; 1997;
  85. Lee CH, Evens MW. Using selectional restrictions to parse and interpret student answers in a cardiovascular tutoring system. In:  Berkowitz E editors. Proceedings of the midwest artificial intelligence and cognitive science conference, MAICS 2004. Schaumburg, IL: Roosevelt U; 2004;p. 63–67
  86. Shah F, Evens MW, Michael JA, Rovick AA. Classifying student initiatives and tutor responses in human keyboard-to-keyboard tutoring sessions. Discourse Process. 2002;33:23–52
  87. VanLehn K. Student modeling. In:  Polson MC,  Richardson JJ editor. Foundations of intelligent tutoring systems. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988;p. 55–78
  88. Brown JS, Burton RR. Diagnostic models for procedural bugs in basic mathematical skills. Cognit Sci. 1978;2:155–192
  89. Shim L, Evens MW, Rovick AA, Michael JA. Effective cognitive modeling in an intelligent tutoring system for cardiovascular physiology. In: Proceedings of the fourth IEEE symposium on computer-based medical systems. Piscataway, NJ: IEEE; 1991;p. 338–345
  90. Chang RC. Surface level generation of tutorial dialogue using a specially developed lexical functional grammar and lexicon. Unpublished doctoral dissertation, Illinois Institute of Technology, Chicago, Illinois, 1992.
  91. Chang RC, Evens MW, Michael JA, Rovick AA. Surface generation in tutorial dialogues based on a sublanguage study. In:  Chang YF editors. Proceedings of the ICAST’94. Naperville, IL: CAPAMA; 1994;p. 113–119
  92. In:  Bresnan J editors. The mental representations of grammatical relations. Cambridge: MIT Press; 1982;p. 173–281
  93. Kaplan R. The formal architecture of lexical-functional grammar. J Informat Sci Eng. 1989;5:305–322
  94. Lepper MR, Woolverton M, Mumme DL, Gurtner JL. Motivational techniques of expert human tutors: lessons for the design of computer-based tutors. In:  Lajoie S,  Derry S editor. Computers as cognitive tools. Hillsdale, NJ: Lawrence Erlbaum Associates; 1993;p. 75–105
  95. Kim JH, Glass MS, Freedman R, Evens MW. Learning the use of discourse markers in tutorial dialogue for an intelligent tutoring system. In:  Gleitman LR,  Joshi AK editor. Proceedings of the cognitive science 2000. Mahwah, NJ: Lawrence Erlbaum Associates; 2000;p. 262–267
  96. Yang FJ, Kim JH, Glass MS, Evens MW. Lexical issues in the tutoring schemata of CIRCSIM–Tutor: analysis of variable references and discourse markers. In:  Benedict M editors. Proceedings of the human interfaces to complex systems. Urbana: Beckman Institute; 2000;p. 26–31
  97. Yang FJ, Kim JH, Glass MS, Evens MW. Turn planning in CIRCSIM–Tutor. In:  Etheredge J,  Manaris B editor. Proceedings of the Florida artificial intelligence symposium. Menlo Park, CA: AAAI Press; 2000;p. 60–64
  98. Cho BI, Michael JA, Rovick AA, Evens MW. A curriculum planning model for an intelligent tutoring system. In:  Kumar A,  Russell I editor. Proceedings of the 12th Florida artificial intelligence symposium (FLAIRS-99). Menlo Park, CA: AAAI Press; 1999;p. 197–201
  99. Cho BI, Michael JA, Rovick AA, Evens MW. An analysis of multiple tutoring protocols. In:  Gauthier G,  Frasson C,  VanLehn K editor. Proceedings of the ITS 2000. Berlin: Springer; 2000;p. 212–221

PII: S0933-3657(05)00109-0

doi: 10.1016/j.artmed.2005.10.004

Artificial Intelligence in Medicine
Volume 38, Issue 1 , Pages 25-46 , September 2006