CA2219262A1 - Interactive learning system with pretest - Google Patents

Abstract

A computer method of automatically providing a paperless, individualized, learning sequence including the steps of storing in a computer readable database a plurality of questions directed toward assessing an individual's understanding of a selected learning objective for each member of a plurality of different learning objectives. Next, automatically evaluating the individual by randomly and sequentially selecting from the database at least one question associated with each member of the plurality of learning objectives and displaying each selected question to the individual for a response wherein each response is received and evaluated relative to a predetermined standard before the next question is selected. Next, accumulating at least some of the results of the evaluations in a computer storage unit in computer readable form and processing the results to automatically produce a specific sequence of instructional units in response to those responses which varied materially from the respective standard. Finally, presenting the sequence of instructional units on a display for the individual wherein the individual can interact with each of the units via the display.

Description

INTERACT~VE LEARNING SYSTEM WITH PRETEST
Field of the Invention:
The invention pertains to interactive le~rning systems. More particularly, the invention pertains to co~uL.,~ based interactive learning systems which incG,l,o~ale pre and post testing capabilities to evaluate the status and progress of a user.
R?~ Jround of the Invention:
Computer based interactive le~rnin~ systems are known. One particular example is described in U.S. Patent No. 5,395,243 to Lubin et al. entitled Int~d~;Liv~ T e~rning System and which is ~ign~e to the ~c~i n~e hereof. The specification and figures of the Lubin et al. Patent are incorporated herein by reference.
Lubin et al. describes a collll.uhl based interactive learning system wherein a user can be ~si~tecl in le~rning how to use a pre-written application prograrn. Typical application programs include word processing or spread sheet operation or operating systems. Lubin et al. describes three different learning paths.
One of the learning paths is a preset lesson path in which the user goes through a sequence of audio visual lessons relating to various predetennined features of the application prograrn being studied. Upon completion of the lesson sequence, the user is then given an oppo, lw~ ~ Ly to work with the actual application prograrn to re-e.lfolce the previously provided instruction.
In a second learning path, the user may indep~ntltontly select a topic relating to an aspect of the application prograrn which is being studied. The user will then receive audio/visual lessons and/or electronically displayed m~t~ri~l relating to that topic.
In a third learning path, the user is able to execute the application program without receiving any training of the type provided by Lubin's system.
During this sequence however, the user may access various help files which can present electronic textual reference information relating to that application program while the program is running. This process can be carried out without having to exit the application program.
The above described types of learning paths have been found to be useful and effective for many users. Lubin's system, however, did not incorporate any capability to evaluate a user's level of skill prior to executing any of thelearning paths. It would be desirable to be able to combine systems of the type taught by Lubin with a functional capability to take into account a user's initial level of skill, if any.
Thus, there continues to be a need for interactive learning systems which take into account a user's initial skill level. It would also be desirable, if a user were able to combine lesson elennentc to create an individll~li7ed le~rningexperience apart from any pre-established learning paths.
Summary of the Invention:
In accordance with the invention, an interactive learning system and method are provided and can be used for learning a selected, pre-written program.
In one aspect of the invention, a paperless, indivi~ li7~-1 learning sequence can be developed and presented to the respective user for the purpose of improving a user's skill and underst~n~ling with respect to given subject matter.
An aypa~ s in accordance with the present invention incorporates a plc~lofed, m~ehine-readable d~t~b~e having a plurality of questions or exercises which are directed toward ~sessin~ the individuals underst~ntling of a selected learning objective. Pluralities of questions are provided for each member of a plurality of different learning objectives.
The a~a.alus carries out an auLolll~lic evaluation of the individual by sequentially selecting from the ~t~b~e at least one of the questions or exercises associated with each member of the plurality of learning objectives. The selected question or exercise is displayed for the individual who in turn enters a response.

Each of the responses that is received is evaluated relative to a predeterrnin~dstandard before the next question is selected.
The system accurnulates the responses and the results of the evaluations for subsequent processing The a~dlus in turn produces from the results of the evaluations a sequence of instructional units, based on those responses which varied materially from the res~e~ te standard which are int~n~1ed to irnprove the user's skills on an individll~li7Pd basis. The sequence of instructional units can then be presented on a display, for exarnple, for the individual. The individual can then progress through the sequence of units so as to improve selected skills in response to the prior evaluation.
In one aspect of the invention, subsequent to completely execution of the sequence of instructional units, the user can then go through a post-learning evaluation or test for comparison purposes.
In yet another aspect of the invention, a user can select from among a number of object elements to independently create a personalized learning experience. At a first level, topic-type object elements can be selected which contain, for example, a single objective and an ~sescment capability. At a higher level, lesson-type object elements can be selected. The lesson-type object elements incorporate a plurality of related topic-type object elements. In another aspect of the invention, at yet another level, unit-type object elements can be selected. The unit-type object elements incorporate a plurality of related lesson-type object elemlo.nt~. , In yet another aspect of the invention, learning-type objects can be grouped together and associated because they incorporate related subject matter or one functions as a prerequisite to another. Similarly, unit-type objects can in turn be associated with one another because they incorporate related subject or because some of them represent prerequisites for others.

Numerous other advantages and features of the present invention will become readily a~arc~ll from the following detailed description of the invention and the embodiments thereof, from the claims and from the accompanying drawings in which the details of the invention are fully and completely disclosed as a part of this specification.
Brief Description of the Drawings:
Fig. 1 is a block diagram of a system in accordance with the present invention;
Fig. 2 is an overall flow diagram of the process of creating an individual learning profile;
Fig. 3 is a more detailed flow diagram of one aspect of the process of Fig. 2;
Fig. 4 is a more detailed flow diagram of another aspect of the process of Fig. 2; and Fig. S is a flow diagram of a process of selecting learning objects for the creation of a personal learning experience.
Detailed Description of the Preferred Embodiments:
While this invention is susceptible of embodiment in many different forms, there are shown in the drawing and will be described herein in detail specific embodiment~ thereof with the underst~n-ling that the present disclosure is to beconsidered as an exemplification of the principles of the invention and is not int~nde~l to limit the invention to the specific embodiments illustrated.
Figure 1 illustrates an interactive le~rning system 10 which incol~oldles a plurality of components. The system 10 includes a control unit 12, which could implennented as a microprocessor. Associated with the microprocessor12 are read-only memory 14 and read-write memory 16 which co~ "icate with the processor 12 via a bidirectional bus structure 18. The memories 14, 16, as is known in the art, can be used to perm~nently or temporarily store constance, programs being executed, or related data.
Also coupled to the bus 18 is a monitor, such as a CRT-type display 20, loud speakers 22, magnetic disk drive 24, CD-Rom Drive 26 and a user input device 28. The user input device 28 could be a keyboard, it could alternately be a mouse.
In addition, a local area network (LAN) interface 30 enables the system 10 to co,ln"u,~icate with the local network. Further, a remote network interface 32 provides bidirectional con~l,lu,~ication with the Worldwide Web or other remote networks either through teleco"m~ ications or through other forms of datatr~n~mi~ion without limitation.
In normal operation, programs can be stored on and read from disk drive 24 or CD-Rom drive 26. Graphics can also be read from the CD-Rom drive.
Both the disk drive 24 and the CD-Rom drive 26 can be used as sources from which ~l~t~b~ses can be accessed.
During normal operation of the system 10, visual information in lessons can be displayed on the display unit 20, under control of the processor 12.
Text and graphics can be read from disk drive 24 or CD-Rom drive 26 for the purpose of displaying same to the user. As will be discussed subsequently, a control program for the purpose of carrying out the interactive learning process can be stored on one or both of disk drive 24 or CD-Rom 26 for access by processor 12.
Processor 12 is thus able to carry out a prestored process which provides for individual ~X~ies~ ent of a user's skills prior to the user going through the interactive le~rning process.
Figure 2 is a flow diagram illustrating various steps of a method in accordance with the present invention. In a step 100, the ope~a~ g system for the system 10 is started. In a step 102 execution of the interactive learning systemapplication prograrn, of a type, for example described in Lubin but for use with an icon driven operating system such as available under the Tr~dem~rk Windows 95 is started. In a step 104 the learning system carries out an initial sequence ofdisplaying titles and related text. When the system exits the initi~ting step 104, the user can select an introduction in a step 106 or can elect to turn directly to the course associated with the system in a step 108.
In a step 110, a user can enter a course overview and pre-~csPc~" .ent testing sequence. After passing through a course overview in a step 112, the user enters the beginning of a plurality of pre-~csçssment sequences indicated generally at 114A, 114B...114N. The steps of a selected pre-~ses~ment sequence are similarso a description of the sequence 114a will also describe sequences 114B.. 114N.
In a step 120, instructions are presented on the display 20 for the user as to how to carry out the pre-~es~mçnt process. Subsequently, in a step 122 a plurality of questions or exercises are displayed, one at a time, irl random order on the display 20. The user responds to each of the questions or exercises using the keyboard or mouse 28 and the responses are stored by the processor 12. In a step124, the responses are colllpaled to a pre-established standard, also stored in the disk drive 24 or the CD-Rom drive 26 to assess the performance of the user. For example and without limitation, if questions are presented to the user, they can be ranged so as to have right or wrong answers or to have more prefe.l~d vs. less preferred ~lswt:l~ which can be in turn reflected in the pre-stored standard. The correlation between the answers received from the user during the step 122 and the appro~l;ate or desirable answers as reflected in the pre~lored standard, provides a basis for establishing a qualllil~ re ~ses~mçnt of user performance. Subsequent to the step 124, if an individll~li7t cl le~rning profile is to be produced based on the sequence 114a, that profile is then produced in a step 126. Subsequent to the step 126, the learning units can be ~l~selll~d to the user in a step 130 ~ cll~se subsequently.

If desired, prior to generation of the indiviclll~li7ed learning profile in the step 126, additional pre-~sç~cment sequences 114B....114N can be executedto provide a composite learning profile.
Figure 3 illustrates in more detail the generation of the indivi~ln~li7ed learning track as illustrated in the step 126. Test items l-l.. l-N to be presented in the step 122 are plei,lored in one of the disk drive 24 or CD-Rom drive 26. In the step 122, one of the test questions or exercises is selected and presented to the user on the display 20. The answer or response received via the input device 28 is colllpaled to a previously stored answer and a step 122a. If the answer is 10 nn~ticf~ctQry, the objective associated with the test item and the associated topic are retrieved in respective steps 122b, 122c. At least the associated topic is then added to the individual learning profile in a step 122d. If the answer is answered correctly in the step 122a, a determination is made in the step 122e if the testing sequence is finished. If it is not finished, the next test item selected. If the test sequence is fini~h~cl either the next text sequence 114b is entered or the learning sequence associated with the individual profile is then executed in the step 130.
Examples of test items follow as Examples 1 and 2. Example 1 illustrates two dirre,ell~ m~tching-type test items. Example 2 illustrates two different process educating test items.

F.~m Objec~ve:
Id~ th~ l~lorer f~Lu~ view files a~d ~oldes~
t~A Topic~
~ thc Display FYT~n.lin~ lap~ Folders Test It~ (qTl~!s~nn ~pe = rn~ h~n~) ~ch ~he b~to~. to thC t~ t ~, r I
~ Oispla~rs files as l~ge ic~
b~ plays i~lc n~m~q in a li~t c 1~ Di~lays ilc inf~ tinn for c~ch file d: ~ Op~~s e: J Clu~ a ro~
Tcst ~tcm ~ n~ pC--ms~ hir~3 Ma~ch the fcan~e to the ~red u~ "~
a: ~ge by D ~s~ Ordm ~lc n~mre by last m~Aifi~ tinn h: Arrallg~ c Lisrs file names aDc~ s~ r~s c: ~rr~ge by Type Displ~ys 311 te3~ lioc~ ts ~: Plus 3igQ Di~play~ ~hc filcs ~ a fol~cr e: ~tinu; Sign Closes an oI~en f~ldcr co~ files li~yqn.p~ 2 ObJC~Vc:
Prc~icw a filc lL~ing Quic~ ~lew 0~ u.
Relat~d Topi~
~uick Vicw Tc~t Item 1: (q~ff~inn lypc ~ ation) CnmrIc~e th~ ce a Quick Vicw of ~O~Tl~)OC using ~e shortcut memL
T~ I~ (q~ff~Qn type ~ o:-nnl~ti~.l) ~omrI~tr the ac~LoD. So pT~ Q~ Vt:w orA~ oc us~g ~e shûrtcllt me Figure 4 is a flow diagram illustrating in more detail executing the personal learning sequence, step 130. Where the personal learning sequence, created in the step 122d includes a plurality of topics Tl..TN the system 10 presents each of the selected topics in a series of steps 130-1...130-N to the user via the display 20.
The user can interact with the various presented topics via the keyboard or mouse 28 during the process of going through that particular individu~li7e-1 learning sequence. Subsequent to exiting the learning sequence, the system 10 can presenta post-~cse~ment test in a step 132 to cletermine the level of skill that the user has hllploved to as a result of the process. A similar set of steps can be carried out to implement the personal learning sequence for each of the units U2.. UN.
Hence, when completed, the user will have experienced an indivi~ li7tod learning sequence in connection with one or more of the units l-N.
The user can then exit to the step 109 and enter the application or other program being taught for direct execution or can enter additional course units for further 1 5 instruction.
Fig. 5 illustrates an overall flow diagrarn for an alternate approach to creating a personalized learning experience based on collecting together a pluralit,v of sepa~ately ~cces~ihle learning objects. The learning objects are contained in an accessible date base which is org~ni7~1 in several different ways, 20 having both hierarchical and contact-sensitive aspects.
A course object is made up of a plurality of independently accessible unit objects. Unit objects are learning objects which include a plurality of independent lesson objects. Lesson objects, in turn, are also learning objects which are made up of a plurality of dependent topic objects. Topic objects are dependent 25 - objects which contain a single objective and an ~ses~ment.
The content of a learning object is illustrated, in an overall sense, in block 150 of Fig. 5.

The lesson object is the smallest independent instructional activity available to a user. A given lesson object exhibits int~ l cohesion and is focused about a plurality of dependent topic objects.
A lesson object incorporates a plurality of objectives as well as a second plurality of test or ~C~eccment items. It also incorporates predefined sequencing and interactions between related, dep~n~l~nt, topic objects.
Lesson objects can be linked with other lesson objects or can stand alone. Topic objects, by way of contrast, are dependent on the associated lessonobject and contain only a single objective and an associated ~ses~ment.
As illustrated in block 152 of Fig. 5, learning objects can be implemented out of a plurality of linked pages. The pages can be linked togetherboth linearally and non-linearally. Pages can contain text, multi-media components and user interaction logic.
Alternately, learning objects can be grouped together as a result of content or because one or more serves as a prerequisite for another, as illustrated in element 154 of Fig. 5.
A plurality of learning objects can be selected via a User through an object access program 156. The User can select, via the access prograrn 156, oneor more lesson objects to be experienced for the purpose of addressing an education or training objective. Learning objects can be stored on a variety of media such as magnetic disc drives and/or CD Rom drives. The object access I?rogram 156 can be accesced by the User not only directly through a local area network but also remotely via the Internet and the Worldwide Web, if desired.

From the foregoing, it will be observed that numerous variations and modifications may be effected without departing from the spirit and scope of theinvention. It is to be understood that no limitation with respect to the specific a~aLdlus illustrated herein is intçnded or should be inferred. It is, of course, intende-l to cover by the appended claims all such modifications as fall within the scope of the claims.

Claims (9)

1. A computer based method of automatically providing a paperless, individualized, learning sequence comprising:
storing in a computer readable database a plurality of questions directed toward assessing an individual's understanding of a selected learning objective for each member of a plurality of different learning objectives;
automatically evaluating the individual by randomly and sequentially selected from the database at least one question associated with each member of the plurality of learning objectives and displaying each selected question to the individual for a response wherein each response is received and evaluatedrelative to a predetermined standard before the next question is selected;
accumulating at least some of the results of the evaluations in a computer storage unit in computer readable form;
processing the results to automatically produce a specific sequence of instructional units in response to those responses which varied materially from the respective standard; and presenting the sequence of instructional units on a display for the individual wherein the individual can interact with each of the units via the display.

2. A method as in claim 1 wherein in storing step, at least some of the questions are linked to a plurality of possible answers and in the displaying step, at least the selected question and the plurality of possible answers are displayed.

3. A method as in claim 1 wherein in the storing step, some of the questions are stored in a form which directs the individual to achieve a specified result without specifying the actions to be taken.

4. A method as in claim 1 which includes presenting a performance evaluating test, subsequent to presenting the sequence of instructional units.

5. An apparatus for providing an automatic, paperless, individualized learning sequence to a user comprising:
a programmable processor;
a visual display coupled to the processor;
a unit coupled to the processor, for reading control information and a database from a medium and providing that information to the processor andwherein, in response to that information, the processor accesses the database and wherein the processor includes circuitry for randomly selecting from the database a plurality of assessment questions and circuitry for presenting the plurality of questions to the user on the display;
a user operable input device coupled to the processor, whereby the user provides responses to the processor to at least some of the assessment questions and wherein the processor includes further circuitry for evaluating the responses and in response thereto for establishing a sequence of selected topics for presentation to the user.

6. A system as in claim 5 wherein the processor includes further circuitry for presenting the sequence of selected topics to the user.

7. A system as in claim 6 wherein the processor includes further circuitry for reading from the database a post-test and circuitry for presenting the post test to the user.

8. An individualized, paperless, learning system comprising:
a database of different learning objects;
a control unit with circuitry for enabling a user to select an individual sequence of learning objects from the database;

a display unit coupled to the control unit whereat the control unit is adapted to display the individual sequence of learning objects.

9. A system as in claim 8 wherein the control unit includes circuitry for linking the objects in the individual sequence.