WO2010056963A2 - Training/coaching system for a voice-enabled work environment - Google Patents

Abstract

A voice-enabled work system includes a wireless network and at least two voice-enabled devices 100, 200 configured for communicating over the wireless network. The devices are operable to convert system Prompts into speech and use speech recognition to convert a voice command into a system command. The first device 100 may be selectively activated into a coaching mode by a user 1 30 to establish a connection with the second device 200 and another user 230 over the wireless network 40 Once connected in coaching mode 40, the coach user 130 receives system Prompts from the coached user 230 and the second device 200. The first device 100 of the coach user then provides those received prompts to the coach user 130.

Description

TRAINING/COACHING SYSTEM FOR A VOICE-ENABLED WORK ENViRQNMENT

RELATED APPLICATION

[0001] This Application is related to and claims the benefit of U S Provisional

Patent Application Serial No 61/1 14,820, entitled "TRAINING/COACHING SYSTEM

FOR A VOICE-ENABLED WORK ENVIRONMENT", filed on November 14, 2008, which application is incorporated by reference herein

[0002] This invention generally relates to the use of speech or voice technology m a voice-enabled work environment to facilitate a variety of tasks, and more specifically for a method of allowing one user of a voice assistant system to tram or coach another user of the system

BACKGROUND OF THE INVENTION

[0003] Speech or voice technology, in the form of speech recognition, is used in a variety of different environments to facilitate the completion of work or various tasks Such voice-enabled work environments, for example, include voice-directed work environments and vosce-assisted work environments [0004] In a typical voice-enabled work environment, the worker wears a mobile computer having voice or speech capabilities The mobile computer is worn on the body of a user or otherwise carried, such as around the waist, and a headset device connects to the mobile computer, such as with a cable or possibly in a wireless fashson In another embodiment, the mobile computer might be implemented directly in the headset The headset includes one or more speakers for playing voice instructions or prompts and other audio that are generated or synthesized by the mobile computer to direct or assist the work of the user and to confirm the spoken words of the user The headset also has a mscrophone for capturing the speech of the user, such as speech commands and other audso, to process the commands spoken by the user and to allow the entry of data and other system feedback using the user's speech and speech recognition [0005] One example of such a voice-enabled work environment is generally referred to as voice-directed work, as the user takes specific direction from the central system and their mobile computer like they might take direction from a manager or supervisor or from reading a work order or to-do list One such voice- directed work system, for example, is provided in the Talkman® system that is available from Vocollect, lnc also of Pittsburgh, PA The mobile and/or wearable computers ailow the users that wear or use them to maintain mobility at a worksite, while providing the users with the necessary directions or instructions and the desirable computing and data-processing functions Such mobile computers often provide a wireless communication link to a larger, more centralized computer system that directs the work activities of a user within the system and processes any user speech inputs, such as collected data, in order to facilitate the work An overall integrated system may utilize a central system that runs a variety of programs, such as a program for directing a plurality of mobile computers and their users in their day-to-day tasks The users perform manual tasks and enter data according to voice instructions and information they receive from the central system, via the mobile computers Through the headset and speech recognition and text-to-speech capabilities of the mobile computer, workers are able to receive voice instructions or questions about their tasks, to receive information about their tasks, to ask and answer questions, to report the progress of thesr tasks, and to report various working conditions, for example

[0006] Another example of a voice-enabled work environment is referred to as voice-assisted work Such a work environment is involved m situations where flexibility is required and specific task direction is not necessary In a voice-assisted work environment, users engage in a selective speech-dialog w^th the system when they need to The voice-assisted work system is designed to accommodate various prompts, instructions, and information as selectively directed by the user and their voiced commands, rather than issuing continuous instructions in a set order as with a voice-directed work system One such voice-assisted system is provided by the AccuNurse® system available from the assignee of this application, Vocoilect Healthcare Systems, inc (VHS) of Pittsburgh, PA

[0007] One of the main challenges in a voice-enabled system centers around the training of new users The voice user interface (VUI) that is part of the voice- enabled system requires a user to know what to say and when to say it The problem that the trainer or coach or other supervisor faces is that it is very difficult to tell a user what to do with respect to the interface when the trainer or coach cannot hear what the user is hearing or where they are in an ongoing speech dialog The same problem surfaces with regard to ongoing training/coaching of existing users as well as when new users join the organization and need to learn how to use the system or a new feature is impiemented in an existing system [0008] To overcome this challenge, hardware solutions have been used For example a trainer or coach might connect a separate piece of hardware, such as a small loudspeaker, to the mobile device or personalized headset that the user is using in order to be able to hear what the user is hearing These hardware solutions, although they successfully accomplish the task, are cumbersome to use and require direct (and obtrusive) interaction with the user being helped, trained, or coached [0009] A need still therefore exists for a voice-enabled system in which a trainer or coach can more effectively coach another user There is also a need for a coach or trainer to know the voice prompts as delivered to the user being coached or know where in the speech dialog the user is so that better training may be facilitated without the need for additional intrusive coaching-specific hardware on a user's computer or other inconveniences to the user

SUMMARY QF THE INVENTION

[0010] A voice assistant system is disclosed which directs the voice prompts delivered to a first user of a voice assistant device to also be communicated wirelessly to the voice assistant device of a second user so that the second user can hear the voice prompts as delivered to the first user

[0011] When a device in the system activates a coaching mode, one device

(the coach device) makes a connection to another device (the coached device) to receive system prompts from the coached device, and thus hears what the person who is being coached would hear The normal voice-enabled work functions of the coach device are suspended while the coach device instead plays, as speech, the system prompts received from the other device

[0012] The coached device includes a coach support module configured to forward system prompts to the coach device when the coaching mode is activated without otherwise altering the functioning of the coached device In one embodiment, a voice device of the invention may be used to either coach another user or to be coached by a user

BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the Detailed Description gsven below, serve to explain the invention

[0014] FIG 1 is a block diagram of a distributed implementation of a voice assistant system consistent with the principles of the present invention

[0015] FIG 2 is a side perspective view of one embodiment of a voice assistant of the voice assistant system of FSG 1 consistent with the principles of the present invention

[0016] FIG 3 is a diagrammatic view of two voice assistants interacting in a coaching relationship according to the present invention

[0017] FIG 4 ss an exemplary coaching routine executed by the voice assistant system of FSG 1 consistent with the principles of the present invention

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION [0018] A training or coaching system ss described wherein one user coaches another user in the proper use of a voice-enabled device 45 within a voice-enabled environment Both the coaching user and the user being coached have voice- enabled devices 45 associated with a voice-enabled work system One device may selectively be placed in a coaching mode such as by using a voice command or other input (such as a button or manual input) to the device The coach device forms a connection with a selected coached device as part of the coaching mode With a connection established, the coached device monitors the connection and forwards its system prompts to the connected and activated coach device The present invention allows the coach or coaching user (coach device) to hear the same system prompts and tones that the coached user (coached device) hears, while each of the parties uses his or her own device with no additional hardware No separate listening kits or disruptive processes are necessary at the coached device

[0019] Turning now to the drawing Figures, wherein like numbers denote iike parts throughout the several Figures, as illustrated in FIG 1 , the present invention may be incorporated within a suitable voice-enabled work environment Although a voice-assisted work environment is discussed herein for a patient-care application, it should be understood that the invention would have applicability in most any voice- enabled work environment, including voice-directed work environments [0020] FIG 1 illustrates a voice-enabled system 5 in the form of a distributed computing system, with computing activities associated with at least one facility 10 and activities associated with an offsite company and/or an onsite enterprise customer IT department 15, such as an offsite Vocoilect Healthcare Systems, lnc Department The system users are physically located at the facility 10, while centralized support and management capabilities for the voice-enabled system 5, on the other hand, may be provided by the offsite department and/or by the onsite enterprise customer IT department 15 which is coupled to the facility 10 with an appropriate network 70, such as a wide area network (WAN) [0021] A workstation 20 at each facility 10 may interface with one or more portable computers in the form of voice-enabled devices 45 The voice-enabled devices 45 execute work plans and provide a user or worker a voice user interface (VUI ) using speech and a speech dialog with the user [0022] The information associated with at least one work plan may be transmitted {e g , in digital form) from the workstation 20 (e g , using the network interface) via local area network (LAN) 30 to a voice transaction manager 35 Each facility 10 may have at least one voice transaction manager 35 to store and manage the work plans for the patients and patient care providers and facility configuration information Specifically, the voice transaction manager 35 may represent and/or include practically any networked appliance, device, or computer as described hereinabove in connection with the workstation 25 The voice transaction manager 35 may be similar to a server computer in some embodiments The voice transaction manager 35 may also include at least one database for storing the data Data may also be transmitted from the voice transaction manager 35 to the workstation 20 through the network 30

[0023] The information and data associated with at least one of the care plans in the voice transaction manager 35 may be transmitted (e g , in digital form) from the voice transaction manager 35 (e g , using the network interface) via wireless network 40 (e g , a WLAN) to at least one voice-enabled device 45 Data may also be transmitted from the voice-enabled device 45 to the voice transaction manager 35, for example, for storage at the voice transaction manager 35 or at work station 20 and for additional processing [0024] The voice-enabled device 45 may include a number of separate portions or elements In the embodiment illustrated in Figure 2, a headset portion 50 (with a microphone, earpieces, and speakers) interfaces with a device portion 55 using and a connecting portion 60 In some embodiments, the connecting portion 60 may be a cable or may be a wireless link The device 55 might be a portable or wearable computer device In another embodiment, not shown, all necessary components of the voice-enabled device 45 may be contained in the headset portion 50 alone That is, the functionality of the device 45 might be completely implemented in the headset portion 50

[0025] The voice-enabled device 45 (or headset 50) also includes suitable processing and memory hardware and software to store and utilize the data received from the vosce transaction manager 35 The voice-enabled device 45 is utilized to maintain a speech dialog with a user by utilizing certain speech commands and system Prompts

[0026] The voice-enabled device 45 may be a wearable computer and/or a personal digital assistant (PDA) that includes WLAN capabilities in some embodiments In particular, the voice-enabled device 45 may be a client, and more specifically a "thick client" that may allow speech recognition and speech synthesis to occur on the actual voice-enabled device 45, rather than remotely One suitable embodiment of a voice-enabled device is set forth in U S Patent Application No 12/536,696 filed August 6, 2009, and entitled, "Voice Assistant System", which application \s incorporated by reference herein in its entirety [0027] In accordance with the principles of the voice-enabled work, each user at the facility 10 may have their own voice-enabled device 45 that they wear or carry The user may log on to the system 5 and data may be transferred from the voice transaction manager 35 to the voice-enabled device 45 The data may include the various elements of the user's work plan for that day for use in the voice-enabied work environment The work plan and information and the data associated therewith may be accessed and utilized using speech in a speech dialog, as discussed further herein For the disclosed example herein, the data may be associated with a care plan for one or more patients and will be used as a basis for the speech dialog earned on between a user and the system 5 However, it will be appreciated that the invention might be used with any number of different voice-enabled systems and environments

[0028] The voice-enabled device 45 may support real time paging For example, multiple devices 45 may communicate with each other via the wireless network 40 to send the pages directly Alternatively, the pages may be first sent to the voice transaction manager 35, and then the pages may be relayed to the final destinations

[0029] The speech dialog that is provided through the voice-enabfed devices

45 may focus on various commands, and may include requiring the user to speak at least one input command with the device responding to the command and providing data or asking questions The speech dialog may be based upon the data in the voice-enabled device 45 (FIG 1 ), including the various patient care plans in one example Such speech dialogs may be carried on with a voice- user interface (VUI) that includes speech recognition and text-to-speech (TTS) technology as would be understood by a person of ordinary skill in the art [0030] The speech dialog may be implemented through the VUI in a number of different ways and the application is not limited to a particular speech dialog or its progression As noted above, in a voice-directed work environment, the speech dialog would include a constant stream of directions to a worker or user interspersed with spoken commands or spoken data entry by the user at appropriate junctures This is implemented m generally a continual back-and-forth speech dialog for directing the user in the work environment In a voice assisted environment, the speech dialog is less intrusive, and may be selectively engaged by a user Generally, a user will speak a command, such as to request information or a work task, and the voice-enabled device will provide directions, data, or other synthesized speech output to the user m response Herein, the spoken utterances or speech of a user, which will be utilized to engage in the speech dialog, will be referred to generally as voice commands or speech commands In the VUI, the voice commands are subject to speech recognition technology to convert the voice command into a system command, such as text or data, in a form that may be utilized in the overall speech-enabied system Alternatively, the system may provide sts own data or text back to a user in what will be referred to herein as a system Prompt Such system Prompts are in a data form to be processed through the system and are then converted into understandable speech by the text-to-speech features of the VUI to form what is referred to herem as a voice Prompt that may be played and heard by the user That is, the speech dialog involves voice commands from the user to the device and voice Prompts from the device to the user In the present invention, the Prompts that are directed or routed from a coached device to a coach device are generally referred to herein as system Prompts The Prompts may be in any suitable data form to aliow the data to be synthesized into speech and heard or listened to by a coach or trainer in accordance with the principles of the invention Therefore, the terminology utilized herein to categorize the speech dialog is not limiting to the invention [0031] The speech dialog will depend on the specific voice commands of the user and the data that is needed by the voice-enabled device 45, or the information to be provided by the device 45 As may be appreciated, in the disclosed example, the speech dialog could take various different forms to provide, in the example, the information about a resident or a care plan to the user, or to obtain information and data about a resident pursuant to their care plan The invention is not limited to the specific questions or format of any given speech dialog The invention ss directed to helping a user to learn how to interface through a speech dialog and also to assist another party in coaching or training a user in such an endeavor [0032] The voice-enabled device may also be utilized to provide the user with audible tones that assist in the interaction with the device 45 The audible tones provide an audible indication about various information or events without directly interrupting the user with a voice dialog For example, an "ail dear" tone may be provided when there are no active pages or reminders in the speech dialog, and an "incoming page" tone may be provided when the user has one or more active pages to listen to The incoming page may be from another user and may include a recorded vosce message similar to a conventional voicemail However, the page is a silent page in that a public address system (i e , PA system) need not be utilized, leading to less disruption Those of ordinary skill in the art will appreciate that other tones may also be supported, and that many variations are consistent with the principles of the present invention in implementing a speech dialog [0033] As noted earlier, additional features and variations of an exemplary voice-assisted work system that might be utilized to implement the present invention are disclosed in U S Patent Application No 61 ,1 14,920, assigned to the same assignee as the present application, which application is incorporated by reference herein as if fully set forth herein, and are also disclosed in the Accu Nurse® System available from the assignee

[0034] FIG 3 illustrates one exemplary embodiment of the invention wherein one voice-enabled device 100 (the coach) and its user can enter a Coaching mode m order to listen to another voice-enabled device 200 (the coached) in accordance with coaching or training the user of that device 200 In this embodiment, the voice- enabled devices 100, 200 are configured generaily similarly if not identically Therefore, no additional or special set-up hardware or software ss necessary for training In fact, the Coaching mode could be configured in the opposite direction (the device 200 listening to the device 100) through a symmetrical process to the one described Herein, for discussion purposes, the coaching user will be "User A" or "Coach", and the user that is being coached will be "User B", or "coached" user [0035] The voice-enabled device 100 of the coach user (User A) that is coaching another user (User B) includes a voice user interface (VUI) 1 10 that implements the speech dialog with the coach user The voice user interface 1 10 converts the coach user's spoken utterances or voice commands to system data or system commands through speech recognition technology, and converts system data or system Prompts to voice Prompts through text-to-speech technology The voice Prompts are then played for the user through the headset In one embodiment, the speakers and microphone associated with playing and receiving speech in the speech dialog are found in the user's headset, shown as portion 50 in FIG 2 In addition to speech commands, in one embodiment, the VUI 1 10 also processes manual inputs, such as button commands associated with the one or more buttons 56 on the device portion 55 as shown in FIG 2 The input/outputs streams whether speech (SPK, MlC) or manual (BUTTONS) are indicated as being provided by the user block 130 in FtG 3 The VUI 110 also sends and receives data and Prompts from the database 115, which acts as a local storage medium for information relevant to the voice-enabied device 100 and the speech dialog for that device 100

[0036] In order to initiate Coaching mode, several options might be used In one embodiment, the coach user 130 associated with the voice-enabled device 100 issues a spoken voice command, such as "Coach [usemame]" For the illustrated example, the user may speak, "Coach User B" As part of processing this command, the VUI 1 10 examines a list of available user names on database 1 15, which may be the same set of names that is available for other user-to-user commands such as paging using the voice-enabled devices in an alternative embodiment, the list of user names may be also be accessible by saying the command "coach" and then using one or more buttons 56 to scroll through the list of available users on database 1 15 In still another alternative, the coaching may be initiated by button presses only For example, one or more of the buttons 56 may be used to access a menu wherein a selection of "coach" may be selected from the menu with the buttons 56 The buttons may then be used to scroll through a list of available users and select a user Alternatively, once coaching mode is selected manually, the user might then use speech to select a user to coach If the identified user name is m fact the user attempting to initiate coaching, the VUI 1 10 responds with the speech dialog response, "You are not permitted to coach yourself and returns to a mam menu, aborting the Coaching mode [0037] In some situations, the list of available users may not immediately update on device 100 A new or unexpected user may take time, for example up to five minutes, to appear on the list in database 1 15 and be available for coaching The device 100 may need to retrieve an updated list from the voice transaction manager server 35

[0038] Assuming a valid username is identified by the spoken "Coach" command, an Actιvate() method 112 is run on a Coaching mode module 120 of device 100 In one embodiment, the Coaching mode module 120 is implemented utilizing a suitable LUA script

[0039] It should be understood that the implementation, as shown in FIG 3, is illustrative or representative of the functionality of the various vosce-enabied devices Therefore, the figure is not an exact representation of the various hardware and software components of a device that may be used to implement the present inventson As such, the devices 100, 200 will utilize appropriate processing hardware and software for implementing the functionality of the devices in accordance with the principles of the invention As such, the present invention is not limited to a particular hardware and software configuration, and various ef-4he blocks and components in FSG 3 do not necessarily set forth and are not limited to specific hardware or software components A person of ordinary skill in the art will understand that the functionality of the present invention might be implemented m a number of different ways in a portable computer device with a suitable processor and appropriate hardware and software components

[0040] The Coaching mode module 120 sends a look-up table request

(workeπnfo get()) to the voice transaction manager 35 to obtain the iocal network IP address associated with the valid username of the user to be coached, User B If no local network address is returned, an error message is played to the user 130 and Coaching mode is aborted If the server 35 returns a network IP address, the Coaching mode module 120 opens or establishes a direct socket connection 150 over the wireless network 40 to the voice-enabled device 200 of the user that is being coached (User B) If a direct socket connection cannot be established, an error message is played to user 130 and Coaching mode is aborted [0041] The voice-enabled device 100 gives status Prompts to the Coaching user User A as the connection is sought and established In one embodiment, the user 130, as shown in FIG 3, hears a spoken voice Prompt from the VUI 1 10 at five- second intervals until the socket connection is established or the process times out if the connection is successfully established within 5 seconds, a message is played "Coaching [user name] Connected Press the STOP button to exit coaching session " If establishing the connection takes longer than five seconds, then after five seconds the device 100 will produce the status Prompt, "Coaching [user name] Connecting, please wait " After each additional five seconds, the status Prompt "Please wait" is heard When the connection is thereafter established, another status Prompt is played "Connected Press the STOP button to exit coaching session " If a connection cannot be established after a set period of time, for example 15 seconds, an error message is played through VUI 1 10 and Coaching mode is aborted

[0042] In one embodiment, a generic error message might be played that is the same regardless of the reason for the lack of connection "Connection cannot be made at this time " The error message is always followed by return to the main menu of the VUI 110 with the appropriate main menu Prompt or tone as appropriate for the VUl [0043] The VUI 1 10 of voice-enabled device 100 continues to process voice commands and manual inputs from the associated user 130 during the establishment of the connection In one embodiment, if the user 130 presses a STOP or CANCEL button of the voice-enabled device 100, or gives an abort voice command such as the spoken voice command, "Cancel", the VUi 1 10 runs a Deactivated method 1 14 of the Coaching mode module 120 and aborts Coaching mode with a spoken message "Exiting coaching session", followed by a return to the main VUI menu with the playing of an appropriate system Prompt or tone The user 130 might then continue using their voice-enabled device 100 in an appropriate manner for the voice-enabled work

[0044] Once the socket connection 150 is established and Coaching mode is running via Coaching mode module 120, the VUI 1 1 0 on the Coach device 100 continues to monitor the database 115 as well as monitoring the manual inputs or buttons In one embodiment, voice recognition capabilities are generally deactivated in device 100 while Coaching mode is active, but the VUI 1 10 performs a program loop, waiting for a signal from a manual input, such as a CANCEL or STOP button of device 1 10 that will deactivate Coaching mode This allows the coach user to then speak to and instruct the coached user on how to interface in the voice dialog and to discuss what responses to give and what words to say without the speech recognition features of the coach device trying to perform speech recognition on the coach user's speech Therefore, the coach user is free to speak to the coached user, such as for instruction, without the coach device trying to perform speech recognition on the coach user's speech While m Coaching mode, VUI 110 might also disable other features of device 100 so as not interrupt User A (user 130) while User A is coaching and listening to User B (user 230) For example, the coaching device 100 might be configured to not play the audible tones associated with pages or reminders sent to the coach User A as part of the voice-enabled system Such tones that might confuse User A as to whether the page or reminder was intended for Coach User A or they are hearing a system Prompt in the form of an audible tone form (user 230) Instead, VUI 110 processes pages and reminders and plays the appropriate tones for User A (user 130) when Coaching mode is deactivated [0045] in an alternative embodiment, some limited speech recognition capabilities might continue to operate in coach mode to allow the coach user to exit Coaching mode with a spoken command such as "Cancel" rather than requiring a manual input The speech recognition feature in that scenario would then only recognize a limited vocabulary for cancellation purposes [0046] As part of its operation, the vosce-enabϊed device 200 includes an appropriate coaching support module 220 that receives a notification 212 whenever the VUI 210 handles a Prompt in order to then convey the Prompt to the user 230 This coaching support module 220 processes each notification of a system Prompt, as well as handling the establishment of a connection 150 through the wireless network with a coaching device 100, such as by providing a blocked thread waiting for new socket connections The coaching support module 220 may serve a limited number of connections by including a limit on the number of open socket connections it will maintain, for example ten If so, the coaching support module 220 may be configured to decline to activate any additional socket connections once the maximum \s reached, which would cause the additional unit to fail to connect as detailed above [0047] Whenever the coaching support module 220 receives a system Prompt notification 212 through the VUI 210 of device 200, it checks Io determine if there are any active socket connections that have been established, which indicate that there are coaching or listening users If there are one or more coaching users, the module 220 sends information about the system Prompt to each connected coach device, such as device 100, as shown in FIG 3 If there are not established connections, the system Prompt will be discarded by the module 220 [0048] When the Coaching mode module 120 of the coach device 100 receives the notification of a system Prompt over the socket connection 150 from the coaching support module 220 of the coached device 200, the Coaching mode module 120 communicates the system Prompt to the local database 1 15 The coach VLJ! 110, which is looping in a software fashion to monitor the database 115, wiil process the new system Prompt, convert it to a voice Prompt or tone as appropriate, and play it to the coach user 130 In this way, the coach user 130 hears the system Prompts that are also played by the coached device 200 and heard by the coached user 230 (User B) The coach User A thus knows what the coached User B is hearing This facilitates better training with minima! disruption to User B [0049] The Coaching mode module 120 continually monitors the socket connection 150 to make sure that it is open Coaching mode can be discontinued in several ways If the socket connection 150 is disengaged, such as by network failure or deactivation of the device 200, the Coaching mode module 120 communicates the disconnected status to the database 1 15 When the VUI 1 10 queries the database and processes this change in status, it will terminate the Coaching mode and return to the main menu It may play a message to User A "Connection lost Exiting coaching session " It will then be out of coaching mode and may return to its normal operation

[0050] If the coach device 100 is deactivated, such as by being disconnected or put to sleep, Coaching mode is also terminated such that when a user 130 next activates the device 100, it will be at the mam VUI menu and not within Coaching mode

[0051] During Coaching mode, in one possible embodiment, the VUI 1 10 of the coach device 100 is not receiving voice commands from the user 130, but continues to receive manual inputs, such as button inputs from the user 130 That is, the speech recognition feature of the VUI 1 10 might be disabled The VUI 1 10 may continue to adjust the volume of the speakers in response to volume adjustment through use of the buttons 56 If the user 130 presses an appropriate STOP or CANCEL button, the VUI 1 10 runs the Deactιvate() method 1 14 on the Coaching mode module 120 which deactivates the socket connection 150 and terminates Coaching mode with the message "Exiting coaching session " The VUI 1 10 then returns to the main VUI menu of the voice-enabled device 100 and can then provide speech recognition and a speech dialog

[0052] The data or Prompts transferred over the socket connection 150 between the coaching support module 220 and the Coaching mode module 120 is not audio or sound data, but is instead text or the equivalent Once received, the system Prompts are converted to audible speech for the user 130 by the local VUI 110 of the coach device 100, thus reducing the ioad on the wireiess network Other sounds associated with the coached device 200, such as prerecorded pages or the commands said by the coached user 230, are not transferred to or played by the coach device 100 in one embodiment

[0053] As explained above, the operation of the coached device 200 is, in one embodiment, almost entirely unaltered by being coached in accordance with one feature of the invention That is, the coaching features provided by the invention do not disrupt the user that is being coached Whenever the VUI 210 issues a system Prompt to the user 230, a notification of that system Prompt is also automaticaily sent to the coaching support module 220, which further sends the system Prompts to other units if applicable as noted above However, the coached user 230 (User B) receives no notice as to whether the system Prompts that they are hearing are being sent, and has no direct or obvious way to tell if the coached device 200 is being coached or being listened to The coaching process does not affect the coached user's ability to use the coached device 200 in its normal fashion for the various voice-enabled work tasks

[0054] In one embodiment of the invention, a voice-enabled device will only enter Coaching mode if it is not currently being coached itself if the coaching support module of the device includes any active socket connections (ι e , it is being coached and thus acting as a coached device), an error message will play to the user of that device and the device wili return to the mam menu instead, aborting Coaching mode, and playing the generic error message "Connection cannot be made at this time " Because this error message is generic and not specific, the user of the voice-enabled device may still be unaware that he is being coached, and thus cannot become a coach himself and put his device into coaching mode This invisibility of the coaching mode to the coached user that is provided by the present invention may be desirable in certain training situations

[0055] In another embodiment, the user may be notified that the user's voice assistant is being coached by having the coached VLJI 210 include some additional output such as a specific prompt or tone, background noises in the audio channel, or a visual indicator that the device is being coached In training situations, visibility or awareness of the use of coaching may be desirable

[0056] In one embodiment, a device that is currently in Coaching mode

(original coach device) may subsequently be contacted by one or more additional coach devices with appropriate connections established Thus, a coach user may be coached by other coach users in turn In such a situation, Prompts received by the Coaching mode module of the original coach device and played for the original coach user would also be further relayed by the coaching support module of the oπginal coach device and relayed to additional Coaching mode modules of the other additional coach devices This "layered" use of the Coaching mode would successfully allow additional users to hear the prompts relayed to the original coach device, and may be useful in situations where there is a need to have multiple users involved in coaching or training another user, or there is a need to exceed the established limit (e g 10 sockets) to coaching connections as described above Therefore, a coach may hear the Prompts and part of the dialog of a coached user either by connecting directly to a coached user or by connecting (via a coaching session) to another coach who is connected to the coached user [0057] FIG 4 illustrates one example of a use of the Coaching mode In this example, User A is the coach user, and their device ts configured to coach or listen to the device of User B, the coached user Block 300 refers to the system Prompts heard by User A, while block 310 refers to the Prompts and ongoing speech dialog of User B as User B works and performs various tasks

[0058] Although the terms "coaching" and "coached" are used above with respect to one user listening to the Prompts given to another user, it is to be understood that the device may be used during a coaching process in reverse, with the person to be coached listening to the Prompts of the coach as part of the training process This feature may also have applications outside of the coaching process, and no such usage restriction is intended

[0059] This invention provides a variety of benefits over the training kits of the prior art A coach or trainer can initiate a coaching session without having to disrupt the user being coached, because nothing needs to be connected to the coached user's device The coach or trainer does not have to locate, assemble, and wear any sort of listening kit, and can initiate a coaching session in a matter of seconds making use of the equipment already being used as part of the voice-enabled work environment The coach is able to teach and reinforce best practices of using the mobile device and personalized headset because the coach is using the same equipment that the user is using to navigate through the VUI for the voice-enabled system. Because the connection occurs over a wireless network, the coach does not even need to be in the same location as the user they are coaching, but can connect and listen remotely, which is not possible with loudspeaker-based training kits [0060] Although the embodiment listed above uses two identical voice- enabled devices functioning on the same local area network, the coaching function could also be performed at a distant site and with different equipment, and may be a direct communication between the devices as disclosed above or may be through a server or other intermediary

[0061] The above embodiments are intended to be illustrative and not limiting on the scope of the invention

Claims

[0062] What is claimed is

1 A device for a voice-enabled work environment comprising a network interface operable to communicate with a wireless network, a voice user interface operable to, upon receiving a system Prompt, convert the system Prompt into speech in the form of a voice Prompt for a user, and upon receiving a voice command from the user, use speech recognition technology to convert the voice command into a system command, and a coaching support module configured to be selectively activated by the establishment of a connection of the device to at least one other device in the wireless network and operable to forward system Prompts to a connected one other device as the system Prompts are received

2 The device of claim 1 wherein the coaching support module is configured to serve a limited number of connections to other devices for forwarding the system Prompts

3 The device of claim 1 wherein the coaching support module is further operable, upon receiving a system Prompt, to determine if a connection has been established to one other device before forwarding the system Prompt

4 The device of claim 1 wherein the connection is a socket connection to the at least one other device through the wireless network

5 The device of claim 1 wherein the establishment of a connection of the device to at least one other devsce is initiated by the at least one other device through the wireless network

6 A device for a voice-enabled work environment comprising a voice user interface operable to, upon receiving a system Prompt, convert the system Prompt into speech in the form of a voice Prompt for a user, and, upon receiving a voice command from the user, use speech recognition technology to convert the voice command into a system command, and the device having a coaching mode and operable, when the coaching mode ss activated, to establish a connection to at least one other device over a wireless network and to receive system Prompts from the at least one other device

7 The device of claim 6 wherein the voice user interface is operable to convert a received system Prompt from the at least one other device into speech as a voice Prompt for the user

8 The device of claim 6 wherein the voice user interface selectively deactivates the speech recognition technology for a voice command when the coaching mode is activated

9 The device of claim 6 wherein, when the coaching mode is activated, the voice user interface only converts system Prompts that are received from the at least one other device into speech in the form of a voice Prompt

10 The device of clasrn 6 wherein the coaching mode is activated through a voice command from the user to the voice user interface

1 1 The device of claim 6 further comprising a manual input component wherein the coaching mode is activated through a manual input from the user

12 The device of claim 6 further comprising a coaching module operable for establishing the connection to the at least one other device when the coaching mode is activated

13 The device of claim 12 wherein the coaching module is operable to obtain information for establishing the connection through interfacing with a wireless network

14 The device of claim 6 wherein the device is further operable for terminating the connection to the at least one other device when the coaching mode is deactivated

15 The device of claim 6 further comprising a manual input component, the coaching mode being deactivated through at least one of a voice command or a manual input from the user

16 The device of claim 6 wherein the connection is a socket connection to the at least one other device through the wireless network

17 A voice-enabled work system, comprising a wireless network; at least two voice-enabled devices, a first device and a second device configured for communicating over the wireless network, each of the at least two devices including a voice user interface operable to, upon receiving a system Prompt, convert the Prompt into speech in the form of a voice Prompt for a user, and, upon receiving a voice command from the user, use speech recognition technology to convert the voice command into a system command, the first device operable for being selectively activated into a coaching mode and to establish a connection with the second device over the wireless network to receive system Prompts from the second device, the second device operable for detecting a connection with the first device and, upon detecting a connection, forwarding system Prompts to a connected first device as the system Prompts are received by the voice user interface of the second device

18 The system of claim 17 wherein the second device is configured to detect connections with multiple devices and to forward system Prompts to multiple connected devices

19 The system of claim 17 wherein the connection is a socket connection through the wireless network

20 The system of claim 17 wherein the first device is operable to convert a received system Prompt from the at least one other device into speech as a voice Prompt for the user

21 The system of claim 17 wherein the first device selectively deactivates the speech recognition technology of the first device for a voice command when the coaching mode is activated

22 The system of claim 17 wherein, when the coaching mode is activated, the first device only converts system Prompts that are received from the second device into speech in the form of a voice Prompt

23 The system of claim 17 wherein the coaching mode is of the first device is activated through a voice command from the user to the voice user interface

24 The system of claim 17 wherein the first device includes a manual input component wherein the coaching mode is activated through a manual input to the first device from the user

25 The system of claim 17 wherein the first device includes a coaching module operable for establishing the connection to the second device when the coaching mode is activated

26 The system of claim 25 wherein the coaching module is operable to obtain information for establishing the connection through interfacing with a wireless network

27 The system of claim 17 wherein the first device is further operable for terminating the connection to the second device when the coaching mode is deactivated

28 The system of claim 17 wherein the first device includes a manual input component further comprising a manual input component, the coaching mode being deactivated through at least one of a voice command or a manual input to the first device from the user

29 The system of claim 17 wherein the connection is a socket connection to the second device through the wireless network

30 A method for training a user in voice-enabled work environment, comprising establishing communication over a wireless network between at least two voice-enabled devices, a first device and a second device, each of the at least two devices including operable to, upon receiving a system Prompt, convert the Prompt into speech, and, upon receiving a voice command from the user, use speech recognition technology to convert the voice command, selectively activating the first device into a coaching mode and establishing a coaching connection with the second device over the wireless network, at the second device, detecting a connection with the first device, if a connection is detected, forwarding system Prompts of the second device to a connected first device as the system Prompts are received by the second device at the first device, receiving system Prompts from the second device and converting them to speech at the first device

31 The method of claim 30 further comprising at the second device, detecting a connection with multiple devices and forwarding system Prompts to multiple connected devices

32 The method of claim 30 further comprising converting a received system Prompt from the second device into speech as a voice Prompt for the user at the first device

33 The method of claim 30 further comprising selectively deactivating the speech recognition technology of the first device when the coaching mode is activated,

34 The method of claim 30 further comprising, when the coaching mode is activated, converting into speech at the first device only system Prompts that are received from the second device

35 The method of claim 30 further comprising activating the coaching mode through a voice command from the user

36 The method of claim 30 further comprising activating the coaching mode through a manual input to the first device from the user

37 The method of claim 30 further comprising terminating the connection to the second device when the coaching mode is deactivated

38. The method of claim 30 further comprising deactivating the coaching mode through at least one of a voice command or a manual input to the first device from the user.