WO2006090326A1

WO2006090326A1 - Soft touch screen family communication board

Info

Publication number: WO2006090326A1
Application number: PCT/IB2006/050550
Authority: WO
Inventors: Fabien M.J. Guillorit
Original assignee: Koninklijke Philips Electronics, N.V.; U.S. Philips Corporation
Priority date: 2005-02-23
Filing date: 2006-02-20
Publication date: 2006-08-31

Abstract

A system and method for communicating messages having audio or video content, or both, via an electronic message board including a touchscreen device provided as part of a computer display device for receiving user touch input. The method comprises steps of : storing identification data of each user corresponding to a touch screen input previously obtained by that user; automatically initiating recording of a message in response to a user touching the touchscreen device,- associating a recorded message with a target recipient user, and providing an indication of availability of one or more recorded messages for the target recipient user on the message board'; and enabling a current user access to an available message by comparing identification data generated by the current user' s touch input with stored identification data of the intended targeted recipient; and, causing playback of the recorded message for the user in response to positively identifying said current user as the targeted recipient. The identification data may be a user's fingerprint template .

Description

SOFT TOUCH SCREEN FAMILY COMMUNICATION BOARD

The present invention relates generally to graphical user interfaces (GUI) and more particularly, an electronic message board that permits users to record audio, video or text messages for retrieval by others.

U.S. Patent No. 6,714,222 describes generally a user touch screen interface that provides access to communications and other applications in a home environment by utilizing icons that may be selected method for enabling access to a computer system that does not employ fingerprint recognition technology, just a physical tap of the icon. U.S. Patent No. 5,420,936 describes generally a method for enabling access to a computer system that employs fingerprint recognition technology. By touching a touchscreen interface directly over a graphical object, a linked fingerprint recognition device is used to recognize the fingerprint user and grant that user access to a program identified by the object to which they are authorized to access. None of these references however teach the use of a family or organization electronic "message board" that enables an individual of a family or organization unit to record, store and playback audio, visual, or A/V messages or text messages to another family or organization member, for retrieval by other family or organization unit members, all via a touch screen and communications interface that employs fingerprint recognition technology.

One aspect of the present invention is directed to an electronic touchscreen "message board" allows users to record audio or video messages for other users. The board may be stand-alone or connected to a home network in order to be used as a display for audio/visual (AV) content, or to browse the Internet. The board is a soft touch screen. Prior to use, all users apply their hand on the screen and get their fingerprint and picture recorded.

In the context of a home environment where the users are members of a family, for example, using the present invention, a user family member is able to record a message for a specific other family member or, for all family members, e.g., a general messages. In order to record, the author will just apply his/her hand or, a finger on the touchscreen. The fingerprint is read, and the recording of a message will start. The screen will have at least a microphone and one or more speakers and, in an additional embodiment, an image and video acquisition device (e.g., a video camera). When the recording is finished, pictures of the family members will appear, and then the author will select whom he/she wants to get the message by touching the right picture. For generic messages, the author will select everyone and give a title to the message.

Thus, according to a preferred aspect of the invention, there is provided a system and method for communicating messages having audio or video content, or both, via an electronic message board including a touchscreen device provided as part of a computer display device for receiving user touch input. The method comprises steps of: storing identification data of each user corresponding to a touch screen input previously obtained by that user; automatically initiating recording of a message in response to a user touching the touchscreen device; associating a recorded message with a target recipient user, and providing an indication of availability of one or more recorded messages for the target recipient user on the message board; and enabling a current user access to an available message by comparing identification data generated by the current user' s touch input with stored identification data of the intended targeted recipient; and, causing playback of the recorded message for the user in response to positively identifying said current user as the targeted recipient.

Advantageously, when a person walks in front of the board, that person will see his/her photographic image or picture and the number of messages that have been recorded for that person. For each message, before play back, the user will additionally see the picture or photo image of the author. A general message will appear as notes with a title (e.g., text), for instance. To initiate message playback, people only have to touch them via the display soft touch screen interface. On fingerprint recognition, the message will be played/presented. Personal messages will not be played if fingerprints do not match.

The objects, features and advantages of the present invention will become apparent to one skilled in the art, in view of the following detailed description taken in combination with the attached drawings, in which:

Figure 1 depicts a block diagram of a computer processing system 10 utilized to implement the present invention;

Figures 2 depicts an example touch screen interface message board 50 providing functionality according to the present invention;

Figure 3 is a flow chart depicting the methodology for recording and delivering messages according to the invention;

Figure 4 depicts an example "Birthday Greetings" message application for the touch screen recognition functionality of the present invention; and,

Figure 5 depicts an example home network application for the touch screen recognition functionality of the present invention.

The present invention is directed to a soft and touch screen message board that enables users to record audio or video messages for other users. Referring first to FIG. 1, a computer processing system 10 which may be utilized to implement the present invention, includes an individual computer device 12, or alternatively, one or more computer devices 13 adapted for implementing the present invention that may be wired or wirelessly connected via a home network, i.e., a wired or wireless Local Area Network (LAN) 19, and, may include a connection to a public network such as the Internet. It is understood that in such computer processing systems, a standard input device such as a keyboard 22 and mouse device (not shown) is provided, and although not shown, a memory storage device and/or a printer/output device may be optionally provided. Further provided with the system of FIG. 1, is a display monitor or like computer display device 40 such as found with an individual computer providing an interface for enabling playback of video data, files, clips or messages, and, additionally, audio speakers 42 for enabling playback of audio data, files clips or messages. Further included is a camera or like video camera device 44 interfaced with the computer 12 that is equipped with the hardware interfaces and communications software for enabling processing and recording of video messages or clips that may be stored in and played back via the computer system, in the manner as known in the art, and, a microphone device 34 interfaced with the computer 12 for enabling recording of audio messages or clips that may be stored in and played back via the computer system.

In order to gain access to the audio/video data, messages and/or applications accessible through the display monitor 40 and respective interfaces, a user may typically have to type, using keyboard 42, an authorized password in the space provided on the screen 40. However, in a preferred embodiment of the invention, as will be described in greater detail herein with respect to Figure 2, the present invention enables recording of and provides access to specific messages and/or applications through the display monitor 40 via a touch screen interface message board 50 (which may include text and graphics such as icons) that are presented to the user for enabling interactivity according to the invention. That is, the display monitor device 40 preferably includes a touch screen interface message board 50 for initiating access to the functions of the present invention. Once identified, a user typically has access only to those features/functions authorized for that identified user. The message board 50 is preferably stand-alone or connected to a home network in order to be used as a display for A/V content or to enable Internet browsing. As shown in Figure 2, in order to gain access to general A/V or text message data as indicated by exemplary touch screen fields represented as icons 52, 54, 56, 58 and 60 and shown in the example touchscreen message board interface 50 of Figure 2, a user must first place his/her fingertip thereon. At that point, a fingerprint recognition device in communication with the touchscreen interface 50 checks for authorized access. If the user is authorized access to that message/data/application, the message/data/application will be presented to the user. Any single user may be authorized access to one or more of the messages/programs/files presented on the touchscreen message board 50. Although not shown, it is understood that the touch-screen surface of Figure 2 is a well-known, multipoint, touch- sensitive surface that detects contact at given points. An analog- digital converter (not shown) passes data about contacts positioned between a touch-sensitive surface of touch screen 50 and a touch driver (not shown). The touch driver is coupled to a fingerprint analyzer where a fingerprint image from the touchscreen message board is communicated to an analyzer device in a form appropriate to distinguish a unique fingerprint, as is known in the art. Thus, when a user touches the screen for accessing a message(s) previously recorded and stored for that specific user via a touch fields represented as icon 60 representing that user, e.g., a photograph image of that user's face or likeness 61, that user's fingerprint is compared to a previously obtained fingerprint template associated with that specific user and represented by the touched iconic representation. If a positive match is found, that user will be granted access to that message, i.e., the message recorded for that targeted recipient an is found via an associated

"message " access table implemented by an access grantor device (not shown). It is understood that the fingerprint match must meet a specified confidence level before manipulation access is granted through the computer device's operating system and access method. The appropriate message/program/data may then be obtained from nonvolatile storage, for example, for playback/presentation via an A/V communication system according to the invention.

Thus, a user' s fingerprints are first recorded via the touch driver and fingerprint analyzer components (not shown) that will record the fingerprint and associate it with the user and that user' s recorded photograph. In this manner, finger prints/ hand prints from the family are memorized, and used to protect messages that are addressed to them. However, as will be explained in greater detail herein, a general message may be recorded for playback that is accessible for all users via touch fields represented as icons 56, 58, for example. As access to a general message is universal, it is not necessary for a user to obtain prior fingerprint recognition in order to gain access to the general message, however, it is advantageous to ensure access only by members of the family or organization.

Thus, as mentioned herein with respect to Figure 2, the touch screen message board 50 according to the present invention provides touch screen fields 60 through which targeted messaging functionality of the invention is provided. In one embodiment, prior to using the invention, all of the contemplated users, e.g., all members of a family or organization, must apply their hand/finger on the touch screen interface 50 and have their fingerprint recorded and stored as their fingerprint template for comparison. Likewise, each user must have his/her digital photograph (picture) recorded, which may be accomplished by conventional means including standard functionality such as may provided with the video camera 44 or like digital camera device. The user's fingerprint profiles are further associated with users' photograph image 61 that is displayed in association with a touch screen field 60 of touch screen interface message board 50. It is understood that besides a photographic image or likeness of the user, any other type of icon or graphic element representative of the user, may be employed.

In the context of a stand-alone family computer for a home, or computers of a home network, a user family member is able to record a message for another specific member of the family or, for all family members. Figure 3 depicts a flow chart 100 providing the methodology for recording and delivering messages according to the invention. A first method step indicates that the computing system is in an idle mode of operation, i.e., waiting for a user interaction state, as depicted at step 102. In order to access the system, a user has to touch the screen by applying his/her hand or a finger on the screen as depicted at step 104. A determination is then made at step 107 as to whether the user is to leave a message, enter or access an application, or, otherwise, retrieve a message that had been left for him/her. In any event, the space on the message board that the user touched must first be qualified. If the user is to leave a message according to the invention, the process proceeds to step 110 where the space on the board touched by the user is qualified. For example, if the user is touching or has touched an application icon on the screen, e.g., a Calendar program or utility such as represented by icon 54 in Figure 2, then it will activate the associated application as indicated at step 115. Otherwise, if an empty space has been touched, the user is prompted to record a message, as indicated at step 120. Thus, at step 120, functionality is activated to enable an audio/visual message to be recorded via microphone 30, and video camera device 44 as shown in Figures 1 and 2.

More particularly, returning to Figure 2 in connection with recording and playback of A/V messages, there is depicted audio processing device 35 and image processing device 45 connected with respective audio microphone device 34 and image acquisition device (video camera) 44. The audio processing device 35 receives audio signals from the microphone and performs the appropriate processing including such functions as analog/digital converting, pre-processing and pre- amplifying including the generation of output audio signals via the speakers 42. Likewise, the image processing device 45 receives image/video signals from the video camera or other image acquisition device (e.g., digital camera) and performs the appropriate processing including such functions as analog/digital converting, if necessary, pre-processing and pre- amplifying including the generation of output image/video signals via the display monitor. Although not shown, it is understood that a suitable mixing unit is provided that connects with both the audio processing device 35 and image processing device 45 to receive digital image/video and digital audio signals to mix these signals for A/V message recording and/or playback applications.

After the user's message is recorded, the process continues to step 125 where the user who has recorded the message is prompted to select an addressee, i.e., an identification of the intended recipient (e.g., a family member) of the newly recorded message. In one embodiment, this may comprise the recipient's e-mail address, e.g. father at work. That is, a user could enter the recipient's e-mail addresses so that audio/video messages can be forwarded to them during convenient times of the day when a recipient's availability to receive e-mail is assured. In one preferred embodiment, after the message has been recorded, photograph images, i.e., icons 60 of all the family members will appear via the touchscreen interface message board 50 of Figure 2, which may be selected. By touching an icon via the touchscreen interface display field(s) 60 of another family member(s), that family member(s) becomes the intended recipient(s), i.e., addressee of the recorded message. In response to selecting an addressee, that person's stored finger print/hand print template will be associated automatically with the message, consequently, making it a private message only accessible by the intended selected recipient. The system further causes generation of an indication, e.g., a number, representing the current amount of messages that have been stored for that user. That number is associated for display with the user icon, and is incremented for each new message saved for that recipient user. Continuing further as shown in Figure 3, a decision is made as to whether the message is to be saved as a general message to any and all users, e.g., family members. Thus, at step 130, a determination is made as to whether the intended recipient (e.g., a family member) of the newly recorded message is general, i.e., intended for receipt by anyone, such as an announcement. If a general message intended for anyone is recorded, e.g., every member of the family, then the requirement of user identification at delivery is not necessary and the process returns to step 102. Otherwise, if at step 130, the intended recipient is a specific person or family member who's fingerprint/handprint has been previously registered/stored, the process continues to step 135, where the added requirement that the user be identified at delivery is enabled. Thereafter, the process returns to idle step 102.

Thus, the present invention advantageously provides the function that enables a user to record an audio/visual message just by applying his/her hand or a finger on the screen. That handprint/fingerprint will be read, and the recording will automatically start via the system microphone and image acquisition devices used to record/playback the message. When the recording is finished, photo images or icons 60 of the family members will appear (Figure 2), and then the author will select whom he/she wants to get the message by touching the touch screen field associated with the image/icon 60 of the selected recipient. For a generic message, the author may select everyone and further, may give a title to the message. Further, referring back to Figure 2, when a person operates, observes or otherwise views the touch screen message board 50, he/she will see his/her picture and the number of messages that have been stored for that person. For each message accessed by a recipieint, before play back, the system may further generate for the target recipient see the picture of the author. General message will appear as notes with a title. To play messages back, user' s only have to touch them via the touchscreen message board interface 50. Upon fingerprint recognition, the message will be played; otherwise, personal messages will not be played if fingerprints don't match.

As further shown in Figure 3, returning to step 107, if it is determined that the screen has been touched at a location of a user's representative photo image or icon 60 that have one or more messages are available for that user to retrieve, as represented by the number or like indication associated with that user's representative photo image or icon 60, then the process proceeds to step 132 which implements the biometric recognition functionality for ascertaining whether the accessing person is the intended recipient to whome the fingerprint/handprint of the touching user belongs. Thus, the process proceeds to step 135 to determine whether the fingerprint/handprint of the touching user is identified or recognized, e.g., a member of the family, for instance. If the touching user can not be identified after comparison of the touching user's fingerprint with the saved fingerprint template associated with the saved message, the process returns to step 102. Otherwise, if the touching user is identified after comparison with the saved fingerprint template, any saved audio, visual, A/V or text messages deliverable to that user is provided to the user via the computing system 10 as indicated at step 137. That is, the obtained fingerprint/handprint is compared against user's fingerprint/handprint templates and if identified, the associated messages for that recognized user are delivered or otherwise accessed by that user.

Referring now to Figure 4, there is depicted an example application for the touch screen recognition functionality of the present invention. In this example application, a "birthday greeting" or reminder message is recorded for an intended recipient having a birthday in the near future. Thus, in the predefined birthday process 150 depicted in Figure 4, it is assumed that a user has pre-recorded a birthday message for an intended recipient family member. A first step of the birthday process 150 involves the step 153 of determining whether it is within a predetermined time of the intended recipient's birthday, e.g., within "x" days or weeks. If it is not within the time period of the intended recipient's birthday, then the process remains idle as depicted in Figure 4. Otherwise, if it is determined that the current time is within the predetermined time period of the intended person's birthday, the process proceeds to step 155 to determine whether the intended person, whose birthday greetings or reminder are to be directed, picture or photo image is available. If the intended person's image is not available, then the process proceeds to step 160 where that person's name and birthdate are caused to be recorded and a reminder message displayed via the interface message board 50 of the display device 40, such as shown in Figure 2. Otherwise, if at step 155, it is determined that the intended person's picture or photo is available, then both the person's picture/photo is displayed at step 158 and the person's birthday reminder including name and birthdate are caused to be recorded and displayed at step 160. Thus, when the amount of days has elapsed, a birthday greetings icon 52 comprising a name, birthday date and photo if available, or, the name and birthday date, if not available, of the person whose birthday is imminent is displayed on the touchscreen interface message board 50. The intended recipient may then access the birthday message by selecting that user' s birthday greeting icon 52 in the manner as described herein with respect to Figure 3. Although not shown, an icon or notification may be displayed with a birthday reminder that distinguishes a message from a birthday. For example, although not shown, a graphic element such as a crown can be associated on screen with the birthday reminder, and only the crown graphic element if no picture is available. Returning to Figure 4, once the identified user, e.g., the birthday recipient has retrieved/acknowledged the birthday greetings message created as depicted at step 163, then the message may be automatically removed as depicted at step 165. It is understood that any event or announcement besides the example birthday application that may be the subject of a message, e.g., family events/agenda, anniversaries, sports classes/events or school meetings, may be implemented for display and access according to the invention in the manner depicted in Figure 4.

Referring now to Figure 5, there is depicted an example home network application 175 for the touch screen recognition functionality of the present invention. In this example application, a first step 180 involves the determination of whether any interactive applications are available. If at step 180 it is determined that no interactive applications are available, then the process remains idle as depicted in Figure 5. Otherwise, at step 180, if it is determined that interactive applications are available, then the process proceeds to step 183 to display that application as an icon. Associated with that icon is a table of user's that, if identified, will be granted access to the particular application(s) represented by the icon. Thus, as indicated at step 185, if it is determined that a user has selected the application by that user touching the representative icon displayed on the screen, a first determination is made as to which user the identified fingerprint belongs. Of course, if the application had not been selected as shown at step 185, Figure 5, then the process remains idle. Once the application is selected and the authorized user is identified via the implemented fingerprint/handprint identification process, the application will execute as depicted at step 187, Figure 5. It is understood that, in the context of the home network application, as the display device 10 can playback video/audio, a user could select a record or a TV program represented by an icon, for instance, via the touchscreen display, to be played back via the computing device.

While there has been shown and described what is considered to be preferred embodiments of the invention, it will, of course, be understood that various modifications and changes in form or detail could readily be made without departing from the spirit of the invention. It is therefore intended that the invention be not limited to the exact forms described and illustrated, but should be constructed to cover all modifications that may fall within the scope of the appended claims.

Claims

Having thus described my invention, what I claim as new, and desire to secure by Letters Patent is:CLAIMS:

1. A touchscreen display messaging system (10) comprising: a touchscreen device (50) provided as part of said computer display means (40) for receiving user touch input and generating associated identification data in response; means for storing identification data (12) of each user corresponding to a touch screen input previously obtained by that user via said touchscreen device; means (34, 42, 40, 44) adapted for recording and playing back of messages comprising audio or video content, or both; means (35, 45) responsive to a user touching said touchscreen device for initiating recording of a message having said audio or video content, or both; means (12) for associating a recorded message with a target recipient user, and providing an indication of availability of one or more recorded messages for said target recipient user via said display means; and, means (52, 54, 56, 58, 60) for enabling a current user access to available messages via said touchscreen device, said access enabling means authenticating a current user's touch input by comparing identification data generated by said current user touch input with stored identification data of the intended targeted recipient of the message, whereby said message having audio or visual content, or both, is played back for said user in response to positively identifying said current user.

2. The touchscreen display messaging system as claimed in Claim 1, further comprising means (60) for representing a user of said messaging system with a graphic element for display on a computer display means, said associating means comprising means for indicating availability of said recorded message for said target recipient user with that user' s graphic element.

3. The touchscreen display messaging system as claimed in Claim 2, wherein said graphic element comprises an image (61) of said messaging system user, said availability of one or more recorded messages for said target recipient user being displayed with said photographic image on said display means.

4. The touchscreen display messaging system as claimed in Claim 1, wherein said associating means further comprises: means responsive to recording of a message for generating graphic elements (60) of all potential target message recipients for display via said display means; and, means for enabling selection of a target message recipient user via touch selection of a graphic element representing the target recipient user.

5. The touchscreen display messaging system as claimed in Claim 1, wherein said identification data includes a fingerprint of each system user.

6. The touchscreen display messaging system as claimed in Claim 1, wherein said identification data includes a handprint of each system user.

7. The touchscreen display messaging system as claimed in Claim 1, wherein said message of audio or video content, or both, is of a general type accessible by all users, said associating means further providing an indication of availability of a general type message (56, 58) via said display means.

8. The touchscreen display messaging system as claimed in Claim 1, further comprising means for representing an executable application (54) as an element on said computer display means and associating authorized users of said application, said means for enabling a current user access to available messages further enables access to said executable application by selection via said touchscreen device.

9. The touchscreen display messaging system as claimed in Claim 1, wherein said means for associating a recorded message with a target recipient user, further comprises means for associating an image of a message author with that author's recorded messages, wherein a target recipient user is enabled to view an image of said author when authorized to access that author's recorded message.

10. A method (100) for communicating messages via an electronic messaging board including a touchscreen means (50) provided as part of a computer display device (40) for receiving user touch input, said method comprising steps of: a) storing identification data of each message board user corresponding to a touch screen input previously obtained by that user via said touchscreen means (50); b) providing means (34, 42, 40, 44) adapted for recording and playing back of messages comprising audio or video content, or both; c) initiating recording (120) of a message having said audio or video content, or both, in response to a user touching said touchscreen means (50); d) associating a recorded message with a target recipient user, and providing an indication of availability of one or more recorded messages for said target recipient user on said message board; e) enabling a current user access (60) to available messages via said touchscreen device by comparing (132) identification data generated by said current user touch input with stored identification data of the intended targeted recipient of the message; and, f) causing playback of said recorded message (137) for said user in response to positively identifying said current user as the targeted recipient.

11. The method as claimed in Claim 10, further comprising the step of: representing a user of said message board with a graphic element (60) for display on a computer display means, said associating step d) further comprising a step of indicating receipt of said recorded message with a graphic element representative of said target recipient user.

12. The method as claimed in Claim 11, wherein said graphic element comprises an image (61) of said message board user, said indicating step comprising displaying said availability of one or more recorded messages for said target recipient with said image on said display means.

13. The method as claimed in Claim 10, wherein said associating step further comprises the steps of: generating graphic elements of all potential target message recipients (60) for display via said message board in response to recording of a message; and, enabling selection (125) of a target message recipient user touch selection of a graphic element representing the target recipient user.

14. The method as claimed in Claim 10, wherein said identification data includes one of fingerprint or handprint data of a message board user.

15. The method as claimed in Claim 10, wherein said message of audio or video content, or both, is of a general type (130) accessible by all users, said associating step further comprising the step of providing an indication of availability of a general type message (56, 58) via said display means.

16. The method as claimed in Claim 10, further comprising: representing an executable application as an element (54) on said computer display device and associating authorized users of said application, said step of enabling a current user access to available messages further enabling access to said executable application (115) by selection via said touchscreen device.

17. The method as claimed in Claim 10, wherein said step of associating a recorded message with a target recipient user further comprises a step of associating an image of a message author with that author's recorded messages, wherein a target recipient user is enabled to view an image of said author when authorized to access that author's recorded message.

18. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform method steps for communicating messages via an electronic messaging board including a touchscreen means provided as part of a computer display device for receiving user touch input, said method steps including the steps of: a) storing identification data of each message board user corresponding to a touch screen input previously obtained by that user via said touchscreen means (50); b) providing means (34, 42, 40, 44) adapted for recording and playing back of messages comprising audio or video content, or both; c) initiating recording (120) of a message having said audio or video content, or both, in response to a user touching said touchscreen means (50); d) associating a recorded message with a target recipient user, and providing an indication of availability of one or more recorded messages for said target recipient user on said message board; e) enabling a current user access (60) to available messages via said touchscreen device by comparing (132) identification data generated by said current user touch input with stored identification data of the intended targeted recipient of the message; and, f) causing playback of said recorded message (137) for said user in response to positively identifying said current user as the targeted recipient.

19. The program storage device readable by a machine as claimed in Claim 18, further comprising the step of: representing a user of said message board with a graphic element (60) for display on a computer display means, said associating step d) further comprising a step of indicating receipt of said recorded message with a graphic element representative of said target recipient user.

20. The program storage device readable by a machine as claimed in Claim 19, wherein said graphic element comprises an image (61) of said message board user, said indicating step comprising displaying said availability of one or more recorded messages for said target recipient with said image on said display means.