WO2009046574A1

WO2009046574A1 - Method and system for contact management and organization

Info

Publication number: WO2009046574A1
Application number: PCT/CN2007/002931
Authority: WO
Inventors: Xiaofeng Zhu; Von A. Mock
Original assignee: Motorola, Inc.
Priority date: 2007-10-11
Filing date: 2007-10-11
Publication date: 2009-04-16

Abstract

A method (700) or system (600) for facilitating contact management can include a display (210) operable to present an image (100) to a user and a processor (202) coupled to the display. The processor can be operable to capture (702) an image having a plurality of individual objects, associate (704) the individual objects with respective contact information, associate (706) the plurality of individual objects having contact information into a group, and selectively contact (708) either the group or an individual object having contact information by selecting at least a portion of the image associated with the group or the individual objects having contact information. The processor can further capture (710) a relative location of each individual object having contact information. The processor can further associate an individual object with a plurality of groups where each group is associated with a different image.

Description

METHOD AND SYSTEM FOR CONTACT MANAGEMENT AND

ORGANIZATION

lnventor(s) Xiaofeng Zhu Von A. Mock

FIELD

[0001] This invention relates generally to contact management schemes, and more particularly to contact management schemes using visual recognition techniques.

BACKGROUND

[0002] Mobile devices provide a lifeline or become extensions to the social lives of many people. Many people use mobile devices primarily as social connectors due to the immediate access they allow. Calling someone and sending a test message has become a relatively easy thing to do. Multimedia messaging can provide opportunities for individuals to share and belong to social groups or other affiliations. There are a number of startup companies that are leveraging the social interaction with the ease of use to generate new opportunities to create and share content. WiMAX and future communication protocols will provide adequate bandwidth to send video and other rich multimedia content between members of a social group. [0003] With embedded cameras, taking pictures and sharing such pictures with others who are socially connected through mobile handsets is becoming popular. Recent research studies show that users are more willing to reflect and share images with people that are part of the experience. For example, a photo taken for a 10 year graduation reunion can help classmates to refresh and maintain their social networking through the branch of a school alumni relationship. A picture taken for all members of a university sailing team can help members to keep fresh the memory of special events they have encountered together in sailing trainings and competitions. [0004] Notwithstanding these advances in bandwidth and hardware technology enabling the sharing of pictures through mobile devices, the management of these rich media files and associated information including contact names, phone numbers, email address and other information is not well integrated for ease of use. Several existing techniques that are centered around instant messaging applications that enables users to determine when a user should contact other users within a social and business environment still fails to address the current needs in the context of multimedia. Even techniques that use an avatar image to represent a user (similar to associating a user's picture with a contact entry) and overlaying text to indicate availability and presence is inadequate for current multimedia requirements. Other aspects such as watermarking of images and group calls as used in mobile environments have not accounted for the latest advancements in sharing of multimedia content among mobile users. :

SUMMARY

[0005] Embodiments in accordance with the present invention can provide a method and system that facilitates the capture an image having a plurality of individual objects and the association of the individual objects with respective contact information into a group to facilitate contacting either the group or the individual object by selecting at least a portion of the image associate with the group or the individual object.

[0006] In a first embodiment of the present invention, a method of contact management can include the steps of capturing an image having a plurality of individual objects, associating the individual objects with respective contact information, associating the plurality of individual objects having contact information into a group, and contacting either the group or an individual object having contact information by selecting at least a portion of the image associated with the group or the individual objects having contact information. Associating the individual object with respective contact information can include embedding the image with water marks having contact information. The step of associating the individual object with respective contact information can also include requesting BlueTooth friendly names and corresponding contact information upon capturing the image.

[0007] The method of contact management can further include the step of capturing a relative location of each individual object having contact information. The method can further include the step of retrieving a group picture when a call from a member of the group is received. In another aspect the method can also include retrieving a group picture when a call from a member of the group is received and further scaling a portion of group picture to substantially fit a predetermined sized display area, wherein the portion of the group picture corresponds to the member of the group sending the call. The method can also include the step of associating an individual object with a plurality of groups, where each group is associated with a different image. The individual object having contact information can be a person where the method further includes the step of recognizing the person in a subsequent captured image and associating contact information previously obtained for the person. The method can also include the step of contacting the group or the individual object having contact information by selecting at least a portion of the image associated with the group or the individual objects having contact information and initiating a push to connect sequence on a two-way communication device.

[0008] In a second embodiment of the present invention, a system for facilitating contact management can include a display operable to present an image to a user and a processor coupled to the display. The processor can be operable to capture an image having a plurality of individual objects, associate the individual objects with respective contact information, associate the plurality of individual objects having contact information into a group, and selectively contact either the group or an individual object having contact information by selecting at least a portion of the image associated with the group or the individual objects having contact information. The processor can associate the individual object with respective contact information by embedding the image with water marks having contact information. The processor can associate the individual object with respective contact information by requesting BlueTooth friendly names and corresponding contact information upon capturing the image. The processor can further capture a relative location of each individual object having contact information. The processor can further retrieve a group picture when a call from a member of the group is received. In another aspect the processor can further retrieve a group picture when a call from a member of the group is received and further scale a portion of group picture to substantially fit a predetermined sized display area of the display where the portion of the group picture corresponds to the member of the group sending the call. The processor can further associate an individual object with a plurality of groups where each group is associated with a different image. The system can also enable contacting the group or the individual object having contact information by selecting at least a corresponding portion of the image associated with the group or a corresponding portion of the individual objects having contact information and initiating a push to connect sequence on a two-way communication device having a wireless transceiver.

[0009] The terms "a" or "an," as used herein, are defined as one or more than one. The term "plurality," as used herein, is defined as two or more than two. The term "another," as used herein, is defined as at least a second or more. The terms "including" and/or "having," as used herein, are defined as comprising (i.e., open language). The term "coupled," as used herein, is defined as connected, although not necessarily directly, and not necessarily mechanically.

[0010] The terms "program," "software application," "resizing program" and the like as used herein, are defined as a sequence of instructions designed for execution on a computer system. A program, computer program, or software application may include a subroutine, a function, a procedure, an object method, an object implementation, an executable application, an applet, a servlet, a source code, an object code, a shared library/dynamic load library and/or other sequence of instructions designed for execution on a computer system.

[0011] Other embodiments, when configured in accordance with the inventive arrangements disclosed herein, can include a system for performing and a machine readable storage for causing a machine to perform the various processes and methods disclosed herein.

BRIEF DESCRIPTION OF THE DRAWINGS

[0012] FIG. 1 is an illustration of an image having a plurality of objects in the form of a group of individuals from a golf club where at least a number of individuals are associated with respective contact information and the group in accordance with an embodiment of the present invention.

[0013] FIG. 2 is an alternative illustration of the image of FIG. 1 demonstrating an ability to use BlueTooth friendly names and an ability to calculate the relative location of each device owner based on a camera's focus, depth, vision and each device's location/GPS data in accordance with an embodiment of the present invention.

[0014] FIG. 3 is another image of the group or a portion of the group of FIG.

1 demonstrating the ability to highlight a call from a member of the group in accordance with an embodiment of the present invention.

[0015] FIG. 4 is yet another image of the group or a portion of the group of

FIG. 1 , demonstrating the ability to highlight a cad from another member of the group in accordance with an embodiment of the present invention.

[0016] FIG. 5 is an illustration of an image or images that enables a user to easily identify member groups that a particular object or individual belongs to in accordance with an embodiment of the present invention.

[0017] FIG. 6 is a block diagram of a system or device for facilitating contact management in accordance with an embodiment of the present invention. [0018] FIG. 7 is flow chart illustrating a method of contact management in accordance with an embodiment of the present invention.

DETAILED DESCRIPTION OF THE DRAWINGS

[0015] While the specification concludes with claims defining the features of embodiments of the invention that are regarded as novel, it is believed that the invention will be better understood from a consideration of the following description in conjunction with the figures, in which like reference numerals are carried forward.

[0016] Embodiments herein can be implemented in a wide variety of ways and in a wide variety of devices such as personal digital assistants, mobile handsets, audio players, and WiMAX capable devices as examples. A group image in a multimedia device can embedded with more information than just the people that participated. People are easier to recall when additional context and group affiliations are provided in the form of embedded information recorded in association with an image. Event or group images take an important role when users develop and maintain their social networking. [0017] Referring to FIG. 1 , a captured image 100 of a group of objects is shown. In particular, this group of objects illustrates a group of individuals from a golf team photo. Each picture image or object can be water marked with contact information 102 when the image is taken or edited afterwards. A photo editor user interface (Ul) can be used to place anchors 104 on or in association with individual persons (or objects) on the photo and further linked with the respective contact information 102. The linking of the information to the objects in the photo can be done either manually or automatically as will be further explained below. In this manner, if a person participates in a group event or activity, the user can and more likely will reflect and share images with people that are part of the experience. The embodiments herein allow a user to contact the group using the image not only as a method of forming a dynamic group but to also send and share information whether the information is related to the common experience or not. [0018] As further shown in FIG. 1 , method and systems in accordance with the embodiments allow users to water mark picture images or objects with contact information when the image is taken or subsequently during editing. In one embodiment, contact information can be immediately embedded if the object being photographed also have devices that provide the associated contact information. For example, if a person being photographed has a phone or personal digital assistant that has Bluetooth technology that can transmit contact information, then Bluetooth friendly names along with contact information can be requested from each user's mobile device at the time of the image capture. The user upon capturing the picture can choose from a list of Bluetooth friendly names along with corresponding contact information to embed in the image (an implementation of watermarking). In an alternative embodiment, a user can associate existing contact information (that can reside in a phone book for example) that can either be linked to the contact in the mobile device or embedded as part of the image.

[0019] In one example with reference to FIGs. 1 and 2, only data (e.g. friendly name, contacts info, etc.) from each owner in the scope of the current shot is selected and recorded/stored/linked with current picture image. Others may be discarded automatically. The relative location information can be used to place water marks or links for each person or at least some of the people shown in the picture automatically in several ways. Relative location of each device owner can be gathered and calculated based on a camera's focus, depth, vision and each device's location/position (e.g. GPS) data. The location of the person where the camera is being focused on can be compared with the location of the camera along with focal length to determine if this person should be included in the contact information list. In other aspects, the camera's focal length and direction can be used to provide input to the radius of wireless monitoring as well as direction (compass heading) during the image capture process. This can eliminate or reduce the individual(s) that are standing behind the user taking the picture to be also listed as contacts. [0020] Furthermore, objection recognition technology (such as recognition technology provided by Evolution Robotics or Neven Vision) can enable the processing of captured images to determine if other preexisting images of individuals are part of the image just captured. Tags or watermarking contact information on the preexisting image(s) can be applied (compared and associated) to the current image. Such a scheme would allow for easy creation of groups and contact information based on existing images a user may already have with associated contact information.

[0021] Once an image and associated contact information or other data is captured for a particular individual, a system incorporating the technology herein can also provide greater visual context. For example, when a call from a member of the golf team is received, the entire group picture can be retrieved and displayed. In a more specific embodiment, if a particular golf team member calls (e.g., John), then a mobile device 300 can display a portion 302 of the group picture with the particular team member's head portrait (John's head portrait) centered in the display of the mobile device 300as shown in FIG. 3. If another call is received from another golf team member (e.g., Richard), then the mobile device 300 can display another portion 403 of the group picture with Richard's head portrait centered in the display of the mobile device 300 as shown in FIG. 4.

[0022] Referring to FIG. 5, object recognition technology can be used to search or affiliate groups and users by identifying an individual within each stored image. For example, a person can be identified within a number of images where each image might be associated with different groups. For example, one individual (e.g. "Bob") might be associated in several groups associated with several images (e.g., Koala project, My Office, and Golf Team). Therefore, Bob would show up as being affiliated in other groups when a user request group affiliations for a particular individual. In this regard, when a picture is taken of Bob or an object of interest that includes other friends, an embodiment herein can now also associate Bob's contact information with Bob's object within the image to all the friends and their respective contact information. Thus, when a new picture is taken of Bob, the device can recognize Bob in the image and automatically add previous contact information created for Bob (and any group affiliation information) to the new picture (or prompt the user to add such additional information). Current object recognition technology fails to automatically add previously captured contact info for an image.

[0023] Note, picture Caller ID can be further incorporated herein to provide additional enhancements. For example, on a mobile device or handset with small displays, the active talker's picture image from the group picture image can be centered on the display. On a mobile device or handset with large^' displays, the whole group image can be rendered with an active talker's nametag presented above, below or in some proximity to the current active talker head and to reflect such active status.

[0024] Other aspects here can enable a proper picture Call ID for individual group members by callee and caller information matching. For example, if John , Bob, and the USER are in the Golf Team, Jake, Jason, John, and USER are in "My Office" Group, and a group call contains John , Bob and the USER, then the device will retrieve Picture Caller ID based on the Golf Team's photo. However, a different image will be rendered (My Office Staff Photo) when the USER is invited to a group call that contains John, Jason, and the USER. A person may have many different memberships or roles in various teams and groups and as the number of contacts typically swell to hundreds, the group and team dynamics becomes unmanageable. The ability to provide contextual information to a user in the form of group function through the use of Picture Identification and how they relate to each other is vital to understanding the context of the communication.

[0025] For the ease of simplicity, an image that has contact information embedded in the image file can be easier to manage, but as an alternative a XML approach can also be utilized where each contact in the XML file can be associated with one or more pictures within the mobile device. The XML contact file can be dynamically updated to include new images and new contacts that are taken by the mobile user.

[0026] In other various other aspects of the embodiments, a user can create a dynamic group based on picture images with water marked contact information and initiate private or interconnect calls or group or conference calls. For example, in a mobile device having push-to-talk or push-to-connect (PTT) technology, a user could press a PTT key on the picture and a group call can be initiated in which all linked members are involved. Similarly, a send key press with an individual member highlighted can cause an interconnect call to be placed to that member. A user can also use four (4) way or multiple-way navigation keys to navigate scroll through a group picture. With proper zoom, the person currently centered on the group picture can be selected for a private call when a PTT key or Send key is activated. In another aspect while viewing a group picture, a user can activate a soft or hard key and be presented with a list of names than be further grouped or selected by the user. [0027] The technology herein can also enable users to pack the water marked picture image with contact information and transmit the package to linked contacts group or others. In other words, the water marked picture image and associated contacts can be pushed to desired recipients. [0028] In another embodiment of the present invention as illustrated in the diagrammatic representation of FlG. 6, an electronic product such as a machine having a display 210 can include a processor or controller 202 coupled to the display. The electronic product or device can be a hand-held device such as a cellular phone, a personal digital assistant, a smart phone, an MP3 P\ayer, a music player, a remote controller, a laptop computer, and the like. Generally, in various embodiments it can be thought of as a machine in the form of a computer system 200 within which a set of instructions, when executed, may cause the machine to perform any one or more of the methodologies discussed herein. In some embodiments, the machine operates as a standalone device. In some embodiments, the machine may be connected (e.g., using a network) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client user machine in server-client user network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. For example, the computer system can include a recipient device 201 and a sending device 250 or vice-versa.

[0029] The machine may comprise a server computer, a client user computer, a personal computer (PC), a tablet PC, personal digital assistant, a cellular phone, a laptop computer, a desktop computer, a control system, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine, not to mention a mobile server. It will be understood that a device of the present disclosure includes broadly any electronic device that provides voice, video or data communication or presentations. Further, while a single machine is illustrated, the term "machine" shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.

[0030] The computer system 200 can include a controller or processor 202 (e.g., a central processing unit (CPU), a graphics processing unit (GPU, or both), a main memory 204 and a static memory 206, which communicate with each other via a bus 208. The computer system 200 may further include a presentation device such as the display 210. The computer system 200 may include an input device 212 (e.g., a keyboard, microphone, etc.), a motion detecting device such as an accelerometer 213, a cursor contro) device 214 (e.g., a mouse or touch pad), a disk drive unit or solid state memory 216, a signal generation device 218 (e.g., a speaker or remote control that can also serve as a presentation device) and a network interface device 220. Of course, in the embodiments disclosed, many of these items are optional. [0031] The disk drive unit 216 may include a machine-readable medium 222 on which is stored one or more sets of instructions (e.g., software 224) embodying any one or more of the methodologies or functions described herein, including those methods illustrated and with respect to FIG. 7 for example. The instructions 224 may also reside, completely or at least partially, within the main memory 204, the static memory 206, and/or within the processor or controller 202 during execution thereof by the computer system 200. The main memory 204 and the processor or controller 202 also may constitute machine-readable media.

[0032] Dedicated hardware implementations including, but not limited to, application specific integrated circuits, programmable logic arrays, FPGAs and other hardware devices can likewise be constructed to implement the methods described herein. Applications that may include the apparatus and systems of various embodiments broadly include a variety of electronic and computer systems. Some embodiments implement functions in two or more specific interconnected hardware modules or devices with related control and data signals communicated between and through the modules, or as portions of an application-specific integrated circuit. Thus, the example system is applicable to software, firmware, and hardware implementations. [0033] In accordance with various embodiments of the present invention, the methods described herein are intended for operation as software programs running on a computer processor. Furthermore, software implementations can include, but are not limited to, distributed processing or component/object distributed processing, parallel processing, or virtual machine processing can also be constructed to implement the methods described herein. Further note, implementations can also include neural network implementations, and ad hoc or mesh network implementations between communication devices. [0034] The present disclosure contemplates a machine readable medium containing instructions 224, or that which receives and executes instructions 224 from a propagated signal so that a device connected to a network environment 226 can send or receive voice, video or data, and to communicate over the network 226 using the instructions 224. The instructions 224 may further be transmitted or received over a network 226 via the network interface device 220. [0035] While the machine-readable medium 222 is shown in an example embodiment to be a single medium, the term "machine-readable medium" should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term "machine-readable medium" shall also be taken to include any medium that is capab\e of storing, encoding or carrying a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present disclosure.

[0036] Referring to FIG. 7, a method 700 of contact management can include the step 702 of capturing an image having a plurality of individual objects, associating the individual objects with respective contact information at step 704, associating the plurality of individual objects having contact information into a group at step 706, and contacting at step 708 either the group or an individual object having contact information by selecting at least a portion of the image associated with the group or the individual objects having contact information. Note, the step of associating the individual object with respective contact information can include embedding the image with water marks having contact information. The step of associating the individual object with respective contact information can also include requesting BlueTooth friendly names and corresponding contact information upon capturing the image.

[0037] The method 700 can further include the step 710 of capturing a relative location of each individual object having contact information. The method can further include the step 712 of retrieving a group picture when a call from a member of the group is received. In another aspect the method 700 can also include retrieving a group picture when a call from a member of the group is received and further scaling a portion of group picture to substantially fit a predetermined sized display area at step 714, wherein the portion of the group picture corresponds to the member of the group sending the call. The method 700 can also include the step 716 of associating an individual object with a plurality of groups, where each group is associated with a different image. The individual object having contact information can be a person where the method 700 further includes the step 718 of recognizing the person in a subsequent captured image and associating contact information previously obtained for the person. The method 700 can also include the step 720 of contacting the group or the individual object having contact information by selecting at least a portion of the image associated with the group or the individual objects having contact information and initiating a push to connect sequence on a two-way communication device.

[0038] In light of the foregoing description, it should be recognized that embodiments in accordance with the present invention can be realized in hardware, software, or a combination of hardware and software. A network or system according to the present invention can be realized in a centralized fashion in one computer system or processor, or in a distributed fashion where different elements are spread across several interconnected computer systems or processors (such as a microprocessor and a DSP). Any kind of computer system, or other apparatus adapted for carrying out the functions described herein, is suited. A typical combination of hardware and software could be a general purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the functions described herein.

[0039] In light of the foregoing description, it should also be recognized that embodiments in accordance with the present invention can be realized in numerous configurations contemplated to be within the scope and spirit of the claims. Additionally, the description above is intended by way of example only and is not intended to limit the present invention in any way, except as set forth in the following claims. [0040] What is claimed is:

Claims

1. A method of contact management, comprising the steps of: capturing an image having a plurality of individual objects; associating the individual objects with respective contact information; associating the plurality of individual objects having contact information into a group; and contacting either the group or an individual object having contact information by selecting at least a portion of the image associated with the group or the individual objects having contact information.

2. The method of claim 1, wherein the step of associating the individual object with respective contact information comprises embedding the image with water marks having contact information.

3. The method of claim 1 , wherein the step of associating the individual object with respective contact information comprises requesting BlueTooth friendly names and corresponding contact information upon capturing the image.

4. The method of claim 1 , wherein the method further comprises the step of capturing a relative location of each individual object having contact information.

5. The method of claim 1 , wherein the method further comprises the step of retrieving a group picture when a call from a member of the group is received.

6. The method of claim 1 , wherein the method further comprises the step of retrieving a group picture when a call from a member of the group is received and further scaling a portion of group picture to substantially fit a predetermined sized display area, wherein the portion of the group picture corresponds to the member of the group sending the call.

7. The method of claim 1 , wherein the method further comprises the step of associating an individual object with a plurality of groups, where each group is associated with a different image.

8. The method of claim 1 , wherein the individual object having contact information is a person and the method further comprises the step of recognizing the person in a subsequent captured image and associating contact information previously obtained for the person.

9. The method of claim 1 , wherein the step of contacting the group or the individual object having contact information is done by selecting at least a portion of the image associated with the group or the individual objects having contact information and initiating a push to connect sequence on a two-way communication device.

10. A system for facilitating contact management, comprising: a display operable to present an image to a user; and a processor coupled to the display, wherein the processor is operable to: capture an image having a plurality of individual objects; associate the individual objects with respective contact information; associate the plurality of individual objects having contact information into a group; and selectively contact either the group or an individual object having contact information by selecting at least a portion of the image associated with the group or the individual objects having contact information.

11. The system of claim 10, wherein the processor associates the individual object with respective contact information by embedding the image with water marks having contact information.

12. The system of claim 10, wherein the processor associates the individual object with respective contact information by requesting BlueTooth friendly names and corresponding contact information upon capturing the image.

13. The system of claim 10, wherein the processor further captures a relative location of each individual object having contact information.

14. The system of claim 10, wherein the processor further retrieves a group picture when a call from a member of the group is received.

15. The system of claim 10, wherein the processor further retrieves a group picture when a call from a member of the group is received and further scales a portion of group picture to substantially fit a predetermined sized display area of the display, wherein the portion of the group picture corresponds to the member of the group sending the call.

16. The system of claim 10, wherein the processor further associates an individual object with a plurality of groups, where each group is associated with a different image.

17. The system of claim 10, wherein the system enables contacting the group or the individual object having contact information by selecting at least a corresponding portion of the image associated with the group or a corresponding portion of the individual objects having contact information and initiating a push to connect sequence on a two-way communication device having a wireless transceiver.

18. A computer readable storage medium comprising a computer program adapted to perform the steps of: capturing an image having a plurality of individual objects; associating the individual objects with respective contact information; associating the plurality of individual objects having contact information into a group; and contacting either the group or an individual object having contact information by selecting at least a portion of the image associated with the group or the individual objects having contact information.

19. The computer readable storage medium of claim 18, wherein the computer program is further adapted to initiate a group call or a call to an individual object having contact information by selecting at least a portion of the image associated with the group or the individual objects having contact information and initiating a push to connect sequence on a two-way communication device.

20. The computer readable storage medium of claim 18, wherein the computer program is further adapted to retrieve a group picture when a call from a member of the group is received or retrieve a portion of a group picture containing an image of the member of the group.