WO2005096613A1

WO2005096613A1 - Device and method for linking psychophysiological parameters to an image

Info

Publication number: WO2005096613A1
Application number: PCT/EP2005/002059
Authority: WO
Inventors: Olivier Alain Christian Furon; Jean-Marie Viau; Nicolas Patrice Bernard Touchard
Original assignee: Eastman Kodak Company
Priority date: 2004-03-11
Filing date: 2005-02-26
Publication date: 2005-10-13
Also published as: FR2867644A1; FR2867644B1

Abstract

The invention is in the technical field of digital imaging. The invention relates to a camera and a method for linking a person's psychophysiological state to an image, when this person captures the image with the camera. The invention means thus enables the camera user's psychophysiological state to be linked to each of the images he/she captures. The invention relates to a camera (1) equipped, on its external case, with a measuring means (2) of at least one physiological data item of a user, when the user's skin touches the measuring means. The camera (1) is preferably a digital photographic camera, or a digital phonecam. The camera (1) comprises in particular a central processing unit (6) linked to the measuring means (2) and to the converter means (5), so as to perform the linking of the user's psychophysiological state to the captured image. The invention is used by people who possess a camera as described above.

Description

DEVICE AND METHOD FOR LINKING PSYCHOPHYSIOLOGICAL PARAMETERS TO AN IMAGE FIELD OF THE INVENTION The invention is in the technical field of digital imaging. The invention relates to a camera and a method for linking a person's psychophysiological state to an image, when this person captures the image with the camera. The invention has its application in the enhancement of images with information relating to the shooting context. BACKGROUND OF THE INVENTION Systems and methods implemented with terminals and taking into account psychophysiological data or parameters of the terminal users exist in the prior art. US Patent 6,540,663 describes a system and a method to control the psychophysiological state of a terminal user. US Patent 6,540,663 describes means to display, on the terminal, images supplied by a remote server in which they are saved. The terminal, for example a cellphone, comprises at least one sensor capable of being put into contact with the terminal user's skin, to make contact for example with the hand or fingers holding the cellphone. The sensor is capable of measuring a physical parameter, for example the skin temperature, the skin's electrical conductivity, etc., and supplying a signal representative of at least one psychophysiological state corresponding to the user. The objective of the means described in US Patent 6,540,663 is to control the user's psychophysiological state by providing him/her, on the terminal screen, with images selected to control this psychophysiological state: for example this consists in the display of restful images for a stressed user. The displayed images are saved in an image database, and selected, according to the psychophysiological state of the user of the terminal equipped with the measuring sensor. The desired goal is to control the user's psychophysiological state, by displaying an image to him/her capable of changing this psychophysiological state. The means described in US Patent 6,540,663 do not describe the linking of a psychophysiological image with an image, at the moment of capturing this image using said means. SUMMARY OF THE INVENTION The object of the present invention is to link one or more images with a psychophysiological state of a camera user at the moment of capturing the image with the camera. The psychophysiological state demonstrates a particular emotional state at the moment of capturing an image. This emotional or psychic state is established based on a measurement of at least one physiological data item specific to the user at the moment of capturing an image. The invention relates to a camera equipped, on its external case, with a measuring means of at least one physiological data item of a user, when the user's skin is in contact with the measuring means. The camera is preferably a digital photographic camera, or a digital phonecam. To improve the camera's ergonomics and reduce this camera's overall dimensions, the measuring means of the user's physiological data is advantageously included in the camera release. The measuring means of the physiological data is for example a touch sensitive sensor for temperature, electrical conductivity, hygrometry, or heart rate; or any other touch sensor enabling physiological data specific to the user to be measured, when the sensor is in contact with this user's skin. The user's physiological data is advantageously detected, using a camera whose sensor is included in the camera release, at the same time as the taking of a shot preceding the image capture. The camera can comprise a converter means, linked to the measuring means of the physiological data, to convert the measured physiological data into data representative of a user's psychophysiological state. To do this, the converter means comprises a conversion table that defines the correspondences between the measurement values of physiological data and data representative of a psychophysiological state. The camera can also preferably comprise a memory for the combined saving of images captured with the camera and data representative of the user's psychophysiological state at the moment of capturing said images. The saving can also be performed in a server remote from the camera, said server being capable of communicating, for example using a wireless link, with the camera. The invention also relates to a shooting method, in which, when a shot is taken by the user, the following steps are performed: the measurement of at least one physiological data item of the user; the conversion of the at least one physiological data item into data representative of a user's psychophysiological state; the saving of the data representative of the user's psychophysiological state linked to an image captured when shooting. The data representative of the user's psychophysiological state is advantageously included in the metadata of tihe image to which it is linked. According to a particular implementation of the method, at least one physiological data item specific to a second user and coming from a second terminal equipped with a measuring means of at least one physiological data item of the second user can be transmitted to the camera, and then converted into data representative of the second user's psychophysiological state; the second user's psychophysiological state is saved linked to the image captured by the camera user. So that the user can adapt his/her actual or experienced emotional state to the measured physiological data, the method can comprise a calibration step, wherein the user is invited, when taking a shot, to enter his/her psychophysiological state, and during which data representative of this psychophysiological state are linked to the physiological data measurements performed during the taking of the shot. The psychophysiological state is advantageously entered using a multiple choice display. Other characteristics will appear on reading the following description, with reference to the drawings of the various figures. BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 represents diagrammatically a camera according to a preferred embodiment of the invention. Figure 2 represents a diagram of the psychophysiological states according to physiological data in compliance with the invention method. Figure 3 represents a partial detailed view of the shot release button of figure 1. DETAILED DESCRIPTION OF THE INVENTION The following description is a detailed description of the main embodiments of the invention, with reference to the drawings in which the same numerical references identify t ie same elements in each of the different figures. Figure 1 represents a camera 1, equipped on one side with a keypad 8, a display screen 9, and a shot release button 3. The camera 1 has, on another side, a camera lens 10. The camera 1 is advantageously a digital camera or a digital phonecam. The camera 1 also comprises internal elements capable of intercommunicating. These internal elements are: a photosensitive component 4, of^" charged coupled device type, also called CCD; a central processing unit 6, also called CPU; a converter means 5; and a memory 7 for saving image digital data and information data related to the images. The image related data is for example information inherent to the image, of metadata type. The central processing unit 6 also comprises an analog-digital converter (not shown). Figure 1 represents diagrammatically a camera according to an advantageous embodiment of trie invention. In this embodiment, the release button 3 comprises a means 2 to measure a camera 1 user's physiological data. The physiological data is measured by a user skin contact using the measuring means 2. The means 2 is a touch sensitive measuring means that comprises at least one from among a temperature sensor, a t ygrometric sensor, an electrical conductivity sensor, or any other measuring sensor of other physiological data. Generally, it is the user's finger that is in contact with the measuring sensor 2: for example when taking a shot. The measuring sensors thus enable, at the moment of shooting, the measurement of for example the temperature or sweatiness of the user's finger when it comes into contact with, the release button 3. La another embodiment not shown, the means 2 to measure the physiological data is not included in the shot release button 3, as represented in figure 1. The means 2 to measure the physiological data is for example placed on the camera case 1, just next to the shot release button 3. Or, the means 2 is detached from the camera 1, and. linked to it by a wire link, or a wireless link, for example radio. The invention is implemented based on image capture or input, using a digital camera or phonecarn. According to the embodiment represented in figure 1, from the moment when the camera 1 user activates the shot release button 3, the corresponding image is captured, and at least one physiological data item of the user's finger who activates the release button 3 is measured simultaneously, using a touch sensitive sensor 2 placed on the top surface of the release button 3. According to figure 3, the shot release button 3 is advantageously equipped, on its top surface with any zones 2A, 2B, 2C, 2D that divide this top surface into preferably equal angular sectors. The zones 2A, 2B, 2C, 2D are touch sensitive zones intended to be touched by the user's finger, when he/she captures an image. These zones 2A, 2B, 2C, 2D thus define the locations for measuring physiological data specific to the user, when he/she captures an image. The zone 2A corresponds to the temperature measurement sector; zone 2B corresponds to the measurement sector of the sweatiness or hygrometry produced by the finger's skin; zone 2C corresponds to the measurement sector of the skin's electrical conductivity, this conductivity being capable of demonstrating for example a more or less high state of anxiety or nervousness; zone 2D corresponds for example to the pH measurement sector, i.e. the skin's acidity, and demonstrates for example a latent state of stress. The number of zones is not necessarily limited to four, as in figure 3. The number of zones can vary from one up to a number that may be more than four. That is, the quantity of physiological data to be measured is generally greater than or equal to one. One may for example also plan a sensor of heart rate meter type, to measure, at a given moment, the user's heart rate. Based on the release of a shot and the measurement of at least one physiological data item, the invention method is implemented using an algorithm that converts the physiological data into at least one data item representative of the user's psychophysiological state. The psychophysiological state is the user's psychic or emotional state. The physiological data are converted, based on the algorithm's instructions, using the converter means 5 that comprises a conversion table, into the user's psychophysiological state at the moment of image capture. The conversion table is constructed to recover psychophysiological states like for example: "highly stressed", "stressed", "calm", "happy", "sad", "irritable", etc.. The conversion table can be, for example, in the form of a programmable memory (EEPROM). The psychophysiological states are determined using the conversion table and the central processing unit 6, according to the measured values of physiological data. According to the number of physiological data items measured, the conversion table can recover a more or less detailed psychophysiological state. That is to say, for example, if a single physiological data item is measured, a first embodiment can lead to the production- of a psychophysiological state comprising a single qualification, like for example "stressed". This qualification is data representative of the user's psychophysiological state. If several physiological data items are measured, a second embodiment can lead to the production of a more detailed psychophysiological state, i.e. -having several qualifications, like for example "highly stressed-irritable"; or "stressed-sad"; etc. The psychophysiological states are saved in a memory 7 advantageously placed in the camera 1. Figure 2 represents a diagram of the psychophysiological states according to physiological data. This diagram has a c ve 15 that graphically represents the equivalences, given by the conversion table, between the physiological data values and the corresponding psychophysiological data state. The abscissa axis represents a physiological data value DP: for example a temperature value, an electrical conductivity value, a pH value, etc. The ordinate axis represents, for a given band 11, 12, 13, 14 parallel to the abscissa axis, a psychophysiological state EP. In a particular embodiment, the abscissa axis represents for example temperature values in degrees Celsius; but the abscissa axis can represent any physical value characterizing a physiological data item, for example a hygrometry value, a pH value, a heart rate, etc. For example, band 14, placed at the start of the ordinate axis, represents the psychophysiological state "highly stressed", band 13 represents the psychophysiological state "stressed", band 12 represents the psychophysiological state "calm", and band 11 represents the psychophysiological state "very calm". The function whose graphic representation is the curve 15 of the psychophysiological states is a standard function established by the algorithm of the invention method, according to preset equivalences between the physiological data values DP and the corresporxding psychophysiological states. The invention method advantageously comprises a calibration or learning step, so that the camera (1) user can calibrate the curve 15 in relation to his/her psychophysiological state. By using the keypad 8, th-e user can, before making an image capture, check whether his/her experienced psychophysiological state corresponds with the standard psychophysiological sta.te of the curve 15. A menu enables the diagram to be displayed on the screen 9. Then the user touches the sensor 2 to start a measurement of at least one physiological data item that can be displayed on the screen 9. According to an advantageous embodiment of the invention, the measured value is automatically displayed on the abscissa axis DP. The user can thus visually compare whether the psychophysiological state he/she experiences corresponds or not with the standard psychophysiological state given by the standard curve 15. If this is not the case, the user, by means of the keypad 8, can slide the curve 15 displayed on the screen 9, to obtain a- curve 16 that corresponds better with the actual correspondence between the value of the at least one displayed physiological data item specific to the user, a-nd his/her actual and experienced psychophysiological state. The user also has the option of modifying the psychophysiological states corresponding to the zones L 1, 12, 13 ,14, based on a multiple choice display of the psychophysiological states, displayed on the screen 9. This enables a conversion table linking the measurements and the user's psychophysiological states to be made up. Several conversion tables may also be envisaged, in the same camera 1, for several users of said camera. Following this adjustment, the user can activate the shot release 3; the ima.ge(s) captured at the moment or in the following moments will thus have metadata of the psychophysiological states calibrated or adjusted to the user's psychophysiological profile. Another advantageous embodiment of the invention is to be able to save the psychophysiological state of a group of people in. an image. According to figure 1, these people, apart from the camera 1 user, have terminals la that can communicate with the camera 1. These people, in the rest of the description are called "second user". The terminals communicate with the camera 1 by using wireless communication means, for example in compliance with the Bluetooth or WiFi standards. The terminals la communicating with the camera 1 are each equipped with a measuring means 2 of at least one physiological data item. The terminals la communicating with the camera 1 can be for example identical to the camera 1. The one among these terminals that can communicate with the camera 1, is also called "second terminal"; in relation to the camera 1 that is considered as the first terminal. According to this particular embodiment of the invention, at least one physiological data item specific to a second user and corning from a second terminal la equipped with a measuring means 2 is transmitted to the first terminal, i.e. to the camera 1, and then converted into data representative of a psychophysiological state of the second user. The psychophysiological state of the second user is saved linked to the image captured by the camera 1 user. The resulting image thus comprises the various psychophysiological states of all the people (the camera 1 user and at least one second user) having supplied physiological data at the moment of image capture.

Claims

CLAIMS : 1. A camera (1) equipped, on its case, with a measuring means (2) of at least one physiological data item (DP) of a user, when the user's skin- is in contact with the measuring means.

2. The camera according to claim 1, characterized in that the camera (1) is a digital camera or a digital phonecam.

3. The camera according to claim 1, characterized in that the measuring means (2) of at least one physiological data item (DP) of the user i s located in the shot release (3) of the camera (1).

4. The camera according to claim 1, characterized in that the user's physiological data (DP) is detected at the same time as the shot release.

5. The camera according to claim 1, characterized in that the measuring means (2) of the physiological data (DP) comprises at least one from among a temperature sensor, an electrical conductivity sensor, and a hygrometric sensor.

6. The camera according to claim 1, characterized in that it comprises a converter means (5), linked to the measuring means (2) of the physiological data (DP), to convert the measured physiological data into data representative of a user's psychophysiological state (EP).

7. The camera according to claim 6, characterized in that the converter (5) is linked to a conversion table linking measured values of physiological data with data representative of a psychophysiological state.

8. The camera according to claim 1, characterized in that it also comprises a memory (7) for the combined saving of images captured using the camera and data representative of the user's psychophysiological state (EP) when capturing said images.

9. A shooting method, wherein, when a shot is taken by a user equipped with a camera according to one of the claims 1 to 8, the following steps are performed: a) the measurement of at least one physiological data item of the user; b) the conversion of the at least one physiological data item into data representative of the user's psychophysiological state; c) the saving of the data representative of the user's psychophysiological state linked to an image captured when shooting.

10. The shooting method according to claim 9, characterized in that at least one physiological data item specific to a second user and coming from a second terminal (la) equipped with a measuring means (2) of at least one physiological data item of the second user is transmitted to the camera (1), and then converted into data representative of the second user's psychophysiological state; the second user's psychophysiological state is saved linked to the image captured by the camera (1) user.

11. The method according to claim 9, characterized in that the data representative of the user's psychophysiological state is included in the metadata of the image to which it is linked.

12. The method according to claim 9, characterized in that a conversion table links the physiological data to the data representative of the psychophysiological state.

13. The method according to claim 9, comprising a calibration step during which the user is invited, when taking a shot, to enter his/her psychophysiological state, and during which the data representative of this psychophysiological state are linked to the measurements of physiological data made when taking the shot, to make up a conversion table linking the measurements and a user's psychophysiological states.

14. The method according to claim 13, characterized in that the input of the psychophysiological state is performed using a multiple choice display.