CN1835711A - Image display system, image display device, image display method - Google Patents

Image display system, image display device, image display method Download PDF

Info

Publication number
CN1835711A
CN1835711A CNA2004800235849A CN200480023584A CN1835711A CN 1835711 A CN1835711 A CN 1835711A CN A2004800235849 A CNA2004800235849 A CN A2004800235849A CN 200480023584 A CN200480023584 A CN 200480023584A CN 1835711 A CN1835711 A CN 1835711A
Authority
CN
China
Prior art keywords
image
measured
physiologic information
image display
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2004800235849A
Other languages
Chinese (zh)
Other versions
CN100482149C (en
Inventor
宫岛靖
佐古曜一郎
寺内俊郎
井上真
白井克弥
高井基行
牡野坚一
井上亜纪子
飞鸟井正道
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN1835711A publication Critical patent/CN1835711A/en
Application granted granted Critical
Publication of CN100482149C publication Critical patent/CN100482149C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165Evaluating the state of mind, e.g. depression, anxiety
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/742Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/744Displaying an avatar, e.g. an animated cartoon character
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/01Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/021Measuring pressure in heart or blood vessels
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/053Measuring electrical impedance or conductance of a portion of the body
    • A61B5/0531Measuring skin impedance
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/08Detecting, measuring or recording devices for evaluating the respiratory organs
    • A61B5/0816Measuring devices for examining respiratory frequency
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/318Heart-related electrical modalities, e.g. electrocardiography [ECG]

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Physics & Mathematics (AREA)
  • Public Health (AREA)
  • Pathology (AREA)
  • Psychiatry (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Child & Adolescent Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

There is provided an image display system for displaying a state of an examinee in a visible state. The examinee carries a mobile terminal (10). The mobile terminal includes a biological sensor (11) for measuring biological information on the examinee and an environment information sensor (12) for measuring environment information surrounding the examinee. The information measured is transmitted to an image display device (20) connected by a network (100). The image display device (20) has a CPU (29) for judging the state of the examinee from the biological information and the environment information, generating an image expressing the state of the examinee, and displaying it on a display section (23).

Description

Image display system, image display device and method for displaying image
Technical field
The present invention relates to show the image display device that the image display system of measured's state is unified method for displaying image and shown the measured's who is in far-end physiologic information with visible form in display device with visible form.
The application is based on number of patent application 2003-295482 of Japan that applied on August 19th, 2003 in Japan and the Japanese patent application No. 2004-136918 of Japan that applied on April 30th, 2004, advocate priority, and the application is introduced in these applications by reference.
Background technology
People's heartbeat number rising when anxiety usually, the heartbeat number is stable when calm.The heartbeat number is the heart contraction rule, is the parameter of expression people's state.The parameter of expression people's state also exists breathing and brain wave etc. a plurality of except that the heartbeat number.These data are called physiological data, are utilized effectively as the parameter of quantificational expression people's state in medical treatment and service field.Environmental information is the information that the intensity rating scale of temperature Change and wind shows the surrounding that surrounds the people.Identical with physiologic information, in order to know the residing state of people, environmental information is utilized effectively as a kind of information.
In the past, as the example of the device that effectively utilizes physiologic information and environmental information, the sort of measurement that has the patent disclosure 2002-282227 of Japan communique to disclose enter bathtub the measured electrocardiogram and according to device that should Electrocardiographic measurement result generation image.In this device, measure electrocardiogram, measure the bathtub temperature as environmental information as physiologic information.Then, the measured of physiologic information prompting with the image that measuring operation changes, is enjoied the measurements electrocardiogram the measured.
The device of above-mentioned document illustration is used for accurately measuring electrocardiogram, limits the kind and the application target of the physiologic information of measuring.And this device is used for the measured and confirms the electrocardiogram of oneself, so the people beyond the measured is not notified measured's state.
As mentioned above, physiologic information is the emotion of expression user and the index of physical qualification, surrounding etc.When effectively utilizing physiologic information and environmental information, can notify measured's state to the people beyond the measured.Yet physiologic information is a numerical information, so need be used to understand the experience and the time of its numerical value.And to tested Fang Eryan, it is painful observing information true to nature.Also have in the part of measured's health or one jiao of method that video camera is set and takes measured's image in room.Use the method, then know measured's state at a glance, but invade measured's privacy.
Summary of the invention
The objective of the invention is to, provide a kind of can solve problem that above-mentioned prior art has, novel show the image display device of physiologic information that the image display system of measured's state is unified method for displaying image and is presented at the measured of far-end with visible form in display device with visible form.
Another object of the present invention is to, image display device, the image display system of a kind of state that can show the people faintly and the ambient condition method for displaying image of unifying is provided.
Image display system of the present invention is configured in two different places with physiologic information measuring device and image display device, and the physiologic information measuring device sends to image display device by network with the physiologic information of measuring.Image display device is according to physiologic information, and generation and display list expose the image of measured's state.
Image display device of the present invention receives the physiologic information that the physiologic information measuring device sends, and according to this physiologic information, generation and display list expose the image of measured's state.
The long-range transmission measured's of method for displaying image of the present invention physiologic information, and, produce the image of the state of showing the measured according to this physiologic information.
According to the present invention, can produce based on measured's the physiologic information and the image of environmental information, and on the image display device that is in the place different, show measured's state with the measured.The image that the present invention produces is not with real image but according to physiologic information and environmental information, produce the image of far-end measured's state, thus different with accurate medical usage, can not only show measured's state faintly, and can appreciate the image that produces, improve recreational.
According to the present invention, can show measured's state in the place different with the measured, can grasp measured's state from far-end in a deadpan way.Image display device shows that the measured is fuzzy state, thereby does not invade measured's privacy.
From hereinafter can further understanding the concrete advantage that other purpose, the present invention of the present invention obtains with reference to the embodiment of description of drawings.
Description of drawings
Fig. 1 illustrates the figure that image display system of the present invention is formed.
Fig. 2 is the block diagram that the portable terminal device that constitutes image display system of the present invention is shown.
Fig. 3 is the block diagram that the image display device that constitutes image display system of the present invention is shown.
Fig. 4 illustrates the figure that produces the process of different images from identical physiologic information and environmental information.
Fig. 5 is the figure that system's composition of another routine image display system of the present invention is shown.
Fig. 6 schematically illustrates to make the position relation be reflected in the figure of the example in the image.
Fig. 7 schematically illustrates to make the data sync relation be reflected in the figure of the example in the image.
Fig. 8 schematically illustrates the figure that the emotion relation that makes the measured is reflected in the example in the image.
Fig. 9 is the figure that the composition of multiple connection data is shown.
Figure 10 illustrates the figure that stimulates the prompting apparatus installation site.
Figure 11 is the figure that the state of observer contact touch pad is shown.
Figure 12 is the figure that a routine correspondence table is shown.
Figure 13 is the figure of the process till schematically illustrating from the observer contact screen to the regulation zone.
Figure 14 schematically illustrates from image display device to point out tactile figure to stimulating prompting apparatus.
Figure 15 is the figure that system's composition of another routine image display system of the present invention is shown.
Figure 16 is the figure that system's composition of another routine image display system of the present invention is shown.
The specific embodiment
Image display system of the present invention has the physiologic information measuring device.The physiologic information measuring device is measured personage's (measured hereinafter referred to as) physiologic information and measured's environmental information on every side, and physiologic information and the environmental information of measuring outputed to the image display device that is in far-end.Image display device produces according to physiologic information and environmental information and display list exposes the image of measured's state.In the image display system, transmit physiologic information by network, thereby can transmit the people's who is in far-end state.
Below, specify image display system of the present invention with reference to accompanying drawing.As shown in Figure 1, image display system of the present invention, the image display device 20 that comprises network-connectable and have the electronic equipment 10 of physiologic information measurement function and receive and show the measured's that this electronic equipment 10 is measured physiologic information.Electronic equipment 10 and image display device 20 interconnect by network 100.Here, as network 100, use " the Internet ".As electronic equipment 10, personal digital aid (PDA)) etc. portable telephone set, pocket personal information terminal (PDA: preferably often with the equipment of walking.In the position that can effectively obtain the physiologic information of equipment user, biosensor is set in this equipment.
Below, enumerate the example that portable telephone set 10 is used as electronic equipment and describe.
Biosensor have be built in portable telephone set 10 and separate with portable telephone set 10.In the biosensor that separates with portable telephone set, can enumerate and be arranged on chair, bed, other electronic equipment etc. with the equipment contact type sensor 11a of the contact portion of human body, directly be contained in partes corporis humani and can detect the human body contact type sensor 11b etc. of physiological data.Here, also comprise the video camera 11c that takes the measured, the microphone of collecting measured's sound in the biosensor.
Portable terminal device 10 shown in Fig. 2, has the biosensor 11 of measuring physiologic information, the environmental information pick off 12 of measurement environment information, the ROM of logging program and set information etc. (read only memory) 13, RAM (random access memory) 14 as the staging area, the computing and the portable terminal device 10 overall CPU (CPU) 15 that control that abide by the program of ROM13 record, carry out the communication interface 16 of data communication according to Internet protocol, and receiving the physiologic information acceptance division 17 of physiologic informations from the biosensor 11 of outside, these assemblies are connected by bus 18.
Biosensor 11 is measured physiologic information.Physiologic information is that the active information that blood pressure, pulse, brain wave etc. constitute the organ of human body quantitatively is shown.Biosensor 11 is arranged on the surface of portable terminal device 10 and the inside of portable terminal device 10.For example, the handle portion at portable terminal device 10 is provided with clinical thermometer, sphygmometer, diaphoresis meter etc.In the inside of portable terminal device 10 accelerometer, vibrameter etc. are set.Microphone portion branch at portable terminal device 10 is provided with respirometer again.
Biosensor 11 can also be arranged on the different position of a part, the furniture of user health, the part in room etc. and portable terminal device 10.By biosensor being installed in all places, the physiologic information that energy measurement is more various.
The biosensor 11b that is installed in the part of user health has: oxygen saturation pick off etc. in the moving acceleration transducer of blood flow meter, brain wave meter, eye movement sensor, electrocardiogram equipment, vibratory gyroscope, acceleration transducer, skin temperature transducer, body, skin conductivity rate pick off, sphygmometer, sphygomanometer, respiration pickup, pupil footpath pick off, inclination sensor, the blood.Blood flow meter is to the human body radiation infrared ray, and utilizes the oxygen concentration in the blood flow and blood in the reflection measurement brain of this infrared light.The brain wave meter is according to brain waves such as current measurement α ripple that circulates in the brain and β ripples.Eye movement sensor is contained in head, according to the frequency of oscillation component of head voltage measurement eyeball.The current measurement heartbeat number that electrocardiogram equipment sends according to cardiac muscle.Vibratory gyroscope is according to angular velocity measurement chest exercise and Respiration Rate.The skin temperature transducer take temperature.Skin conductivity rate pick off is according to the skin resistance measurement diaphoretic volume.Respiration pickup detects the change of pressure with its breathing around the abdomen chest of user.Inclination sensor is according to the inclination measurement position of health each several part.
The biosensor 11a that is arranged on furniture and the bed has: shell temperature distribution measuring apparatus, the moving meter of body, respirometer, sphygmometer etc.Being arranged on human pressure's change pattern that the biosensor 11 of sofa and bed etc. transmits from the elastomer by sofa and bed, to extract pulse, breathing, body moving.The shell temperature distribution measuring apparatus utilizes infrared ray sensor to measure the Temperature Distribution of human body.Collect measured's the image and the biosensor 11c of sound video camera and microphone are arranged.Can measure people's action, expression shape change, ocular movemeut from the image of video camera shooting.Microphone collector's sound.These biosensors send to portable terminal device 10 by infrared ray or radio with the acoustic information of measuring.
Environmental information pick off 12 is pick offs of measuring measured's environmental information on every side.Environmental information pick off 12 has luminance meter, gas sensor, thermometer, barometer, altimeter, GPS (global positioning system).Luminance meter is measured the brightness around the measured, the abnormal smells from the patient that gas sensor is measured.GPS measures longitude, the latitude of the position of measured's existence according to the electric wave from satellite.Portable terminal device 10 also can pass through network 100, obtains environmental information.The environmental information that obtains by network 100 has weather, monthly age, snowpack, rainfall, atmospheric pollution degree, wind speed etc.
The environmental information that communication interface 16 is measured the physiologic information and the environmental information pick off 12 of biosensor 11 measurements sends to image display device 20.The transmission of CPU15 control communication interface 16 is handled.CPU15 carry out to send the program of physiologic information and environmental information on the backstage, with the value of intervalometer as trigger message, to communication interface 16 output index signals.
Image display device 20 produces the image of the state of showing the measured according to the physiologic information and the environmental information that receive from portable terminal device 10.Image display device 20 can be the device that television set, portable phone, personal computer etc. have display screen and information treatment part, also can be special-purpose device.
Fig. 3 illustrates the inside of image display device 20 and forms.Image display device 20 have the input part 21 accepting user and key in, output sound audio output unit 22, display image display part 23, logging program and set information ROM24, as the RAM25 of the operating area of CPU29, read the image storage part 28 that the device driver 26 of the information of recording medium, according to the rules communication protocol carry out the communication interface 27 and the memory image of data communication, these assemblies are connected by bus 200.
CPU29 infers measured's roughly emotion and action according to physiologic information, and produces the image of the state of showing the measured.The image that produces is with measured's state abstractionization and the image that symbolises.That is, the image appearance measured's that image display device 20 produces roughly emotion and action, but truly do not describe.Among the present invention, produce the measured for fuzzy image, to be shown as feature in a deadpan way.
Illustrate that an illustration is as production method.Here, show the measured with fish.Storage is a plurality of in the image storage part 28 produces the program of image and the image of the fish of performance measured's state according to physiologic information and environmental information.The image of fish for example has, and fish eats the image of erbium, the image of fish strength swimming, the image of the fish in the sleep etc.Image storage part 28 is also stored a plurality of background images.Background image has: clear water, muddy water, mobile anxious water, the water in evening are medium.
CPU29 infers measured's state according to physiologic information and environmental information, and selects the image of the fish of this state of performance.The state estimation method is described.Actions such as measured's state has emotion such as happiness, anger, grief and joy, happy offending sensation, food, moves, sleep.
The estimation method of emotion, sensation, action has multiple.For example, can infer scaring, terrified, uneasy emotion according to skin resistance.When heartbeat number and fervescence, can infer the emotion happiness.And, be in mentally, during psychological stable status, the peripheral vessel expansion, arterial blood flows into, thereby presents the heartbeat number and pulse changes slowly, and there is trend of rising in body temperature.Mentally, during psychological high-pressure, peripheral vessel shrinks, artery blood flow reduces, thereby heartbeat and pulse are accelerated the trend that exists body temperature to reduce.When the people was nervous, hands was perspired, and difference appears in galvanic skin reflex value, heartbeat number, breath cycle interval width etc. as can be known.Known have: the temperature difference of the finger tip and the centre of the palm or nose and forehead is big under the offending situation.Delivered the method for estimating happiness, anger, grief and joy from brain wave.By together with these physical signs, the myoelectricity that comprehensive utilization expression together causes changes, the gesture recognition of Expression Recognition, acceleration transducer and the inclination sensor of image, voice recognition etc., can estimate the emotion of indignation and grief.
So far, the estimation method of a routine emotion, sensation, action has been described, but has inferred precision, certainly, be more preferably and use a plurality of pick offs, carried out these suppositions according to a plurality of physiologic informations in order further to improve.
Then, the supposition to action describes.People's action can be inferred according to the image that for example video camera is taken.Video camera is arranged on measured's head and a jiao of room.CPU15 can be according to the image of video camera shooting, object that exists around the supposition measured and measured's action.Can also estimate measured's action from measured's position.For example, when company, work, in evil case when hospital, the probability height that when gymnasium, moves, have meal at the restaurant the time.Only the positional information by the measured is difficult to compulsory exercise, thereby physiologic information and the environmental information comprehensive information of CPU15 with the measured, infers measured's action.For example, the measured of fever is when hospital, and it is sick to be speculated as the measured; When the measured's of gymnasium body temperature raises gradually, be speculated as the measured and move.Also can infer measured's action from measured's sound on every side.At this moment, can what have around inferring, or after the audio textization with the people, infer measured's action according to the tonequality of the sound of collecting, interval etc.
As described above, CPU29 infers measured's emotion, sensation, action.Then, CPU29 produces the image of the state that satisfies the measured.The production method of image has at ROM24 deposits the table that the state that makes the measured and image have corresponding relation, and selects the method for the image that image storage part 28 deposits, emotion, sensation, the action of input are carried out the method etc. of the generation object of image output according to this table.Use any method, the image of generation all makes the people remember measured's state.For example, when the measured has a dinner at the restaurant, produce the image that fish eats erbium; When feeling out of one's plate, produce the background image of muddy water and the image of dull fish in water.When the measured is active and healthy, produce the image of clear water background image and fish strength swimming.Background image in the water that the fine day generation becomes clear is at the image of the high day fish that generation is indulged in a little of temperature.
The fine actions such as muddy degree of the quantity of the activity of CPU29 control fish, the activity of water, underwater bubble and size, water.This action control also can contain and reason information and the irrelevant factor of environmental information.CPU29 also irrespectively produces image with physiologic information and environmental information sometimes automatically.When the measured refuses to measure physiologic information, not during the energy measurement physiologic information, in the time of can not receiving physiologic information and environmental information because of transmission line is not good enough, carries out image produces automatically.
CPU29 shows image on display part 23.Display part 23 display lists expose the image of measured's state, but this is not real image, but show the image of measured's state faintly.This image is because abstract, even normal the demonstration do not goed deep into measured's privacy yet, long-time observation is not painful yet.During with this image of performance such as biology, landscape, can be as the photograph of firm bat, drawing, be arranged on the wall in living room, on the furniture.When portable terminal device 10 display images, can often observe measured's state.
The image that display part 23 shows is not limited to fish, can be other biology such as Canis familiaris L., cat, computer graphical etc., also can be simultaneously by the sound of audio output unit 22 output samplings, synthetic sound etc.Can select display image.Depositing various images and sound in the image storage part 28.Image display device 20 can make display image change displaying contents according to the selection of user.Fig. 4 illustrates picture 23a that shows fish and the example that shows the picture 23b of cat.The displaying contents difference of these images, but produce them according to identical physiologic information and environmental information.Display image can be a true picture as photograph; Can as animation, be the image of distortion also.So long as be convenient to the image of the measured's of association state, making the key diagram picture can.
Display image can be recorded in image storage part 23 in advance, also can obtain from the outside by network 100 and recording medium.When obtaining the display image that image storage part 28 do not store from the outside, the image change that can show is various, the business that can carry out selling images.
Like this, 1 pair of user that is in far-end of image display system is notified measured's state.The image that measured's state is shown is to form fuzzy image, can notify measured's roughly variation in the mode that the side of watching and viewed side can not feel unpleasant.This image display system 1 can be used to monitor the child who stays in old man at a distance and go away.This image display system 1 can show people's change of state with the picture of non-true picture.
This image display system is with image appearance measured's situation, and notice is at the user of far-end, but also can make this image become the image of viewing and admiring usefulness, effectively uses with entertainment way.
Then, the example that the image that makes a plurality of measured shows is described on 1 image display device 20.As shown in Figure 5, in this example, 10 pairs of servers of a plurality of portable terminal devices, 30 accumulation measured's physiologic information and environmental information.Behind the physiologic information and environmental information multiple connection of server 30 with portable terminal device 10 transmission, be sent to image display device 20.When 1 image display device, 20 accumulation measured's information, do not need server 30.
Image display device 20 is reflected on the image measured's relation.Measured's relation has position relation, data sync relation, measured's environmental concerns, measured's emotion relation etc.GPS measuring position information.The position relation on each measured's the map is described in Fig. 6 left side, and the image of position relation is described to reflect in the right side.Image display device 20 rule according to the rules makes image change reflection position relation.This rule leaves among the ROM24 of image display device 20 with the form of program.CPU29 reads in this program, makes image change.This program makes measured and certain object (for example, being Rhopilema esculenta here) have corresponding relation.So, make the measured's who is near position object show closely.This program is according to the size apart from the decision objects thing of measured and image display device 20.In this program, the object that will be near the measured of image display device 20 shows greatly, and the object that will be in the measured of position far away shows for a short time.
In the example of Fig. 6, the Rhopilema esculenta corresponding with measured A, B is configured near position, the Rhopilema esculenta corresponding with measured C is configured in position far away.Because measured A, B are in the position near image display device 20, show the Rhopilema esculenta corresponding with measured A, B greatly, corresponding with measured C shows for a short time.
20 couples of measured's of image display device positional information is used simple rule, and the relation of each measured's relation, measured and image display device 20 is reflected in the image.It is separate state that the measured moves voluntarily, but by using rule, produces relation property.
Image display device 20 is reflection data synchronization relation in image produces.Here, be the cycle data that take place or change in accordance with regulations such as breathing, heartbeat, walking beat, action by the data of reference.Image display device 20 produces the image of expression synchronous regime when this data are synchronous accidentally.It is synchronous that the left side of Fig. 7 illustrates the heartbeat number of measured D, E, and the right side of Fig. 7 illustrates the Rhopilema esculenta corresponding with measured D, E and coordinates to wave.Here, input heartbeat number, and use the rule that produces the image of waving.
Environmental concerns is meant the difference of environmental information etc.Brightness, temperature, air pressure, highly, environmental information such as weather can measure with environmental information pick off 12.The temperature difference around the measured is big more, and the action of the Rhopilema esculenta that image display device 20 shows is fierce more, perhaps during the local bad weather at measured place, shows the image of billowing big great waves, or shows muddy water.
Image display device 20 is inferred measured's emotion and emotion according to measured's physiologic information and environmental information, and measured's emotion relation is reflected on the image.The estimation method of emotion is as indicated above.Fig. 8 makes happy and offending emotion be reflected in ideograph on the image.Image display device 20 is happy or unhappy according to measured's emotion, divides into groups.Make with the measured's who belongs to happy group corresponding Rhopilema esculenta and coordinate to wave, or make it close.Otherwise, make the Rhopilema esculenta corresponding hostile, or leave mutually, or accuse each other with the measured who belongs to offending group.
More than like that, when image display device 20 receives a plurality of measured's data, produce image according to these measured's relation.Here, the data of input are measured's physiological data and environmental datas.Image display device 20 is deposited according to the data of input and is obtained measured's relation, and makes this relation be reflected in program on the image.Do not limit the data, relation of input specially, to the method for the reflection of image etc.The present invention's data of giving chapter and verse are obtained relation and are made this relation be reflected in method on the image.
The method of the data that transmit a plurality of measured then, is described.In addition multiple connection of the data that server 30 transmits portable terminal device 10.As shown in Figure 9, the information of multiple connection is made of a plurality of data sets 40.Each data set 40 comprises communication stem 41 and data portion 42.The communication control information of address of sending the place and the source of transmission and so on is deposited in communication in the stem 41.Data portion 42 is made of data header 43 and deposit data portion 44.The ingredient of data header 43 comprise the measured ID45, get time mark 46, the information classification sign indicating number 47 of representing information category that time synchronized uses and the information type sign indicating number 48 of representing information type.Information classification sign indicating number 47 is meant that the data that deposit data portion 44 deposits are the physiological data or the sign indicating number of environmental data.When measuring new category of information in the future, extendible this sign indicating number.Information type sign indicating number 48 is that the information that expression deposit data portion 44 deposits is the sign indicating number of which kind of information.For example, represent heartbeat number, myoelectricity, breathing, represent temperature, humidity, weather with sign indicating number K11, K12, K13 with sign indicating number H23, H24, H25.
Import the actual value of the project of representing with information type sign indicating number 48 in the deposit data portion 44.For example, information type sign indicating number 48 is " pulses ", then input numerical value such as " 72 "; Information type sign indicating number 48 is " weather ", then the numerical value or the character string of input expression " fine day ".This field length is variable, and represents the numerical value of the length of deposit data portion itself in the input of the top of deposit data portion 44.
Image display device 20 is according to measured's ID, with the multiple connection data separately.Then, according to time mark, information is located by the time sequence.Image display device 20 produces the image of expression measured state separately, and the image of generation is shown on display part.In the example shown in Figure 5, image producing method makes 3 measured carry portable terminal device 10a, 10b, 10c respectively, and 3 portable terminal device 10a, 10b, 10c send to server 30 with physiologic information and environmental information.Server 30 in addition after the multiple connection, sends to image display device 20 with the physiologic information received and environmental information.Image display device 20 produces the image of 3 measured's of expression state, and the pictorial display that makes generation is on 1 display part 23.
In the above-mentioned example, configuration server 30 is as the relay of transfer of data, but also can constitute not configuration server 30, makes portable terminal device 10 and image display device 20 direct swap datas.The composition of the data set that server 30 produces and data identifier coding etc. are not limited only to above-mentioned situation.
In the above-mentioned example,, but in fact also can show 1 object and biology according to each measured's physiologic information and environmental information with each measured of the biological performance of simulation.For example, technique of expression also can be: different measured is distributed in the action of the electromotor of 1 airplane, empennage, main wing respectively, and show the flight of 1 airplane.Perhaps, can consider that also the kinestate such as color, size, spring method with ball shows.
Then, key diagram is as observer and the interactional example of measured.In this example, observer is upset measured's dermal sensation (especially sense of touch).Measured's physiologic information changes because of stimulation, and this variation also changes the image that shows the measured.Among the embodiment 3, form the feedback control loop between measured and the observer.
The measured is installed the stimulation prompting apparatus 90 that skin is upset.Figure 10 illustrates the installation site that stimulates prompting apparatus 90.To stimulate prompting apparatus 90 to be contained in the position more than 1 of measured's health.Stimulate prompting apparatus 90 that the haptic signal of far-end input is transformed into physical stimulation.From portable terminal device 10 input haptic signals.Connect portable terminal device 10 and stimulate prompting apparatus 90 with wired or wireless mode.In order to point out tactual stimulation, stimulate prompting apparatus 90 to utilize at least a in the vibration of actuator and motor, the electricity irritation that low-frequency therapy apparatus uses, the measured is upset.Do not stimulate prompting apparatus 90 even be not provided with specially, can utilize the vibrating function prompting of portable terminal device to stimulate yet.
Display part 23 at image display device 20 is provided with touch pad 91.Touch pad 91 is according to the change detection input of resistance value and electrostatic capacitance, available PVDF piezoelectric elements such as (Kynoar).When using the touch pad of resistance value and piezoelectric element, can obtain sense of touch intensity.
Below shown in example in, make measured and certain object (being Rhopilema esculenta) have corresponding relation here.Show the quantity Rhopilema esculenta identical at display part 23 with the measured.On one deck, describe each Rhopilema esculenta respectively.By ply is shown, show a plurality of Rhopilema esculentas at 1 display part.As shown in figure 11, during user contact touch pad 91, image display device 20 obtains the coordinate P of contact portion.Image display device 20 compares the coordinate of object with some P, differentiate object and whether comprise a P.Carry out this differentiation successively at the darkest layer.Relatively arrive top layer, image display device 20 will be differentiated at last for the object that comprises a P and be judged as the object that is touched always.
When the object that is touched rotated, image display device 20 carried out the direction standardization of object.When image display device 20 is judged as object, judge what position of user contact object thing.In order to carry out this judgement, with the object subregion, the coordinate of posting field and the title that is subjected to the corresponding position of tactual stimulation in the correspondence table 92 shown in Figure 12.Process till Figure 13 schematically illustrates from observer touch picture to the regulation zone.Zone a is corresponding to the head of Rhopilema esculenta, and regional b is corresponding to the chest of Rhopilema esculenta, and regional c is corresponding to the abdominal part of Rhopilema esculenta, and regional d is corresponding to the last shank of Rhopilema esculenta, and regional e is corresponding to the following shank of Rhopilema esculenta.In this example, the some P of observer contact is regional d, promptly is included in the shank.
This correspondence table 92 preferably manages together with the view data that shows on the image display device 20 of equipment touch pad 91.From the network download view data and when forming the image of cat for example, also download correspondence table simultaneously.Be subjected to the position of tactual stimulation, its each position is awarded unique sign indicating number, and display image is Rhopilema esculenta or cat, and the sign indicating number of corresponding position is all constant.In this example, being decided to be head is 0 * 01, and chest is 0 * 02 etc.The sign indicating number of corresponding position is 2 n power, can be simultaneously corresponding with a plurality of tactual stimulation devices.Only 5 kinds in this example of corresponding positions, but as long as sign indicating number does not repeat, also can increase.But this numbering is unique, thereby not multiple with the code weight of having used.
When image display device 20 is obtained corresponding position, will to the corresponding measured of object of contact, the sign indicating number and the haptic signal of stimulus intensity, stimulus type etc. of the corresponding position of conclusion send to the portable terminal device 10 that is in far-end.When portable terminal device received haptic signal, driving stimulated prompting apparatus 90, points out the physics skin irritation to the measured.Figure 14 schematically illustrates from 20 pairs of sense of touch transmission that stimulate prompting apparatus 90 of image display device.
Stimulus type is the sign indicating number of stimulus types such as expression actuator vibration mode and electricity irritation.Can be according to the frequency of vibration of this parameter change actuator, or vibration beat, electrical stimulation pattern are changed, non-single stimulus modelity can be provided.
Image display system 3 can constitute distributes to unspecific a plurality of image display device 20 with specific measured's physiologic information and environmental information.At this moment, as shown in figure 15, image display system 3 comprise the physiologic information of measuring the measured and environmental information physiologic information measuring device 50, physiologic information and environmental information are sent to the server 60 of a plurality of image display devices 20 and the image display device 20 that produces image according to physiologic information and environmental information.
The composition of physiologic information measuring device 50 is identical in fact with above-mentioned portable unit 10.In the image display system 3, because individual privacy information is distributed to many people, this measuring device preferably is not that portable terminal device often carries like that, and is arranged on the high to a certain degree space of public character.Certainly, allow, also can distribute personal physiological information if obtain the individual.
This system is used for distributing nonspecific majority to want physiologic information (for example physiologic information of the player in the musician of concert and the match) and the environmental information that obtains.By distributing musician and player's physiologic information and environmental information, even can not watch in office under the situation of actual motion contest, also can grasp the roughly flow process of match again, the player's who can't see on the energy observation television image emotion variation etc.
Then, illustrate not to be to reproduce in real time physiologic information and the environmental information of measuring, but according to the physiologic information of past measurement and the image display device 20 of environmental information generation image.As shown in figure 16, the physiologic information measured and environmental information are recorded in the physiologic information service device 70 or recording mediums 80 such as CD-ROM, semiconductor storage module on the network 100.Image display device 20 produces image according to these physiologic informations and environmental information.Thus, the identical image of user appreciation all can several times.Can also only measure physiologic information and environmental information in advance, when the time, the flaw was surplus, show.For example, can write down late person's physiologic information before death earlier, and utilize symbolic image to reproduce its situation before death in due course.
It will be understood by those skilled in the art that: the invention is not restricted to the foregoing description, can carry out various changes, displacement or the operation suitable, and do not break away from the scope and the purport thereof of appended claims with it with reference to description of drawings.

Claims (24)

1, a kind of image display system is characterized in that, comprises
Have the physiologic information measuring unit of the physiologic information of measuring the measured and send described physiologic information transmitting element the physiologic information measuring device and
Image display device with receiving element that receives described physiologic information and the image generation unit that produces image according to described physiologic information and the display unit that shows described image,
Described physiologic information measuring device is in different places with image display device, is connected by network.
2, image display system as claimed in claim 1 is characterized in that,
Described image generation unit produces the image of the state of showing described measured.
3, image display system as claimed in claim 1 is characterized in that,
Described physiologic information measuring device has the environmental information measuring unit of the described measured's of quantitative measurement surrounding,
Described image generation unit produces and shows measured's the state and the image of surrounding according to described physiologic information and environmental information.
4, image display system as claimed in claim 1 is characterized in that,
Receive a plurality of measured's physiologic information, produce the simulation biometric image of the state of showing each measured, and described display device shows that simultaneously a plurality of simulations are biological.
5, image display system as claimed in claim 1 is characterized in that,
Described image generation unit makes the dependency of a plurality of measured's physiologic information obtain reflection in image change.
6, image display system as claimed in claim 3 is characterized in that,
Described image generation unit makes the dependency of a plurality of measured's environmental information obtain reflection in image change.
7, image display system as claimed in claim 1 is characterized in that,
Described image display device has
Detect to the contact detection unit of the contact of described display unit and
To the activation signal transmitting element of described physiologic information measuring device transmission based on the activation signal of the unitary output of described contact detection,
Described physiologic information measuring device has the skin irritation unit that the dermal sensation that makes the measured when receiving described activation signal is upset.
8, image display system as claimed in claim 7 is characterized in that,
At least a in the vibration of described skin irritation unit by using, electricity irritation, the friction provides skin irritation.
9, image display system as claimed in claim 1 is characterized in that,
Described image display device has the sensing element of the information that writes down in the recording medium of reading,
Physiologic information and environmental information that described image generation unit is read according to described sensing element produce the image of the state show the measured and measured's surrounding.
10, image display system as claimed in claim 1 is characterized in that,
Described image display device has according to described physiologic information, produces the sound generating unit and the voice output unit of exporting described sound of the sound of the state of showing described measured.
11, a kind of image display device is connected by the physiologic information measuring device of network with the physiologic information of measuring the measured, it is characterized in that having
Receive the physiologic information that described physiologic information measuring device sends the physiologic information receiving element,
According to described physiologic information produce image image generation unit and
The display unit that shows described image.
12, image display device as claimed in claim 11 is characterized in that,
Described physiologic information measuring device has the environmental information measuring unit of the described measured's of quantitative measurement surrounding,
Described image generation unit produces and shows measured's the state and the image of surrounding according to described physiologic information and environmental information.
13, image display device as claimed in claim 11 is characterized in that,
The sensing element that also has the information that writes down in the recording medium of reading,
Described image generation unit produces the image of the surrounding of showing measured's state and measured according to the physiologic information and the environmental information that write down in advance in the recording medium.
14, image display device as claimed in claim 11 is characterized in that,
When a plurality of physiologic information measuring devices received different a plurality of measured's physiologic information, described image generation unit produced the image of the state of showing each measured, and the image of described each measured's state is exposed in described display device display list simultaneously.
15, image display device as claimed in claim 11 is characterized in that,
Described image generation unit makes a plurality of measured's physiologic information dependency obtain reflection in image change.
16, image display device as claimed in claim 12 is characterized in that,
Described image generation unit makes a plurality of measured's physiologic information dependency obtain reflection in image change.
17, image display device as claimed in claim 11 is characterized in that,
Described image generation unit has
Detect to the contact detection unit of the contact of described display unit and
To the activation signal transmitting element of described physiologic information measuring device transmission based on the activation signal of the unitary output of described contact detection.
18, image display device as claimed in claim 11 is characterized in that,
Sensing element with the information that writes down in the recording medium of reading,
Described image generation unit is according to the physiologic information and the environmental information of record in advance in the described recording medium, produces the image of the state show the measured and measured's surrounding.
19, a kind of method for displaying image is characterized in that, has following steps:
The physiologic information measuring process of measurement measured's physiologic information,
The forwarding step of the described physiologic information of long-range transmission,
Receive the physiologic information that sends in the described forwarding step receiving step,
The image that produces image according to the physiologic information that receives in the described receiving step produce step and
Show that described image produces the step display of the image that produces in the step.
20, method for displaying image as claimed in claim 19 is characterized in that,
The environmental information measuring process that also has the described measured's of quantitative measurement surrounding,
Described image produces in the step, according to described physiologic information and environmental information, produces the image of the state of showing described measured.
21, method for displaying image as claimed in claim 19 is characterized in that,
When described receiving step received a plurality of measured's physiologic information, described image produced the image that step produces the state of showing each measured, and described step display while display list exposes the image of a plurality of measured's state.
22, method for displaying image as claimed in claim 20 is characterized in that,
Make described a plurality of measured's physiologic information dependency in image change, obtain reflection.
23, method for displaying image as claimed in claim 21 is characterized in that,
Make described a plurality of measured's physiologic information dependency in image change, obtain reflection.
24, method for displaying image as claimed in claim 19 is characterized in that, has following steps:
Detect to the contact detection step of the contact of described image and
The skin irritation step that measured's dermal sensation is upset according to detected activation signal in the described contact detection step.
CNB2004800235849A 2003-08-19 2004-08-13 Image display system, image display device, image display method Expired - Fee Related CN100482149C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP295482/2003 2003-08-19
JP2003295482 2003-08-19
JP136918/2004 2004-04-30

Publications (2)

Publication Number Publication Date
CN1835711A true CN1835711A (en) 2006-09-20
CN100482149C CN100482149C (en) 2009-04-29

Family

ID=37003239

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2004800235849A Expired - Fee Related CN100482149C (en) 2003-08-19 2004-08-13 Image display system, image display device, image display method

Country Status (1)

Country Link
CN (1) CN100482149C (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101179712B (en) * 2006-11-07 2010-11-10 索尼株式会社 Imaging and display device, imaging method and display method
US7876374B2 (en) 2006-12-07 2011-01-25 Sony Corporation Image display system, display apparatus, and display method
CN102246120A (en) * 2008-12-12 2011-11-16 英默森公司 Method and apparatus for providing a haptic monitoring system using multiple sensors
US8687925B2 (en) 2007-04-10 2014-04-01 Sony Corporation Image storage processing apparatus, image search apparatus, image storage processing method, image search method and program
CN103917993A (en) * 2011-11-09 2014-07-09 皇家飞利浦有限公司 Using biosensors for sharing emotions via a data network service
US8797331B2 (en) 2007-08-06 2014-08-05 Sony Corporation Information processing apparatus, system, and method thereof
US8872941B2 (en) 2006-11-07 2014-10-28 Sony Corporation Imaging apparatus and imaging method
CN107320069A (en) * 2017-06-19 2017-11-07 泰康保险集团股份有限公司 Intelligence sees maintaining method, device, system and server
CN111249595A (en) * 2020-01-20 2020-06-09 南京大学 System and method for measuring human body indexes of atmospheric pollution
CN111603147A (en) * 2020-05-21 2020-09-01 王琼 Patient nursing monitoring system based on somatosensory device and working method thereof

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5736982A (en) * 1994-08-03 1998-04-07 Nippon Telegraph And Telephone Corporation Virtual space apparatus with avatars and speech
JP3824848B2 (en) * 2000-07-24 2006-09-20 シャープ株式会社 Communication apparatus and communication method
JP3672838B2 (en) * 2001-04-18 2005-07-20 昇 赤坂 Emergency response system
CN1420466A (en) * 2001-11-20 2003-05-28 罗一峰 Video music elextroencephalic biologic feedback method

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8872941B2 (en) 2006-11-07 2014-10-28 Sony Corporation Imaging apparatus and imaging method
CN101179712B (en) * 2006-11-07 2010-11-10 索尼株式会社 Imaging and display device, imaging method and display method
US7876374B2 (en) 2006-12-07 2011-01-25 Sony Corporation Image display system, display apparatus, and display method
US8009219B2 (en) 2006-12-07 2011-08-30 Sony Corporation Image display system, display apparatus, and display method
US8687925B2 (en) 2007-04-10 2014-04-01 Sony Corporation Image storage processing apparatus, image search apparatus, image storage processing method, image search method and program
US9568998B2 (en) 2007-08-06 2017-02-14 Sony Corporation Information processing apparatus, system, and method for displaying bio-information or kinetic information
US8797331B2 (en) 2007-08-06 2014-08-05 Sony Corporation Information processing apparatus, system, and method thereof
US9972116B2 (en) 2007-08-06 2018-05-15 Sony Corporation Information processing apparatus, system, and method for displaying bio-information or kinetic information
US10262449B2 (en) 2007-08-06 2019-04-16 Sony Corporation Information processing apparatus, system, and method for displaying bio-information or kinetic information
US10529114B2 (en) 2007-08-06 2020-01-07 Sony Corporation Information processing apparatus, system, and method for displaying bio-information or kinetic information
US10937221B2 (en) 2007-08-06 2021-03-02 Sony Corporation Information processing apparatus, system, and method for displaying bio-information or kinetic information
CN102246120A (en) * 2008-12-12 2011-11-16 英默森公司 Method and apparatus for providing a haptic monitoring system using multiple sensors
CN103917993A (en) * 2011-11-09 2014-07-09 皇家飞利浦有限公司 Using biosensors for sharing emotions via a data network service
CN107320069A (en) * 2017-06-19 2017-11-07 泰康保险集团股份有限公司 Intelligence sees maintaining method, device, system and server
CN111249595A (en) * 2020-01-20 2020-06-09 南京大学 System and method for measuring human body indexes of atmospheric pollution
CN111603147A (en) * 2020-05-21 2020-09-01 王琼 Patient nursing monitoring system based on somatosensory device and working method thereof

Also Published As

Publication number Publication date
CN100482149C (en) 2009-04-29

Similar Documents

Publication Publication Date Title
KR101072561B1 (en) Image display system image display device image display method
CN101198277B (en) Systems for physiological and psycho-physiological monitoring
US10735831B2 (en) System and method communicating biofeedback to a user through a wearable device
JP7149492B2 (en) EMG-assisted communication device with context-sensitive user interface
JP5139319B2 (en) Stressor sensor and stress management system
CN101524267A (en) Comprehensive evaluating system and proposal for checking personal physical and psychological health
KR20150060663A (en) Personal wellness management platform
WO2015190042A1 (en) Activity evaluation device, evaluation processing device, and program
EP1551281A4 (en) Method and apparatus for auto journaling of continuous or discrete body states utilizing physiological and/or contextual parameters
WO2002001478A1 (en) Method and device for wireless transmission and processing of psychophysiological data
CN100482149C (en) Image display system, image display device, image display method
US11699524B2 (en) System for continuous detection and monitoring of symptoms of Parkinson's disease
CN110868930B (en) Information processing system
EP1377205B1 (en) Personalized information distribution system
EP3549630A1 (en) Output control device, output control method, and program
CN115910333A (en) Vitality increase and decrease evaluation method and system based on wearable equipment
Rawashdeh et al. A multimedia cloud-based framework for constant monitoring on obese patients
PT1414340E (en) Apparatus for monitoring health, wellness and fitness
Franzke et al. TOFI: Designing Intraoral Computer Interfaces for Gamified Myofunctional Therapy
US20220143460A1 (en) Method and system for dynamically transforming user health and exercise-related data into visual, audio, textual, and physical data representations
Gatto et al. A virtual reality application for stress reduction: design and first implementation of ermes project
WOLLNIK PLAY ME–Sonification of Sexual Arousal in Live Performances
Munsch et al. Accelerometers as a Methodological Tool in Group Processes Research
JP2016163292A (en) Information processor, communication support system, information processing method, and program
Chickella et al. 1.2. PERVASIVE AND PERSUASIVE TECHNOLOGIES IN MOTIVATING PEOPLE TO PHYSICAL ACTIVITIES OUTDOOR IN FITNESS PARKS

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CI02 Correction of invention patent application

Correction item: Priority

Correct: 2004.04.30 JP 136918/2004

False: Lack of priority second

Number: 38

Page: The title page

Volume: 22

COR Change of bibliographic data

Free format text: CORRECT: PRIORITY; FROM: MISSING THE SECOND ARTICLE OF PRIORITY TO: 2004.4.30 JP 136918/2004

REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1095506

Country of ref document: HK

C14 Grant of patent or utility model
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1095506

Country of ref document: HK

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090429

Termination date: 20170813

CF01 Termination of patent right due to non-payment of annual fee