WO2011059246A2 - Method and apparatus for providing image in camera or remote-controller for camera - Google Patents

Method and apparatus for providing image in camera or remote-controller for camera Download PDF

Info

Publication number
WO2011059246A2
WO2011059246A2 PCT/KR2010/007961 KR2010007961W WO2011059246A2 WO 2011059246 A2 WO2011059246 A2 WO 2011059246A2 KR 2010007961 W KR2010007961 W KR 2010007961W WO 2011059246 A2 WO2011059246 A2 WO 2011059246A2
Authority
WO
WIPO (PCT)
Prior art keywords
camera
image
time
image capture
remote controller
Prior art date
Application number
PCT/KR2010/007961
Other languages
French (fr)
Other versions
WO2011059246A3 (en
Inventor
Sang-Ho Shin
Seung-Dong Yu
Woo-Yong Chang
Se-Jun Park
Min-Jeong Moon
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Publication of WO2011059246A2 publication Critical patent/WO2011059246A2/en
Publication of WO2011059246A3 publication Critical patent/WO2011059246A3/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/02—Bodies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4786—Supplemental services, e.g. displaying phone caller identification, shopping application e-mailing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet

Definitions

  • the present invention generally relates to remotely controlling a camera, and more particularly to a method and an apparatus for providing an image in a camera or a remote controller of a camera.
  • a digital camera is a device for converting a still image or a moving image to digital signals and storing the digital signals in a storage medium, such as a memory card.
  • An image of an object captured via a lens is converted to electric signals by a Charge-Coupled Device (CCD) or a Complementary Metal-Oxide Semiconductor (CMOS).
  • CCD Charge-Coupled Device
  • CMOS Complementary Metal-Oxide Semiconductor
  • the electric signals are converted to digital signals by an Analog-to-Digital (A/D) converter, and the digital signals are stored in a memory after correction and compression.
  • the stored digital signals are transmitted to a Personal Computer (PC) or a recording medium via any of various interfaces. Accordingly, a digital image is formed.
  • PC Personal Computer
  • An object is photographed by using a digital camera by directing a lens of the digital camera toward the object, focusing the digital camera to capture an optimal image, and triggering a shutter.
  • the series of operations is applicable when a person operating a digital camera and a person to be photographed are different people.
  • a timer function of a digital camera is generally used.
  • the present invention provides a method and an apparatus for providing an image in a camera or a remote controller of a camera to acquire a captured image with no time delay.
  • FIGS. 1A through 1E are diagrams showing examples of methods of remotely controlling a camera, according to an embodiment of the present invention.
  • FIG. 2 is a diagram showing a method of remotely controlling a camera, according to an embodiment of the present invention.
  • FIG. 3 is a diagram showing an example of screen images displayed on the camera and the remote controller.
  • FIGS. 4A through 4D are diagrams showing examples of methods of remotely controlling a camera, according to an embodiment of the present invention.
  • FIG. 5 is a diagram showing a method of remotely controlling a camera, according to another embodiment of the present invention.
  • FIG. 6 is a diagram showing a method of remotely controlling a camera, according to another embodiment of the present invention.
  • FIG. 7 is a block diagram of a camera 720 and a remote controller 710 of the camera, according to an embodiment of the present invention.
  • a method of providing an image includes transmitting an image capture start signal to a camera; transmitting an image capture end signal to the camera; and receiving an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
  • a method of providing an image includes receiving an image capture start signal from a remote controller of the camera; successively capturing images after the image capture start signal is received; receiving an image capture end signal from the remote controller; and selecting an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
  • a method of providing an image includes transmitting first image capture signal to a camera; transmitting second image capture signal to the camera; and receiving a JPEG image captured at a time which is a predetermined period of time prior to a time at which the successive image capture end signal is received.
  • a method of transmitting an image includes receiving first image capture signal from a remote controller of a camera; encoding an image displayed on the camera by using a motion JPEG encoding method and transmitting the encoded image to the remote controller; receiving second image capture signal from the remote controller; and selecting a JPEG image captured at a time which is a predetermined period of time prior to a time at which the second image capture signal is received.
  • a method of providing an image includes transmitting a motion picture capture start signal to a camera; receiving a real time stream of a motion picture captured by the camera; transmitting a still image capture signal to the camera; and receiving an image file generated by converting a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, extracted from the captured motion picture.
  • a method of transmitting an image includes receiving a motion picture capture start signal from a remote controller; capturing a motion picture; streaming the captured motion picture to the remote controller in real time; receiving a still image capture signal from the remote controller; and extracting a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, from the captured motion picture and converting the frame to an image file.
  • a remote controller of a camera includes a transmitting unit, which transmits an image capture start signal to a camera, and then transmits an image capture end signal to the camera; and a receiving unit, which receives an image captured at a time a predetermined period of time prior to a time at which the image capture end signal is received.
  • a camera includes a receiving unit, which receives an image capture start signal and an image capture end signal from a remote controller of the camera; an image capturing unit, which successively captures images after the image capture start signal is received until the image capture end signal is received; and a control unit, which selects an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
  • a remote controller of a camera includes a transmitting unit, which transmits a first image capture signal to the camera and transmits a second image capture signal to the camera; receiving a JPEG image captured at a time which is a predetermined period of time prior to a time at which the second image capture signal is received.
  • a camera includes a receiving unit, which receives a first image capture signal and a second image capture signal from a remote controller of a camera; and a control unit, which encodes an image displayed on the camera by using a motion JPEG encoding method and transmitting the encoded image to the remote controller and, when a second image capture signal is received from the remote controller, selects a JPEG image captured at a time which is a predetermined period of time prior to a time at which the second image capture signal is received.
  • a remote controller of a camera includes a transmitting unit, which transmits a motion picture capture start signal to a camera; and a receiving unit, which receives a real time stream of a motion picture captured by the camera and receives an image file generated by converting a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, extracted from the captured motion picture.
  • a camera includes a receiving unit, which receives a motion picture capture start signal and a still image capture signal from a remote controller of the camera; an image capturing unit, which captures a motion picture when the motion picture capture start signal is received from the remote controller; a control unit, which, when the still image capture signal is received, extracts a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, from the captured motion picture and converts the frame to an image file.
  • FIGS. 1a a through 1e are diagrams showing methods of remotely controlling a camera, according to an embodiment of the present invention.
  • a camera 110 and a mobile device 120 which is a remote controller of the camera 110, are connected to each other via a predetermined wired or wireless communication network, such as Wi-Fi.
  • a predetermined wired or wireless communication network such as Wi-Fi.
  • an image 111 which is formed of electric signals converted from a light input via a lens of the camera 110, is displayed on a display unit of the camera 110.
  • the mobile device 120 executes an application for remotely controlling the camera 110, a screen image displayed on the camera 110 is streamed to and is displayed on a display unit of the mobile device 120 in real time.
  • screen images displayed on each of the display units may not be identical to each other.
  • a screen image 121 displayed on the display unit of the mobile device 120 is smaller than a screen image 111 displayed on the display unit of the camera 110.
  • the screen image 121 displayed on the display unit of the mobile device 120 is partially cut as compared to the screen image 111 displayed on the display unit of the camera 110.
  • the layout of the screen image 122 may be corrected by a zoom function with respect to a screen image 122 displayed on the display unit of the mobile device 120.
  • the size of the screen image 122 may be adjusted by using the zoom function.
  • the screen image 122 displayed on the display unit of the mobile device 120 becomes identical to the screen image 111 displayed on the display unit of the camera 110 by using the zoom function.
  • a user may remote-photograph an object by using a predetermined button of the mobile device 120.
  • An image captured by the camera 110 is received by the mobile device 120, and the image is displayed.
  • a user of the mobile device 120 may either store or delete the received image.
  • FIG. 1e when a received image is displayed on the mobile device 120, if a user pushes a predetermined button for sharing the image, an address book stored in the mobile device 120 is displayed on a display screen 123 of the mobile device 120. Names and e-mail addresses of people is included in the address book. Next, when the user selects addresses of people to send the image, the mobile device 120 transmits the received image to the selected addresses.
  • FIG. 2 is a diagram showing a method of remotely controlling a camera, according to an embodiment of the present invention.
  • the camera displays an image of an object on a display unit via a live-view feature.
  • the live-view feature refers to a function of displaying an image input via a lens on a display unit, e.g., an LCD window.
  • the camera encodes the screen image displayed on the display unit by using a predetermined encoding method, and then streams the encoded screen image to a remote controller in real time.
  • the remote controller decodes the screen image, which is streamed in real time, by using a predetermined decoding method, and then displays the decoded screen image on a display unit. In this case, a time delay occurs, due to the encoding operation in the camera, transmission from the camera to the remote controller, and the decoding operation in the remote controller.
  • a screen image displayed on the camera and a screen image displayed on the remote controller are not exactly the same.
  • a screen image displayed on the remote controller becomes a past screen image with respect to a screen image displayed on the camera, due to a sum of the time delays stated above.
  • the captured image corresponds to a screen image a time displayed a time delay after the screen image viewed by the user.
  • a user may not be able to acquire an image of a desired screen image. Detailed description thereof will be given below with reference to FIG. 3.
  • FIG. 3 is a diagram showing an example of screen images displayed on the camera and the remote controller.
  • step 210 an image of a current object 310 input via a lens of a camera 320 is displayed.
  • the camera 320 streams a displayed screen image 321 to a remote controller, e.g., a mobile device 330, in real time.
  • the camera 320 encodes the displayed screen image 321 by using a predetermined encoding method and transmits the encoded screen image 321, whereas the mobile device 330 decodes received stream signals by using a predetermined decoding method and displays the decoded stream signals.
  • a time delay occurs, due to the encoding operation, the transmission, and the decoding operation. Therefore, a screen image 331 displayed on the mobile device 330 becomes a past screen image with respect to the screen image 321 displayed on the camera 320.
  • step 220 if a user pushes an image capture button of the remote controller while the user is viewing a screen image displayed on the remote controller, the remote controller transmits a successive image capture start signal to the camera.
  • step 230 when the camera receives the successive image capture start signal from the remote controller, the camera successively captures images at a predetermined interval.
  • the successive image capture is a function of successively capturing images when a shutter button is pushed.
  • a speed of successively capturing images may vary according to performance of the camera.
  • a time interval for successively capturing images may be smaller than a sum of time delays.
  • Successively captured images respectively include information regarding time points at which the images are captured.
  • the camera stores at least one of successively captured image in a predetermined storage unit of the camera.
  • the remote controller transmits a successive image capture end signal to the camera.
  • the remote controller when a user pushes a shutter button of the remote controller, the remote controller generates a successive image capture start signal.
  • the remote controller When a user holds and releases the shutter button of the remote controller, the remote controller generates a successive image capture end signal and transmits the successive image capture end signal to the camera.
  • step 250 the camera, which has received the successive image capture end signal, terminates the operation of successively capturing images and selects a predetermined image to be stored from among successively captured images.
  • the camera selects an image captured at a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the successive image capture end signal. In this case, an image identical to a screen image desired by a user may be acquired. If no image is captured at a desired time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the successive image capture end signal, an image captured at a nearest time is selected as an image to be stored.
  • the camera may select a plurality of images captured within a predetermined time interval from the desired time as images to be stored.
  • the camera may store all of successively captured images, so that a user may select images to store.
  • a sum of time delays corresponds to a sum of a period of time elapsed for encoding operation in the camera, a period of time elapsed for streaming a screen image from the camera to the remote controller, a period of time elapsed for decoding operation in the remote controller, and a period of time elapsed for transmitting a signal from the remote controller to the camera.
  • the camera transmits a selected image to the remote controller.
  • the camera may transmit a selected image via e-mail based on information in an address book stored in the camera.
  • the camera since the camera includes a face detection/ recognition module, if a captured image is a portrait picture, information of a person photographed in the captured image may be detected. In this case, the camera may transmit a selected image to a person corresponding to the information detected in the image via e-mail based on information in the address book. If no address is stored in the camera, the camera may request address information to the remote controller (e.g., a mobile device), receive the address information, and transmit the selected image via e-mail based on the address information.
  • the remote controller e.g., a mobile device
  • the remote controller may also transmit the received image via e-mail based on an address in an address book stored in the remote controller. If the remote controller includes a face detection/ recognition module, the remote controller may transmit the received image to a person corresponding to the information detected in the image as described above via e-mail based on the address information in the address book.
  • FIGS. 4a through 4d are diagrams showing examples of methods of remotely controlling a camera, according to an embodiment of the present invention.
  • an image 411 of an object is displayed on the camera 410. Furthermore, the camera 410 streams the image 411 to a remote controller, e.g., a mobile device 420, in real time. The image 421 streamed in real time is displayed on the remote controller 420. However, the image 421 displayed on the mobile device 420 is not identical to the image 411 displayed on the camera 410.
  • a remote controller e.g., a mobile device 420
  • the image 421 is an image delayed by a sum of a period of time elapsed for the camera 410 to encode the image 411, a period of time elapsed for the camera to transmit encoded stream signals to the mobile device 420, and a period of time elapsed for the mobile device 420 to decode the encoded stream signals.
  • the image 421 displayed on the mobile device 420 shown in FIG. 4a is a blank image due to time delay.
  • an image 412 displayed on the camera 410 and an image 422 displayed on the mobile device 420 are different from each other by a sum of time delays. Compared to FIG. 4b, FIG.
  • FIG. 4c shows an image after a sum of time delays.
  • a user since a desired scene is found in an image 423 displayed on the mobile device 420, a user transmits a successive image capture end signal 413 to the camera 410.
  • the camera 410 which has received the successive image capture end signal, selects an image captured prior to the time delays and transmits the selected image to the mobile device 420.
  • the camera 410 transmits a captured image corresponding to a scene image prior to the time delays, that is, an image 430 as shown in FIG. 4d to the mobile device 420.
  • an image currently displayed on a display unit of a camera may be encoded to an image of a lower resolution and the encoded image may be transmitted to a remote controller.
  • the time delay, due to encoding operation in the camera, transmission, and a decoding operation in the remote controller, may be reduced.
  • FIG. 5 is a diagram showing a method of remotely controlling a camera, according to another embodiment of the present invention.
  • step 510 an image displayed on the camera via live-view function is streamed in real time.
  • step 520 if a user pushes an image capture button of the remote controller while the user is viewing a screen image displayed on the remote controller, the remote controller transmits a first image capture signal to the camera.
  • a method of encoding an image displayed on a display unit of the camera via live-view function is switched to a Motion JPEG (M-JPEG) encoding method.
  • M-JPEG Motion JPEG
  • the M-JPEG encoding method encodes each of frames to JPEG, and is an image compression technique developed from the JPEG compression method, which is a compression method for a still image.
  • JPEG compression each of frames constituting an image is encoded to JPEG and is successively arranged to form a motion picture.
  • a JPEG image is stored in a temporary memory.
  • step 540 the remote controller transmits a second image capture signal to the camera.
  • the camera which has received the second image capture signal, selects a predetermined JPEG image from among stored JPEG images.
  • the camera selects a JPEG image captured at a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the second image capture signal.
  • a sum of time delays corresponds to a sum of a period of time elapsed for M-JPEG encoding operation in the camera, a period of time elapsed for streaming the encoded M-JPEG from the camera to the remote controller, a period of time elapsed for M-JPEG decoding operation in the remote controller, and a period of time elapsed for transmitting the second image capture signal from the remote controller to the camera.
  • step 560 the camera transmits the selected JPEG image to the remote controller.
  • JPEG images selected by the camera or the remote controller are transmitted via e-mail as described above in FIG. 2.
  • FIG. 6 is a diagram showing a method of remotely controlling a camera, according to another embodiment of the present invention.
  • a remote controller transmits a motion picture capture start signal to the camera.
  • step 620 after the motion picture capture start signal is received, the camera starts capturing a motion picture.
  • step 630 the camera transmits captured motion picture signals to the remote controller.
  • step 640 while the camera is capturing a motion picture, the remote controller transmits a still image capture signal.
  • step 650 the camera extracts a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, from the captured motion picture, that is, a captured image sequence.
  • a frame corresponding to a time which is calculated by subtracting a sum of time delays from the time at which the still image capture signal is received, is extracted.
  • the camera converts the extracted frame to an image file of a predetermined format. If there is no frame corresponding to a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the still image capture signal, a frame captured at a nearest time is extracted.
  • a sum of time delays corresponds to a sum of a period of time elapsed for motion picture encoding operation in the camera, a period of time elapsed for transmitting the encoded motion picture from the camera to the remote controller, a period of time elapsed for motion picture decoding operation in the remote controller, and a period of time elapsed for transmitting a still image capture signal from the remote controller to the camera.
  • the camera transmits the converted image file to the remote controller.
  • Image files converted by the camera or the remote controller are transmitted via e-mail as described above in FIG. 2.
  • the present embodiment may also employ M-JPEG format for capturing motion picture, and, when of transmitting a motion picture from the camera to the remote controller, the motion picture may be encoded to a motion picture of a lower resolution and the encoded motion picture may be transmitted to the remote controller.
  • FIG. 7 is a block diagram of a camera 720 and a remote controller 710 of the camera, according to an embodiment of the present invention.
  • the remote controller 710 includes a receiving unit 711, a display unit 712, a button unit 713, a transmitting unit 714, and a storage unit 715.
  • the camera 720 includes a display unit 721, a transmitting unit 722, a receiving unit 723, an image capturing unit 724, a control unit 725, and a storage unit 726.
  • the receiving unit 711 of the remote controller 710 receives image signals, which are generated by encoding a screen image displayed on the display unit 721 of the camera 720 and are streamed to the remote controller 710 in real time.
  • the remote controller 710 decodes the image signals streamed from the camera 720 in real time at a decoding unit (not shown) and displays the decoded image signals on the display unit 712 of the remote controller 710.
  • a time delay occurs, due to the encoding operation in the camera 720, transmission from the camera 720 to the remote controller 710, and the decoding operation in the remote controller 710. Therefore, a screen image displayed on the display unit 721 of the camera 720 and a screen image displayed on the display unit 712 of the remote controller 710 are not exactly the same.
  • a screen image displayed on the display unit 712 of the remote controller 710 becomes a past screen image with respect to a screen image displayed on the display unit 721 of the camera 720, due to a sum of the time delays stated above.
  • the captured image corresponds to a screen image a time displayed a time delay after the screen image viewed by the user. In this case, a user may not be able to acquire an image of a desired screen image.
  • the button unit 713 generates a successive image capture start signal and a successive image capture end signal for the camera 720.
  • the button unit 713 may generate a successive image capture start signal when the button unit 713 is pushed, whereas the button unit 713 may generate a successive image capture end signal when the button unit 713 is held and released.
  • the transmitting unit 714 of the remote controller 710 transmits a successive image capture start signal and a successive image capture end signal to the camera 720.
  • the receiving unit 711 of the remote controller 710 receives an image captured at a time, which is calculated by subtracting a sum of time delays from a time at which the camera 720 has received the successive image capture end signal.
  • a sum of time delays corresponds to a sum of a period of time elapsed for transmitting a successive image capture start signal and a successive image capture end signal from the remote controller 710 to the camera 720, a period of time elapsed for encoding operation in the camera, a period of time elapsed for streaming a screen image from the camera to the remote controller, and a period of time elapsed for decoding operation in the remote controller.
  • the storage unit 715 of the remote controller 710 stores the received image. Furthermore, the storage unit 715 may store an address book as described below.
  • the display unit 721 of the camera 720 displays an image generated by converting light input via a lens (not shown) of the camera 720 to electric signals.
  • An encoding unit (not shown) of the camera 720 encodes the image displayed on the display unit 721 of the camera 720 by using a predetermined encoding method.
  • the transmitting unit 722 of the camera 720 streams encoded image signals to the remote controller 710 in real time.
  • the encoding unit (not shown) of the camera 720 may encode an image to be streamed in real time to a resolution lower than that of a resolution of the image to be streamed in real time and transmit the encoded image to the remote controller 710. In this case, the time delay due to encoding operation in the camera, transmission, and decoding operation in the remote controller may be reduced, due to stream signals of a low resolution.
  • the camera 720 receives a successive image capture start signal or a successive image capture end signal from the remote controller 710.
  • the image capturing unit 724 starts to successive capture images when the successive image capture start signal is received and terminates to successively capture images when the successive image capture end signal is received.
  • the successive image capture is a function of successively capturing images when a shutter button is pushed.
  • a speed of successively capturing images may vary according to performance of the camera.
  • a time interval for successively capturing images may be smaller than a sum of time delays.
  • Successively captured images respectively include information regarding time points at which the images are captured.
  • the control unit 725 terminates the operation of successively capturing images and selects a predetermined image to be stored from among successively captured images.
  • the control unit 725 selects an image captured at a time, which is calculated by subtracting a sum of the time delays from a time at which the camera has received the successive image capture end signal. In this case, an image identical to a screen image desired by a user may be acquired. If no image is captured at a desired time, which is calculated by subtracting a sum of the time delays from a time at which the camera has received the successive image capture end signal, the control unit 725 selects an image captured at a nearest time as an image to be stored.
  • control unit 725 may select a plurality of images captured within a predetermined time interval from the desired time as images to be stored.
  • the camera may select all of successively captured images, so that a user may select images to store.
  • the sum of time delays corresponds to a sum of a period of time elapsed for encoding operation in the camera 720, a period of time elapsed for streaming a screen image from the camera 720 to the remote controller 710, a period of time elapsed for decoding operation in the remote controller 710, and a period of time elapsed for transmitting a signal from the remote controller 710 to the camera 720.
  • the storage unit 726 of the camera 720 stores captured images.
  • the transmitting unit 722 of the camera 720 transmits the selected image to the remote controller 710.
  • the control unit 725 of the camera 720 may transmit the selected image via the transmitting unit 722 of the camera 720 via e-mail based on information in an address book stored in the storage unit 726 of the camera 720.
  • the control unit 725 of the camera 720 may detect information of a person photographed in the captured image. In this case, the control unit 725 of the camera 720 may transmit a selected image to a person corresponding to the information detected in the image via the transmitting unit 722 of the camera 720 via e-mail based on the address information in the address book. If no address is stored in the storage unit 726 of the camera 720, the control unit 725 of the camera 720 may request address information to the remote controller 710, receive the address information, and transmit the selected image via e-mail based on the address information.
  • the remote controller 710 may also transmit the received image via e-mail based on information in an address book stored in the storage unit 715 of the remote controller 710. If the remote controller 710 includes a face detection/recognition module, the remote controller 710 may transmit the received image to a person corresponding to the information detected in the image as described above via e-mail based on information in the address book.
  • a camera and a remote controller of the camera according to another embodiment of the present invention will be described below.
  • the receiving unit 711 of the remote controller 710 receives an image, which is generated by encoding a screen image displayed on the display unit 721 of the camera 720 and is streamed in real time.
  • the remote controller 710 decodes the image streamed in real time by using a decoding unit (not shown) and displays the decoded image on the display unit 712 of the remote controller 710.
  • the button unit 713 generates a first image capture signal and a second image capture signal by using a predetermined button.
  • the transmitting unit 714 of the remote controller 710 transmits a first image capture signal and a second image capture signal to the camera 720.
  • the receiving unit 711 of the remote controller 710 receives a selected JPEG image from the camera 720.
  • the display unit 721 of the camera 720 displays an image generated by converting light input via a lens (not shown) of the camera 720 to electric signals.
  • An encoding unit (not shown) of the camera 720 encodes the image displayed on the display unit 721 of the camera 720 by using a predetermined encoding method.
  • the transmitting unit 722 of the camera 720 streams the encoded image to the remote controller 710 in real time. If the camera 720 receives the first image capture signal from the remote controller 710, the encoding unit (not shown) of the camera 720 switches a current method of encoding an image to a M-JPEG encoding method.
  • the M-JPEG encoding method encodes each of frames to JPEG, and is an image compression technique developed from the JPEG compression method, which is a compression method for a still image. During M-JPEG compression, each of frames constituting an image is encoded to JPEG and is successively arranged to form a motion picture. A JPEG image is stored in a temporary memory (not shown).
  • the receiving unit 723 of the camera 720 receives a first image capture signal and a second image capture signal from the remote controller 710.
  • the control unit 725 selects a predetermined JPEG image from among temporarily stored JPEG image, the predetermined JPEG image captured at a time, which is calculated by subtracting a sum of the time delays from a time at which the camera has received the second image capture signal. If JPEG no image is captured at a desired time, which is calculated by subtracting a sum of the time delays from a time at which the camera has received the second image capture signal, the control unit 725 selects a JPEG image captured at a nearest time point.
  • the sum of time delays corresponds to a sum of a period of time elapsed for M-JPEG encoding operation in the camera 720, a period of time elapsed for streaming a screen image from the camera 720 to the remote controller 710, a period of time elapsed for M-JPEG decoding operation in the remote controller 710, and a period of time elapsed for transmitting the second image capture signal from the remote controller 710 to the camera 720.
  • the transmitting unit 722 of the camera 720 transmits the selected JPEG image to the remote controller 710.
  • a JPEG image selected by the camera 720 or the remote controller 710 is transmitted via e-mail as described above.
  • a camera and a remote controller of the camera according to another embodiment of the present invention will be described below.
  • the button unit 713 generates a motion picture capture start signal and a still image capture signal by using a predetermined button.
  • the transmitting unit 714 of the remote controller 710 transmits the motion picture capture start signal and the still image capture signal to the camera 720.
  • the receiving unit 711 of the remote controller 710 receives a real time stream of a captured motion picture from the camera 720.
  • the remote controller 710 decodes the motion picture streamed in real time by using a decoding unit (not shown) and displays the decoded motion picture on the display unit 712 of the remote controller 710.
  • the receiving unit 711 receives an image file, which is generated by converting a frame corresponding to a time which is a predetermined period of time prior to a time in a captured image sequence, from the camera 720.
  • the image capturing unit 724 of the camera 720 displays an image, which is generated by converting light input via a lens (not shown) of the camera 720 to electric signals, on the display unit 721 of the camera 720.
  • An encoding unit (not shown) of the camera 720 encodes the image displayed on the display unit 721 of the camera 720 by using a predetermined encoding method.
  • the transmitting unit 722 of the camera 720 streams the encoded image to the remote controller 710 in real time.
  • the control unit 725 extracts a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, from the captured motion picture, that is, a captured image sequence. In other words, the control unit 725 extracts a frame corresponding to a time, which is calculated by subtracting a sum of time delays from the time at which the still image capture signal is received, and converts the extracted frame to a predetermined image file. If there is no frame corresponding to a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the still image capture signal, a frame captured at a nearest time is extracted.
  • a sum of time delays corresponds to a sum of a period of time elapsed for motion picture encoding operation in the camera 720, a period of time elapsed for transmitting the encoded motion picture from the camera 720 to the remote controller 710, a period of time elapsed for motion picture decoding operation in the remote controller 710, and a period of time elapsed for transmitting a still image capture signal from the remote controller 710 to the camera 720.
  • the transmitting unit 722 of the camera 720 transmits the converted image file to the remote controller 710.
  • An image file converted by the camera 720 or the remote controller 710 is transmitted via e-mail as described above.
  • the invention can also be embodied as computer readable codes on a computer readable recording medium.
  • the computer readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of the computer readable recording medium include Read-Only Memory (ROM), Random-Access Memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc.
  • the computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. Also, functional programs, codes, and code segments for accomplishing the present invention can be easily construed by programmers skilled in the art to which the present invention pertains.

Abstract

A method of providing an image, the method including receiving an image capture start signal from a remote controller of the camera, successively capturing images after the image capture start signal is received, receiving an image capture end signal from the remote controller, and selecting an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.

Description

METHOD AND APPARATUS FOR PROVIDING IMAGE IN CAMERA OR REMOTE-CONTROLLER FOR CAMERA
The present invention generally relates to remotely controlling a camera, and more particularly to a method and an apparatus for providing an image in a camera or a remote controller of a camera.
A digital camera is a device for converting a still image or a moving image to digital signals and storing the digital signals in a storage medium, such as a memory card. An image of an object captured via a lens is converted to electric signals by a Charge-Coupled Device (CCD) or a Complementary Metal-Oxide Semiconductor (CMOS). The electric signals are converted to digital signals by an Analog-to-Digital (A/D) converter, and the digital signals are stored in a memory after correction and compression. The stored digital signals are transmitted to a Personal Computer (PC) or a recording medium via any of various interfaces. Accordingly, a digital image is formed.
An object is photographed by using a digital camera by directing a lens of the digital camera toward the object, focusing the digital camera to capture an optimal image, and triggering a shutter. The series of operations is applicable when a person operating a digital camera and a person to be photographed are different people. When a person operating a digital camera and another person shall be photographed together, a timer function of a digital camera is generally used. However, it is difficult to obtain a desired angle and focus by using a timer function, and thus it is difficult to obtain a clear image. Therefore, a remote controller for remotely controlling a digital camera is used.
The present invention provides a method and an apparatus for providing an image in a camera or a remote controller of a camera to acquire a captured image with no time delay.
The above and other features and advantages of the present invention will become more apparent, by describing in detail embodiments thereof, with reference to the attached drawings in which:
FIGS. 1A through 1E are diagrams showing examples of methods of remotely controlling a camera, according to an embodiment of the present invention.
FIG. 2 is a diagram showing a method of remotely controlling a camera, according to an embodiment of the present invention.
FIG. 3 is a diagram showing an example of screen images displayed on the camera and the remote controller. FIGS. 4A through 4D are diagrams showing examples of methods of remotely controlling a camera, according to an embodiment of the present invention.
FIG. 5 is a diagram showing a method of remotely controlling a camera, according to another embodiment of the present invention.
FIG. 6 is a diagram showing a method of remotely controlling a camera, according to another embodiment of the present invention.
FIG. 7 is a block diagram of a camera 720 and a remote controller 710 of the camera, according to an embodiment of the present invention.
According to an aspect of the present invention, a method of providing an image includes transmitting an image capture start signal to a camera; transmitting an image capture end signal to the camera; and receiving an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
According to another aspect of the present invention, a method of providing an image includes receiving an image capture start signal from a remote controller of the camera; successively capturing images after the image capture start signal is received; receiving an image capture end signal from the remote controller; and selecting an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
According to another aspect of the present invention, a method of providing an image includes transmitting first image capture signal to a camera; transmitting second image capture signal to the camera; and receiving a JPEG image captured at a time which is a predetermined period of time prior to a time at which the successive image capture end signal is received.
According to another aspect of the present invention, a method of transmitting an image includes receiving first image capture signal from a remote controller of a camera; encoding an image displayed on the camera by using a motion JPEG encoding method and transmitting the encoded image to the remote controller; receiving second image capture signal from the remote controller; and selecting a JPEG image captured at a time which is a predetermined period of time prior to a time at which the second image capture signal is received.
According to another aspect of the present invention, a method of providing an image includes transmitting a motion picture capture start signal to a camera; receiving a real time stream of a motion picture captured by the camera; transmitting a still image capture signal to the camera; and receiving an image file generated by converting a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, extracted from the captured motion picture.
According to another aspect of the present invention, a method of transmitting an image includes receiving a motion picture capture start signal from a remote controller; capturing a motion picture; streaming the captured motion picture to the remote controller in real time; receiving a still image capture signal from the remote controller; and extracting a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, from the captured motion picture and converting the frame to an image file.
According to another aspect of the present invention, a remote controller of a camera includes a transmitting unit, which transmits an image capture start signal to a camera, and then transmits an image capture end signal to the camera; and a receiving unit, which receives an image captured at a time a predetermined period of time prior to a time at which the image capture end signal is received.
According to another aspect of the present invention, a camera includes a receiving unit, which receives an image capture start signal and an image capture end signal from a remote controller of the camera; an image capturing unit, which successively captures images after the image capture start signal is received until the image capture end signal is received; and a control unit, which selects an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
According to another aspect of the present invention, a remote controller of a camera, the remote controller includes a transmitting unit, which transmits a first image capture signal to the camera and transmits a second image capture signal to the camera; receiving a JPEG image captured at a time which is a predetermined period of time prior to a time at which the second image capture signal is received.
According to another aspect of the present invention, a camera includes a receiving unit, which receives a first image capture signal and a second image capture signal from a remote controller of a camera; and a control unit, which encodes an image displayed on the camera by using a motion JPEG encoding method and transmitting the encoded image to the remote controller and, when a second image capture signal is received from the remote controller, selects a JPEG image captured at a time which is a predetermined period of time prior to a time at which the second image capture signal is received.
According to another aspect of the present invention, a remote controller of a camera, the remote controller includes a transmitting unit, which transmits a motion picture capture start signal to a camera; and a receiving unit, which receives a real time stream of a motion picture captured by the camera and receives an image file generated by converting a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, extracted from the captured motion picture.
According to another aspect of the present invention, a camera includes a receiving unit, which receives a motion picture capture start signal and a still image capture signal from a remote controller of the camera; an image capturing unit, which captures a motion picture when the motion picture capture start signal is received from the remote controller; a control unit, which, when the still image capture signal is received, extracts a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, from the captured motion picture and converts the frame to an image file.
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the following description, the same elements will be designated by the same reference numerals although they are shown in different drawings. Further, in the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted for the sake of clarity and conciseness.
FIGS. 1a a through 1e are diagrams showing methods of remotely controlling a camera, according to an embodiment of the present invention.
Referring to FIG. 1a, a camera 110 and a mobile device 120, which is a remote controller of the camera 110, are connected to each other via a predetermined wired or wireless communication network, such as Wi-Fi. Referring to FIG. 1b, an image 111, which is formed of electric signals converted from a light input via a lens of the camera 110, is displayed on a display unit of the camera 110. Referring to FIG. 1c, when the mobile device 120 executes an application for remotely controlling the camera 110, a screen image displayed on the camera 110 is streamed to and is displayed on a display unit of the mobile device 120 in real time. However, due to a hardware difference, such as a difference between a resolution of the display unit of the camera 110 and a resolution of the display unit of the mobile device 120, screen images displayed on each of the display units may not be identical to each other. In FIG. 1c, a screen image 121 displayed on the display unit of the mobile device 120 is smaller than a screen image 111 displayed on the display unit of the camera 110. In other words, the screen image 121 displayed on the display unit of the mobile device 120 is partially cut as compared to the screen image 111 displayed on the display unit of the camera 110. Referring to FIG. 1d, the layout of the screen image 122 may be corrected by a zoom function with respect to a screen image 122 displayed on the display unit of the mobile device 120. The size of the screen image 122 may be adjusted by using the zoom function. In FIG. 1d, the screen image 122 displayed on the display unit of the mobile device 120 becomes identical to the screen image 111 displayed on the display unit of the camera 110 by using the zoom function. Here, a user may remote-photograph an object by using a predetermined button of the mobile device 120. An image captured by the camera 110 is received by the mobile device 120, and the image is displayed. A user of the mobile device 120 may either store or delete the received image. Referring to FIG. 1e, when a received image is displayed on the mobile device 120, if a user pushes a predetermined button for sharing the image, an address book stored in the mobile device 120 is displayed on a display screen 123 of the mobile device 120. Names and e-mail addresses of people is included in the address book. Next, when the user selects addresses of people to send the image, the mobile device 120 transmits the received image to the selected addresses.
FIG. 2 is a diagram showing a method of remotely controlling a camera, according to an embodiment of the present invention.
In step 210, the camera displays an image of an object on a display unit via a live-view feature. The live-view feature refers to a function of displaying an image input via a lens on a display unit, e.g., an LCD window. The camera encodes the screen image displayed on the display unit by using a predetermined encoding method, and then streams the encoded screen image to a remote controller in real time. The remote controller decodes the screen image, which is streamed in real time, by using a predetermined decoding method, and then displays the decoded screen image on a display unit. In this case, a time delay occurs, due to the encoding operation in the camera, transmission from the camera to the remote controller, and the decoding operation in the remote controller. Therefore, a screen image displayed on the camera and a screen image displayed on the remote controller are not exactly the same. In other words, a screen image displayed on the remote controller becomes a past screen image with respect to a screen image displayed on the camera, due to a sum of the time delays stated above. For example, if a user captures an image based on a screen image displayed on the remote controller, the captured image corresponds to a screen image a time displayed a time delay after the screen image viewed by the user. In this case, a user may not be able to acquire an image of a desired screen image. Detailed description thereof will be given below with reference to FIG. 3.
FIG. 3 is a diagram showing an example of screen images displayed on the camera and the remote controller.
Referring to FIG. 3, in step 210, an image of a current object 310 input via a lens of a camera 320 is displayed. The camera 320 streams a displayed screen image 321 to a remote controller, e.g., a mobile device 330, in real time. In this case, the camera 320 encodes the displayed screen image 321 by using a predetermined encoding method and transmits the encoded screen image 321, whereas the mobile device 330 decodes received stream signals by using a predetermined decoding method and displays the decoded stream signals. Here, a time delay occurs, due to the encoding operation, the transmission, and the decoding operation. Therefore, a screen image 331 displayed on the mobile device 330 becomes a past screen image with respect to the screen image 321 displayed on the camera 320.
In step 220, if a user pushes an image capture button of the remote controller while the user is viewing a screen image displayed on the remote controller, the remote controller transmits a successive image capture start signal to the camera.
In step 230, when the camera receives the successive image capture start signal from the remote controller, the camera successively captures images at a predetermined interval. The successive image capture is a function of successively capturing images when a shutter button is pushed. A speed of successively capturing images may vary according to performance of the camera. According to an embodiment of the present invention, a time interval for successively capturing images may be smaller than a sum of time delays. Successively captured images respectively include information regarding time points at which the images are captured. The camera stores at least one of successively captured image in a predetermined storage unit of the camera.
In step 240, the remote controller transmits a successive image capture end signal to the camera. According to an embodiment of the present invention, when a user pushes a shutter button of the remote controller, the remote controller generates a successive image capture start signal. When a user holds and releases the shutter button of the remote controller, the remote controller generates a successive image capture end signal and transmits the successive image capture end signal to the camera.
In step 250, the camera, which has received the successive image capture end signal, terminates the operation of successively capturing images and selects a predetermined image to be stored from among successively captured images. The camera selects an image captured at a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the successive image capture end signal. In this case, an image identical to a screen image desired by a user may be acquired. If no image is captured at a desired time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the successive image capture end signal, an image captured at a nearest time is selected as an image to be stored. Furthermore, the camera may select a plurality of images captured within a predetermined time interval from the desired time as images to be stored. The camera may store all of successively captured images, so that a user may select images to store. A sum of time delays corresponds to a sum of a period of time elapsed for encoding operation in the camera, a period of time elapsed for streaming a screen image from the camera to the remote controller, a period of time elapsed for decoding operation in the remote controller, and a period of time elapsed for transmitting a signal from the remote controller to the camera.
In step 260, the camera transmits a selected image to the remote controller. The camera may transmit a selected image via e-mail based on information in an address book stored in the camera. Furthermore, since the camera includes a face detection/ recognition module, if a captured image is a portrait picture, information of a person photographed in the captured image may be detected. In this case, the camera may transmit a selected image to a person corresponding to the information detected in the image via e-mail based on information in the address book. If no address is stored in the camera, the camera may request address information to the remote controller (e.g., a mobile device), receive the address information, and transmit the selected image via e-mail based on the address information.
Furthermore, if the remote controller receives a selected image, the remote controller may also transmit the received image via e-mail based on an address in an address book stored in the remote controller. If the remote controller includes a face detection/ recognition module, the remote controller may transmit the received image to a person corresponding to the information detected in the image as described above via e-mail based on the address information in the address book.
The above method will be described below with reference to FIGS. 4a through 4d. FIGS. 4a through 4d are diagrams showing examples of methods of remotely controlling a camera, according to an embodiment of the present invention.
In FIG. 4a, an image 411 of an object is displayed on the camera 410. Furthermore, the camera 410 streams the image 411 to a remote controller, e.g., a mobile device 420, in real time. The image 421 streamed in real time is displayed on the remote controller 420. However, the image 421 displayed on the mobile device 420 is not identical to the image 411 displayed on the camera 410. Here, as compared to the image 411 displayed on the camera 410, the image 421 is an image delayed by a sum of a period of time elapsed for the camera 410 to encode the image 411, a period of time elapsed for the camera to transmit encoded stream signals to the mobile device 420, and a period of time elapsed for the mobile device 420 to decode the encoded stream signals. The image 421 displayed on the mobile device 420 shown in FIG. 4a is a blank image due to time delay. In the same regard, as shown in FIG. 4b, an image 412 displayed on the camera 410 and an image 422 displayed on the mobile device 420 are different from each other by a sum of time delays. Compared to FIG. 4b, FIG. 4c shows an image after a sum of time delays. In FIG. 4c, since a desired scene is found in an image 423 displayed on the mobile device 420, a user transmits a successive image capture end signal 413 to the camera 410. The camera 410, which has received the successive image capture end signal, selects an image captured prior to the time delays and transmits the selected image to the mobile device 420. In this case, the camera 410 transmits a captured image corresponding to a scene image prior to the time delays, that is, an image 430 as shown in FIG. 4d to the mobile device 420.
Furthermore, according to an embodiment of the present invention, when a successive image capture start signal is received, an image currently displayed on a display unit of a camera may be encoded to an image of a lower resolution and the encoded image may be transmitted to a remote controller. In this case, the time delay, due to encoding operation in the camera, transmission, and a decoding operation in the remote controller, may be reduced.
FIG. 5 is a diagram showing a method of remotely controlling a camera, according to another embodiment of the present invention.
In step 510, an image displayed on the camera via live-view function is streamed in real time.
In step 520, if a user pushes an image capture button of the remote controller while the user is viewing a screen image displayed on the remote controller, the remote controller transmits a first image capture signal to the camera.
In step 530, when the camera receives the first image capture signal from the remote controller, a method of encoding an image displayed on a display unit of the camera via live-view function is switched to a Motion JPEG (M-JPEG) encoding method. The M-JPEG encoding method encodes each of frames to JPEG, and is an image compression technique developed from the JPEG compression method, which is a compression method for a still image. During M-JPEG compression, each of frames constituting an image is encoded to JPEG and is successively arranged to form a motion picture. A JPEG image is stored in a temporary memory.
In step 540, the remote controller transmits a second image capture signal to the camera.
In step 550, the camera, which has received the second image capture signal, selects a predetermined JPEG image from among stored JPEG images. The camera selects a JPEG image captured at a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the second image capture signal. A sum of time delays corresponds to a sum of a period of time elapsed for M-JPEG encoding operation in the camera, a period of time elapsed for streaming the encoded M-JPEG from the camera to the remote controller, a period of time elapsed for M-JPEG decoding operation in the remote controller, and a period of time elapsed for transmitting the second image capture signal from the remote controller to the camera.
In step 560, the camera transmits the selected JPEG image to the remote controller. JPEG images selected by the camera or the remote controller are transmitted via e-mail as described above in FIG. 2.
FIG. 6 is a diagram showing a method of remotely controlling a camera, according to another embodiment of the present invention.
In step 610, a remote controller transmits a motion picture capture start signal to the camera.
In step 620, after the motion picture capture start signal is received, the camera starts capturing a motion picture. In step 630, the camera transmits captured motion picture signals to the remote controller.
In step 640, while the camera is capturing a motion picture, the remote controller transmits a still image capture signal.
In step 650, the camera extracts a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, from the captured motion picture, that is, a captured image sequence. In other words, a frame corresponding to a time, which is calculated by subtracting a sum of time delays from the time at which the still image capture signal is received, is extracted. Next, the camera converts the extracted frame to an image file of a predetermined format. If there is no frame corresponding to a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the still image capture signal, a frame captured at a nearest time is extracted. A sum of time delays corresponds to a sum of a period of time elapsed for motion picture encoding operation in the camera, a period of time elapsed for transmitting the encoded motion picture from the camera to the remote controller, a period of time elapsed for motion picture decoding operation in the remote controller, and a period of time elapsed for transmitting a still image capture signal from the remote controller to the camera.
In step 660, the camera transmits the converted image file to the remote controller. Image files converted by the camera or the remote controller are transmitted via e-mail as described above in FIG. 2. The present embodiment may also employ M-JPEG format for capturing motion picture, and, when of transmitting a motion picture from the camera to the remote controller, the motion picture may be encoded to a motion picture of a lower resolution and the encoded motion picture may be transmitted to the remote controller.
FIG. 7 is a block diagram of a camera 720 and a remote controller 710 of the camera, according to an embodiment of the present invention.
Referring to FIG. 7, the remote controller 710 includes a receiving unit 711, a display unit 712, a button unit 713, a transmitting unit 714, and a storage unit 715. The camera 720 includes a display unit 721, a transmitting unit 722, a receiving unit 723, an image capturing unit 724, a control unit 725, and a storage unit 726.
The receiving unit 711 of the remote controller 710 receives image signals, which are generated by encoding a screen image displayed on the display unit 721 of the camera 720 and are streamed to the remote controller 710 in real time.
The remote controller 710 decodes the image signals streamed from the camera 720 in real time at a decoding unit (not shown) and displays the decoded image signals on the display unit 712 of the remote controller 710. In this case, a time delay occurs, due to the encoding operation in the camera 720, transmission from the camera 720 to the remote controller 710, and the decoding operation in the remote controller 710. Therefore, a screen image displayed on the display unit 721 of the camera 720 and a screen image displayed on the display unit 712 of the remote controller 710 are not exactly the same. In other words, a screen image displayed on the display unit 712 of the remote controller 710 becomes a past screen image with respect to a screen image displayed on the display unit 721 of the camera 720, due to a sum of the time delays stated above. For example, if a user captures an image based on a screen image displayed on the display unit 712 of the remote controller 710, the captured image corresponds to a screen image a time displayed a time delay after the screen image viewed by the user. In this case, a user may not be able to acquire an image of a desired screen image.
The button unit 713 generates a successive image capture start signal and a successive image capture end signal for the camera 720. According to an embodiment of the present invention, the button unit 713 may generate a successive image capture start signal when the button unit 713 is pushed, whereas the button unit 713 may generate a successive image capture end signal when the button unit 713 is held and released.
The transmitting unit 714 of the remote controller 710 transmits a successive image capture start signal and a successive image capture end signal to the camera 720.
Furthermore, the receiving unit 711 of the remote controller 710 receives an image captured at a time, which is calculated by subtracting a sum of time delays from a time at which the camera 720 has received the successive image capture end signal. A sum of time delays corresponds to a sum of a period of time elapsed for transmitting a successive image capture start signal and a successive image capture end signal from the remote controller 710 to the camera 720, a period of time elapsed for encoding operation in the camera, a period of time elapsed for streaming a screen image from the camera to the remote controller, and a period of time elapsed for decoding operation in the remote controller.
The storage unit 715 of the remote controller 710 stores the received image. Furthermore, the storage unit 715 may store an address book as described below.
The display unit 721 of the camera 720 displays an image generated by converting light input via a lens (not shown) of the camera 720 to electric signals.
An encoding unit (not shown) of the camera 720 encodes the image displayed on the display unit 721 of the camera 720 by using a predetermined encoding method. Next, the transmitting unit 722 of the camera 720 streams encoded image signals to the remote controller 710 in real time. Furthermore, according to another embodiment of the present invention, if a successive image capture start signal is received, the encoding unit (not shown) of the camera 720 may encode an image to be streamed in real time to a resolution lower than that of a resolution of the image to be streamed in real time and transmit the encoded image to the remote controller 710. In this case, the time delay due to encoding operation in the camera, transmission, and decoding operation in the remote controller may be reduced, due to stream signals of a low resolution.
The camera 720 receives a successive image capture start signal or a successive image capture end signal from the remote controller 710.
The image capturing unit 724 starts to successive capture images when the successive image capture start signal is received and terminates to successively capture images when the successive image capture end signal is received. The successive image capture is a function of successively capturing images when a shutter button is pushed. A speed of successively capturing images may vary according to performance of the camera. According to an embodiment of the present invention, a time interval for successively capturing images may be smaller than a sum of time delays. Successively captured images respectively include information regarding time points at which the images are captured.
When a successive image capture end signal is received via the receiving unit 723 of the camera 720, the control unit 725 terminates the operation of successively capturing images and selects a predetermined image to be stored from among successively captured images. The control unit 725 selects an image captured at a time, which is calculated by subtracting a sum of the time delays from a time at which the camera has received the successive image capture end signal. In this case, an image identical to a screen image desired by a user may be acquired. If no image is captured at a desired time, which is calculated by subtracting a sum of the time delays from a time at which the camera has received the successive image capture end signal, the control unit 725 selects an image captured at a nearest time as an image to be stored. Furthermore, the control unit 725 may select a plurality of images captured within a predetermined time interval from the desired time as images to be stored. The camera may select all of successively captured images, so that a user may select images to store. The sum of time delays corresponds to a sum of a period of time elapsed for encoding operation in the camera 720, a period of time elapsed for streaming a screen image from the camera 720 to the remote controller 710, a period of time elapsed for decoding operation in the remote controller 710, and a period of time elapsed for transmitting a signal from the remote controller 710 to the camera 720. The storage unit 726 of the camera 720 stores captured images.
The transmitting unit 722 of the camera 720 transmits the selected image to the remote controller 710. The control unit 725 of the camera 720 may transmit the selected image via the transmitting unit 722 of the camera 720 via e-mail based on information in an address book stored in the storage unit 726 of the camera 720. Furthermore, because the camera 720 includes a face detection/recognition module, if a captured image is a portrait picture, the control unit 725 of the camera 720 may detect information of a person photographed in the captured image. In this case, the control unit 725 of the camera 720 may transmit a selected image to a person corresponding to the information detected in the image via the transmitting unit 722 of the camera 720 via e-mail based on the address information in the address book. If no address is stored in the storage unit 726 of the camera 720, the control unit 725 of the camera 720 may request address information to the remote controller 710, receive the address information, and transmit the selected image via e-mail based on the address information.
Furthermore, if the remote controller 710 receives a selected image, the remote controller 710 may also transmit the received image via e-mail based on information in an address book stored in the storage unit 715 of the remote controller 710. If the remote controller 710 includes a face detection/recognition module, the remote controller 710 may transmit the received image to a person corresponding to the information detected in the image as described above via e-mail based on information in the address book.
A camera and a remote controller of the camera according to another embodiment of the present invention will be described below.
The receiving unit 711 of the remote controller 710 receives an image, which is generated by encoding a screen image displayed on the display unit 721 of the camera 720 and is streamed in real time.
The remote controller 710 decodes the image streamed in real time by using a decoding unit (not shown) and displays the decoded image on the display unit 712 of the remote controller 710.
The button unit 713 generates a first image capture signal and a second image capture signal by using a predetermined button.
The transmitting unit 714 of the remote controller 710 transmits a first image capture signal and a second image capture signal to the camera 720.
Furthermore, the receiving unit 711 of the remote controller 710 receives a selected JPEG image from the camera 720.
The display unit 721 of the camera 720 displays an image generated by converting light input via a lens (not shown) of the camera 720 to electric signals.
An encoding unit (not shown) of the camera 720 encodes the image displayed on the display unit 721 of the camera 720 by using a predetermined encoding method. Next, the transmitting unit 722 of the camera 720 streams the encoded image to the remote controller 710 in real time. If the camera 720 receives the first image capture signal from the remote controller 710, the encoding unit (not shown) of the camera 720 switches a current method of encoding an image to a M-JPEG encoding method. The M-JPEG encoding method encodes each of frames to JPEG, and is an image compression technique developed from the JPEG compression method, which is a compression method for a still image. During M-JPEG compression, each of frames constituting an image is encoded to JPEG and is successively arranged to form a motion picture. A JPEG image is stored in a temporary memory (not shown).
The receiving unit 723 of the camera 720 receives a first image capture signal and a second image capture signal from the remote controller 710.
If the second image capture signal is received, the control unit 725 selects a predetermined JPEG image from among temporarily stored JPEG image, the predetermined JPEG image captured at a time, which is calculated by subtracting a sum of the time delays from a time at which the camera has received the second image capture signal. If JPEG no image is captured at a desired time, which is calculated by subtracting a sum of the time delays from a time at which the camera has received the second image capture signal, the control unit 725 selects a JPEG image captured at a nearest time point. The sum of time delays corresponds to a sum of a period of time elapsed for M-JPEG encoding operation in the camera 720, a period of time elapsed for streaming a screen image from the camera 720 to the remote controller 710, a period of time elapsed for M-JPEG decoding operation in the remote controller 710, and a period of time elapsed for transmitting the second image capture signal from the remote controller 710 to the camera 720.
The transmitting unit 722 of the camera 720 transmits the selected JPEG image to the remote controller 710. A JPEG image selected by the camera 720 or the remote controller 710 is transmitted via e-mail as described above.
A camera and a remote controller of the camera according to another embodiment of the present invention will be described below.
The button unit 713 generates a motion picture capture start signal and a still image capture signal by using a predetermined button.
The transmitting unit 714 of the remote controller 710 transmits the motion picture capture start signal and the still image capture signal to the camera 720.
The receiving unit 711 of the remote controller 710 receives a real time stream of a captured motion picture from the camera 720.
The remote controller 710 decodes the motion picture streamed in real time by using a decoding unit (not shown) and displays the decoded motion picture on the display unit 712 of the remote controller 710.
Furthermore, the receiving unit 711 receives an image file, which is generated by converting a frame corresponding to a time which is a predetermined period of time prior to a time in a captured image sequence, from the camera 720.
If a motion picture capture start signal is received via the receiving unit 723 of the camera 720, the image capturing unit 724 of the camera 720 displays an image, which is generated by converting light input via a lens (not shown) of the camera 720 to electric signals, on the display unit 721 of the camera 720.
An encoding unit (not shown) of the camera 720 encodes the image displayed on the display unit 721 of the camera 720 by using a predetermined encoding method. Next, the transmitting unit 722 of the camera 720 streams the encoded image to the remote controller 710 in real time.
If the still image capture signal is received via the receiving unit 723 of the camera 720, the control unit 725 extracts a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, from the captured motion picture, that is, a captured image sequence. In other words, the control unit 725 extracts a frame corresponding to a time, which is calculated by subtracting a sum of time delays from the time at which the still image capture signal is received, and converts the extracted frame to a predetermined image file. If there is no frame corresponding to a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the still image capture signal, a frame captured at a nearest time is extracted. A sum of time delays corresponds to a sum of a period of time elapsed for motion picture encoding operation in the camera 720, a period of time elapsed for transmitting the encoded motion picture from the camera 720 to the remote controller 710, a period of time elapsed for motion picture decoding operation in the remote controller 710, and a period of time elapsed for transmitting a still image capture signal from the remote controller 710 to the camera 720.
The transmitting unit 722 of the camera 720 transmits the converted image file to the remote controller 710. An image file converted by the camera 720 or the remote controller 710 is transmitted via e-mail as described above.
The invention can also be embodied as computer readable codes on a computer readable recording medium. The computer readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of the computer readable recording medium include Read-Only Memory (ROM), Random-Access Memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. Also, functional programs, codes, and code segments for accomplishing the present invention can be easily construed by programmers skilled in the art to which the present invention pertains.
Although the present invention has been particularly shown and described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. The preferred embodiments should be considered in descriptive sense only and not for purposes of limitation. Therefore, the scope of the invention is defined not by the detailed description of the invention but by the appended claims, and all differences within the scope will be construed as being included in the present invention.

Claims (42)

  1. A method of providing an image, the method comprising:
    transmitting an image capture start signal to a camera;
    transmitting an image capture end signal to the camera; and
    receiving an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
  2. The method of claim 1, wherein the image capture start signal is a successive image capture start signal, and the image capture end signal is a successive image capture end signal.
  3. The method of claim 2, wherein the predetermined period of time is a difference between a time corresponding to an image displayed on the camera and an image displayed on the remote controller of the camera, which transmits the successive image capture start signal to the camera.
  4. The method of claim 3, wherein a time lag between images displayed on the camera and the remote controller is based on a sum of a time delay due to transmission of a signal from the remote controller to the camera, a time delay due to the encoding operation in the camera, a time delay due to transmission of an image from the camera to the remote controller, and a time delay due to the decoding operation in the remote controller.
  5. The method of claim 3, wherein transmitting the successive image capture start signal comprises transmitting the successive image capture start signal to the camera when a push signal, which is generated as a predetermined image capture button of the remote controller is pushed, is received, and
    wherein transmitting a successive image capture end signal comprises transmitting the successive image capture end signal to the camera when reception of the push signal is completed.
  6. The method of claim 3, wherein receiving the captured image from the camera comprises receiving at least one image captured within a predetermined period of time from a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the successive image capture end signal.
  7. A method of providing an image, the method comprising:
    receiving an image capture start signal from a remote controller of the camera;
    successively capturing images after the image capture start signal is received;
    receiving an image capture end signal from the remote controller; and
    selecting an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
  8. The method of claim 7, wherein the image capture start signal is a successive image capture start signal, and the image capture end signal is a successive image capture end signal.
  9. The method of claim 8, wherein the predetermined period of time is a difference between a time corresponding to an image displayed on the camera and an image displayed on the remote controller of the camera, which transmits the successive image capture start signal to the camera.
  10. The method of claim 9, wherein a time lag between images displayed on the camera and the remote controller is based on a sum of a time delay due to transmission of a signal from the remote controller to the camera, a time delay due to the encoding operation in the camera, a time delay due to transmission of an image from the camera to the remote controller, and a time delay due to the decoding operation in the remote controller.
  11. The method of claim 8, further comprising transmitting the selected image to the remote controller.
  12. The method of claim 11, wherein selecting an image comprises selecting at least one image captured within a predetermined period of time from a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the successive image capture end signal.
  13. The method of claim 7, further comprising encoding an image to be streamed in real time to an image of a lower resolution and transmitting the encoded image to the remote controller.
  14. The method of claim 7, further comprising transmitting the selected image via e-mail based on information in a stored address book.
  15. The method of claim 7, further comprising:
    requesting a predetermined address book to the remote controller; and
    transmitting the selected image via e-mail based on information in the stored address book received from the remote controller.
  16. The method of claim 7, further comprising storing the selected image in a predetermined storage unit.
  17. A method of providing an image, the method comprising:
    transmitting first image capture signal to a camera;
    transmitting second image capture signal to the camera; and
    receiving a JPEG image captured at a time which is a predetermined period of time prior to a time at which the successive image capture end signal is received.
  18. A method of transmitting an image, the method comprising:
    receiving first image capture signal from a remote controller of a camera;
    encoding an image displayed on the camera by using a motion JPEG encoding method and transmitting the encoded image to the remote controller;
    receiving second image capture signal from the remote controller; and
    selecting a JPEG image captured at a time which is a predetermined period of time prior to a time at which the second image capture signal is received.
  19. A method of providing an image, the method comprising:
    transmitting a motion picture capture start signal to a camera;
    receiving a real time stream of a motion picture captured by the camera;
    transmitting a still image capture signal to the camera; and
    receiving an image file generated by converting a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, extracted from the captured motion picture.
  20. A method of transmitting an image, the method comprising:
    receiving a motion picture capture start signal from a remote controller;
    capturing a motion picture;
    streaming the captured motion picture to the remote controller in real time;
    receiving a still image capture signal from the remote controller; and
    extracting a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, from the captured motion picture and converting the frame to an image file.
  21. A remote controller of a camera comprising:
    a transmitting unit, which transmits an image capture start signal to a camera, and then transmits an image capture end signal to the camera; and
    a receiving unit, which receives an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
  22. The remote controller of claim 21, wherein the image capture start signal is a successive image capture start signal, and the image capture end signal is a successive image capture end signal.
  23. The remote controller of claim 22, wherein the predetermined period of time is a difference between a time corresponding to an image displayed on the camera and an image displayed on the remote controller of the camera, which transmits the successive image capture start signal to the camera.
  24. The remote controller of claim 23, wherein a time lag between images displayed on the camera and the remote controller is based on a sum of a time delay due to transmission of a signal from the remote controller to the camera, a time delay due to the encoding operation in the camera, a time delay due to transmission of an image from the camera to the remote controller, and a time delay due to the decoding operation in the remote controller.
  25. The remote controller of claim 23, further comprising a button unit, which generates the successive image capture start signal and the successive image capture end signal according to a predetermined push signal,
    wherein the transmitting unit transmits the successive image capture start signal to the camera when a push signal, which is generated as a predetermined image capture button of the remote controller is pushed, is received, and
    the transmitting unit transmits the successive image capture end signal to the camera when reception of the push signal is completed.
  26. The remote controller of claim 23, wherein the receiving unit receives at least one image captured within a predetermined period of time from a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the successive image capture end signal.
  27. A camera comprising:
    a receiving unit, which receives an image capture start signal and an image capture end signal from a remote controller of the camera;
    an image capturing unit, which successively captures images after the image capture start signal is received until the image capture end signal is received; and
    a control unit, which selects an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
  28. The camera of claim 27, wherein the image capture start signal is a successive image capture start signal, and the image capture end signal is a successive image capture end signal.
  29. The camera of claim 28, wherein the predetermined period of time is a difference between a time corresponding to an image displayed on the camera and an image displayed on the remote controller of the camera, which transmits a successive image capture start signal to the camera.
  30. The camera of claim 29, wherein a time lag between images displayed on the camera and the remote controller is based on a sum of a time delay due to transmission of a signal from the remote controller to the camera, a time delay due to the encoding operation in the camera, a time delay due to transmission of an image from the camera to the remote controller, and a time delay due to the decoding operation in the remote controller.
  31. The camera of claim 28, wherein the transmitting unit transmits the selected image to the remote controller.
  32. The camera of claim 31, wherein the control unit selects at least one image captured within a predetermined period of time from a time, which is calculated by subtracting a sum of time delays from a time at which the camera has received the successive image capture end signal.
  33. The camera of claim 27, wherein the control unit encodes an image to be streamed in real time to an image of a lower resolution, and
    the transmitting unit transmits the encoded image to the remote controller.
  34. The camera of claim 27, wherein the transmitting unit transmits the selected image via e-mail based on information in a stored address book.
  35. The camera of claim 27, wherein the camera requests a predetermined address book to the remote controller, and
    the camera transmits the selected image via the transmitting unit via e-mail based on information in the stored address book received from the remote controller.
  36. The camera of claim 27, further comprising a storage unit for storing the selected image in a predetermined storage unit.
  37. A remote controller of a camera, the remote controller comprising:
    a transmitting unit, which transmits a first image capture signal to the camera and transmits a second image capture signal to the camera;
    receiving a JPEG image captured at a time which is a predetermined period of time prior to a time at which the second image capture signal is received.
  38. A camera comprising:
    a receiving unit, which receives a first image capture signal and a second image capture signal from a remote controller of a camera; and
    a control unit, which encodes an image displayed on the camera by using a motion JPEG encoding method and transmitting the encoded image to the remote controller and, when a second image capture signal is received from the remote controller, selects a JPEG image captured at a time which is a predetermined period of time prior to a time at which the second image capture signal is received.
  39. A remote controller of a camera, the remote controller comprising:
    a transmitting unit, which transmits a motion picture capture start signal to a camera; and
    a receiving unit, which receives a real time stream of a motion picture captured by the camera and receives an image file generated by converting a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, extracted from the captured motion picture.
  40. A camera comprising:
    a receiving unit, which receives a motion picture capture start signal and a stil image capture signal from a remote controller of the camera;
    an image capturing unit, which captures a motion picture when the motion picture capture start signal is received from the remote controller;
    a control unit, which, when the still image capture signal is received, extracts a frame corresponding to a time which is a predetermined period of time prior to a time, at which the still image capture signal is received, from the captured motion picture and converts the frame to an image file.
  41. A computer readable recording medium having recorded thereon a computer program for implementing the method of providing an image, the method comprising:
    transmitting an image capture start signal to a camera;
    transmitting an image capture end signal to the camera; and
    receiving an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
  42. A computer readable recording medium having recorded thereon a computer program for implementing the method of providing an image, the method comprising:
    receiving an image capture start signal from a remote controller of the camera;
    successively capturing images after the image capture start signal is received;
    receiving an image capture end signal from the remote controller; and
    selecting an image captured at a time which is a predetermined period of time prior to a time at which the image capture end signal is received.
PCT/KR2010/007961 2009-11-13 2010-11-11 Method and apparatus for providing image in camera or remote-controller for camera WO2011059246A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2009-0109545 2009-11-13
KR20090109545 2009-11-13
KR10-2010-0110959 2010-11-09
KR1020100110959A KR101725888B1 (en) 2009-11-13 2010-11-09 Method and apparatus for providing image in camera or remote-controller for camera

Publications (2)

Publication Number Publication Date
WO2011059246A2 true WO2011059246A2 (en) 2011-05-19
WO2011059246A3 WO2011059246A3 (en) 2011-10-20

Family

ID=43498615

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2010/007961 WO2011059246A2 (en) 2009-11-13 2010-11-11 Method and apparatus for providing image in camera or remote-controller for camera

Country Status (6)

Country Link
US (3) US20110115932A1 (en)
EP (2) EP2963916B1 (en)
JP (2) JP2011109657A (en)
KR (1) KR101725888B1 (en)
CN (2) CN104935818A (en)
WO (1) WO2011059246A2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10044939B2 (en) 2014-09-19 2018-08-07 Sony Interactive Entertainment LLC Systems and methods for camera operation through control device
US11445102B2 (en) 2018-08-31 2022-09-13 Sony Corporation Information processing device and information processing method

Families Citing this family (76)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9124436B2 (en) 2010-12-16 2015-09-01 Cellco Partnership Intelligent automated data usage upgrade recommendation
US9043455B1 (en) 2011-04-06 2015-05-26 Cellco Partnership Universal data remote
US9723092B1 (en) * 2011-04-07 2017-08-01 Cellco Partnership Universal data remote application framework
US8994650B2 (en) * 2012-04-27 2015-03-31 Qualcomm Incorporated Processing image input to communicate a command to a remote display device
DE112013002409T5 (en) 2012-05-09 2015-02-26 Apple Inc. Apparatus, method and graphical user interface for displaying additional information in response to a user contact
DE112013002412T5 (en) 2012-05-09 2015-02-19 Apple Inc. Apparatus, method and graphical user interface for providing feedback for changing activation states of a user interface object
DE112013002387T5 (en) 2012-05-09 2015-02-12 Apple Inc. Apparatus, method and graphical user interface for providing tactile feedback for operations in a user interface
WO2013169842A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for selecting object within a group of objects
WO2013169849A2 (en) 2012-05-09 2013-11-14 Industries Llc Yknots Device, method, and graphical user interface for displaying user interface objects corresponding to an application
WO2013169865A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input
WO2013169851A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for facilitating user interaction with controls in a user interface
AU2013259642A1 (en) 2012-05-09 2014-12-04 Apple Inc. Device, method, and graphical user interface for moving and dropping a user interface object
EP2847660B1 (en) 2012-05-09 2018-11-14 Apple Inc. Device, method, and graphical user interface for selecting user interface objects
AU2013259630B2 (en) 2012-05-09 2016-07-07 Apple Inc. Device, method, and graphical user interface for transitioning between display states in response to gesture
WO2013169843A1 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for manipulating framed graphical objects
JP6213817B2 (en) * 2012-09-03 2017-10-18 パナソニックＩｐマネジメント株式会社 Electronic devices that can send images
KR101974820B1 (en) * 2012-09-10 2019-08-23 삼성전자주식회사 Method for controlling a device and device performing the same
JP6152947B2 (en) * 2012-12-27 2017-06-28 パナソニックＩｐマネジメント株式会社 Electronic devices that can communicate with other devices
KR102001332B1 (en) 2012-12-29 2019-07-17 애플 인크. Device, method, and graphical user interface for determining whether to scroll or select contents
WO2014105275A1 (en) 2012-12-29 2014-07-03 Yknots Industries Llc Device, method, and graphical user interface for forgoing generation of tactile output for a multi-contact gesture
EP2939095B1 (en) 2012-12-29 2018-10-03 Apple Inc. Device, method, and graphical user interface for moving a cursor according to a change in an appearance of a control icon with simulated three-dimensional characteristics
CN103945030B (en) * 2013-01-17 2017-06-30 信泰光学(深圳)有限公司 Modular appliance and its operating method
TWI510084B (en) * 2013-01-25 2015-11-21 Sintai Optical Shenzhen Co Ltd Combination apparatus and operating method thereof
EP2950518A4 (en) * 2013-01-28 2016-09-14 Nikon Corp Electronic device
WO2014143776A2 (en) 2013-03-15 2014-09-18 Bodhi Technology Ventures Llc Providing remote interactions with host device using a wireless device
KR102124017B1 (en) 2013-07-31 2020-06-17 삼성전자주식회사 Image photographing apparatus , user device and method for establishing communications between image photographing apparatus and user device
KR20150019710A (en) * 2013-08-14 2015-02-25 삼성전자주식회사 Photographing apparatus and method
JP5541430B1 (en) 2013-08-19 2014-07-09 ソニー株式会社 Imaging unit, mounting device
JP5527492B1 (en) * 2013-08-19 2014-06-18 ソニー株式会社 Imaging apparatus, control method, and program
JP6195065B2 (en) * 2013-10-11 2017-09-13 リコーイメージング株式会社 Image capturing apparatus, operation control terminal apparatus, operation control program, and operation control system
CN103607536B (en) * 2013-10-29 2019-07-12 北京智谷睿拓技术服务有限公司 The control method and camera of camera
KR20150078266A (en) * 2013-12-30 2015-07-08 삼성전자주식회사 Digital Photographing Apparatus And Method for Controlling the Same
US10225454B2 (en) * 2014-05-19 2019-03-05 Sony Corporation Information processing apparatus, information processing method, and information processing system
JP6433151B2 (en) * 2014-05-20 2018-12-05 キヤノン株式会社 Video supply device, video acquisition device, control method thereof, and video supply system
EP3195098A2 (en) 2014-07-21 2017-07-26 Apple Inc. Remote user interface
CN106537891B (en) * 2014-08-12 2020-09-04 索尼公司 Information processing apparatus, program, and information processing method
US9742977B2 (en) 2014-09-02 2017-08-22 Apple Inc. Camera remote control
US9547419B2 (en) 2014-09-02 2017-01-17 Apple Inc. Reduced size configuration interface
US9451144B2 (en) * 2014-09-02 2016-09-20 Apple Inc. Remote camera user interface
WO2016067363A1 (en) * 2014-10-28 2016-05-06 楽天株式会社 Information processing device, information processing method, program, and storage medium
JP6415286B2 (en) * 2014-12-08 2018-10-31 キヤノン株式会社 Imaging device, control method thereof, and program
US10334085B2 (en) 2015-01-29 2019-06-25 Splunk Inc. Facilitating custom content extraction from network packets
US9632664B2 (en) 2015-03-08 2017-04-25 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US9645732B2 (en) 2015-03-08 2017-05-09 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US10216351B2 (en) 2015-03-08 2019-02-26 Apple Inc. Device configuration user interface
US10048757B2 (en) 2015-03-08 2018-08-14 Apple Inc. Devices and methods for controlling media presentation
US10095396B2 (en) 2015-03-08 2018-10-09 Apple Inc. Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object
US9639184B2 (en) 2015-03-19 2017-05-02 Apple Inc. Touch input cursor manipulation
US20170045981A1 (en) 2015-08-10 2017-02-16 Apple Inc. Devices and Methods for Processing Touch Inputs Based on Their Intensities
CN108353126B (en) 2015-04-23 2019-08-23 苹果公司 Handle method, electronic equipment and the computer readable storage medium of the content of camera
US10346030B2 (en) 2015-06-07 2019-07-09 Apple Inc. Devices and methods for navigating between user interfaces
US9891811B2 (en) 2015-06-07 2018-02-13 Apple Inc. Devices and methods for navigating between user interfaces
US9830048B2 (en) 2015-06-07 2017-11-28 Apple Inc. Devices and methods for processing touch inputs with instructions in a web page
US9860451B2 (en) 2015-06-07 2018-01-02 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US10200598B2 (en) * 2015-06-07 2019-02-05 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9880735B2 (en) 2015-08-10 2018-01-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10235035B2 (en) 2015-08-10 2019-03-19 Apple Inc. Devices, methods, and graphical user interfaces for content navigation and manipulation
JP6399358B2 (en) * 2015-08-31 2018-10-03 カシオ計算機株式会社 Imaging apparatus, recording instruction apparatus, image recording method, recording instruction method, and program
CN105120099A (en) * 2015-08-31 2015-12-02 小米科技有限责任公司 Shooting control method and device
JP6700923B2 (en) * 2016-04-06 2020-05-27 キヤノン株式会社 Communication device, control method thereof, and program
US10009536B2 (en) 2016-06-12 2018-06-26 Apple Inc. Applying a simulated optical effect based on data received from multiple camera sensors
US11112964B2 (en) 2018-02-09 2021-09-07 Apple Inc. Media capture lock affordance for graphical user interface
US10887193B2 (en) 2018-06-03 2021-01-05 Apple Inc. User interfaces for updating network connection settings of external devices
DK201870623A1 (en) 2018-09-11 2020-04-15 Apple Inc. User interfaces for simulated depth effects
US10674072B1 (en) 2019-05-06 2020-06-02 Apple Inc. User interfaces for capturing and managing visual media
US11770601B2 (en) 2019-05-06 2023-09-26 Apple Inc. User interfaces for capturing and managing visual media
US11321857B2 (en) 2018-09-28 2022-05-03 Apple Inc. Displaying and editing images with depth information
US11128792B2 (en) 2018-09-28 2021-09-21 Apple Inc. Capturing and displaying images with multiple focal planes
US20200280761A1 (en) * 2019-03-01 2020-09-03 Pelco, Inc. Automated measurement of end-to-end latency of video streams
EP3827323B1 (en) 2019-05-06 2023-12-13 Apple Inc. Restricted operation of an electronic device
US11706521B2 (en) 2019-05-06 2023-07-18 Apple Inc. User interfaces for capturing and managing visual media
DK201970533A1 (en) 2019-05-31 2021-02-15 Apple Inc Methods and user interfaces for sharing audio
JP7287146B2 (en) * 2019-06-25 2023-06-06 大日本印刷株式会社 photography system
DE102019134009B3 (en) * 2019-12-11 2021-04-29 Arnold & Richter Cine Technik Gmbh & Co. Betriebs Kg Digital motion picture camera
US11039074B1 (en) 2020-06-01 2021-06-15 Apple Inc. User interfaces for managing media
US11212449B1 (en) 2020-09-25 2021-12-28 Apple Inc. User interfaces for media capture and management

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11261875A (en) * 1998-03-11 1999-09-24 Matsushita Electric Ind Co Ltd Digital camera remote controller
US20030083048A1 (en) * 2001-10-26 2003-05-01 Eastman Kodak Company Supply of geolocalized digital images to a user
JP2004096165A (en) * 2002-08-29 2004-03-25 Nikon Corp Electronic camera and electronic camera system
KR20050041673A (en) * 2003-10-31 2005-05-04 엘지전자 주식회사 Digital camera remote control systen and method

Family Cites Families (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5434829A (en) * 1977-08-23 1979-03-14 Canon Inc Cine camera with warning device for anomaly
JPH09113988A (en) * 1995-10-24 1997-05-02 Nikon Corp Remotely controllable camera
US6441854B2 (en) * 1997-02-20 2002-08-27 Eastman Kodak Company Electronic camera with quick review of last captured image
US6172605B1 (en) * 1997-07-02 2001-01-09 Matsushita Electric Industrial Co., Ltd. Remote monitoring system and method
JP2000023015A (en) 1998-07-03 2000-01-21 Fuji Photo Film Co Ltd Electronic camera system
JP2001103359A (en) * 1999-09-30 2001-04-13 Canon Inc Communication unit, image pickup device, communication system, communication method and storage medium
US6809759B1 (en) * 2000-06-19 2004-10-26 Benq Corporation Remote control unit with previewing device for an image-capturing device
US6961082B2 (en) * 2000-11-16 2005-11-01 Fujitsu Limited Image display control system reducing image transmission delay
WO2003013140A1 (en) * 2001-07-25 2003-02-13 Stevenson Neil J A camera control apparatus and method
US20030043292A1 (en) * 2001-08-31 2003-03-06 Pyle Norman C. System and method for automatic capture of light producing scenes
TW533735B (en) * 2001-10-11 2003-05-21 Primax Electronics Ltd Image-capturing system with remote functionality of changing capturing angle
JP4295948B2 (en) 2002-02-19 2009-07-15 ソニー株式会社 Imaging system, imaging apparatus, and imaging method
US20030160873A1 (en) * 2002-02-26 2003-08-28 Tecu Kirk Steven Image capturing device that learns a wireless remote control
KR100976693B1 (en) * 2002-08-12 2010-08-18 교세라 가부시키가이샤 Communication terminal with imaging function and program for the communication terminal
JP2004096166A (en) 2002-08-29 2004-03-25 Nikon Corp Electronic camera and electronic camera system
US20040070679A1 (en) * 2002-10-15 2004-04-15 Pope David R. Compensating for delays inherent in digital still camera imaging
US7252633B2 (en) * 2002-10-18 2007-08-07 Olympus Corporation Remote controllable endoscope system
US7327890B2 (en) * 2002-12-20 2008-02-05 Eastman Kodak Company Imaging method and system for determining an area of importance in an archival image
US7301562B2 (en) * 2003-02-06 2007-11-27 Eastman Kodak Company Imaging system with delayed verification image presentation
JP4103683B2 (en) 2003-05-29 2008-06-18 カシオ計算機株式会社 Captured image transmitting apparatus and program
US7469064B2 (en) * 2003-07-11 2008-12-23 Panasonic Corporation Image display apparatus
KR100565275B1 (en) * 2003-07-11 2006-03-30 엘지전자 주식회사 Remote picture-taking apparatus and method for a camera phone
JPWO2005013620A1 (en) * 2003-08-01 2006-09-28 合資会社 コバルト Remote monitoring system
US20060268122A1 (en) * 2003-09-01 2006-11-30 Mariko Iwasaki Camera having transmission function, mobile telephone device, and image data acquiring/transmitting program
KR100557858B1 (en) * 2003-09-27 2006-03-10 학교법인 인하학원 Apparatus and method for extracting the representative still images from MPEG video
JP2006013881A (en) * 2004-06-25 2006-01-12 Inst For Information Industry Remote control system with image display, and its using method
US8289399B2 (en) * 2004-08-09 2012-10-16 Hewlett-Packard Development Company, L.P. System and method for image capture device
JP2006101466A (en) * 2004-09-03 2006-04-13 Nikon Corp Digital still camera
US20060146122A1 (en) * 2004-10-25 2006-07-06 Mcdonald Chad System for remotely capturing and storing images for multiple users in a centralized image management center
JP2006135587A (en) 2004-11-05 2006-05-25 Fuji Photo Film Co Ltd Photographing system, photographing apparatus, and auxiliary apparatus
JP4522344B2 (en) 2004-11-09 2010-08-11 キヤノン株式会社 Imaging apparatus, control method thereof, and program thereof
US20060176364A1 (en) * 2005-01-26 2006-08-10 Inventec Appliances Corp. Mobile communication apparatus capable of automatically capturing image data and method for automatically capturing image data thereof
US7751614B2 (en) * 2005-05-16 2010-07-06 Fujifilm Corporation Album creating apparatus, album creating method, and album creating program
JP4612866B2 (en) * 2005-05-20 2011-01-12 キヤノン株式会社 Imaging method and imaging system
JP4612865B2 (en) * 2005-05-20 2011-01-12 キヤノン株式会社 Imaging apparatus and power supply control method thereof
TW200700878A (en) * 2005-06-27 2007-01-01 Lite On Technology Corp Image capturing apparatus with a remote controller
US7379664B2 (en) * 2005-07-26 2008-05-27 Tinkers & Chance Remote view and controller for a camera
US20070109417A1 (en) * 2005-11-16 2007-05-17 Per Hyttfors Methods, devices and computer program products for remote control of an image capturing device
JP4668056B2 (en) 2005-12-19 2011-04-13 シャープ株式会社 Remote camera device, remote camera operation device, and data generation device
JP4567593B2 (en) * 2005-12-27 2010-10-20 三星デジタルイメージング株式会社 Imaging apparatus and imaging method
US20070153713A1 (en) * 2005-12-29 2007-07-05 Akseli Anttila Transmission of media content stream
JP2008154132A (en) * 2006-12-20 2008-07-03 Matsushita Electric Ind Co Ltd Audio/video stream compression apparatus and audio/video recording device
JP4771481B2 (en) 2007-02-15 2011-09-14 ソニー・エリクソン・モバイルコミュニケーションズ株式会社 Remote shooting system, portable terminal and computer program
US7701362B2 (en) * 2007-02-16 2010-04-20 Precise Flight, Inc. Optical system for detecting an object
US7729602B2 (en) * 2007-03-09 2010-06-01 Eastman Kodak Company Camera using multiple lenses and image sensors operable in a default imaging mode
JP5009847B2 (en) * 2008-03-28 2012-08-22 富士フイルム株式会社 Stereo image generating apparatus and method, and program
US8098297B2 (en) * 2008-09-03 2012-01-17 Sony Corporation Pre- and post-shutter signal image capture and sort for digital camera
US8194152B2 (en) * 2008-09-05 2012-06-05 CSR Technology, Inc. Image processing under flickering lighting conditions using estimated illumination parameters
US8624998B2 (en) * 2009-06-05 2014-01-07 Apple Inc. Camera image selection based on detected device movement

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11261875A (en) * 1998-03-11 1999-09-24 Matsushita Electric Ind Co Ltd Digital camera remote controller
US20030083048A1 (en) * 2001-10-26 2003-05-01 Eastman Kodak Company Supply of geolocalized digital images to a user
JP2004096165A (en) * 2002-08-29 2004-03-25 Nikon Corp Electronic camera and electronic camera system
KR20050041673A (en) * 2003-10-31 2005-05-04 엘지전자 주식회사 Digital camera remote control systen and method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10044939B2 (en) 2014-09-19 2018-08-07 Sony Interactive Entertainment LLC Systems and methods for camera operation through control device
US11445102B2 (en) 2018-08-31 2022-09-13 Sony Corporation Information processing device and information processing method

Also Published As

Publication number Publication date
EP2963916A3 (en) 2016-04-06
US10057490B2 (en) 2018-08-21
WO2011059246A3 (en) 2011-10-20
US20130265452A1 (en) 2013-10-10
KR101725888B1 (en) 2017-04-13
JP2016001927A (en) 2016-01-07
US20110115932A1 (en) 2011-05-19
EP2963916B1 (en) 2021-06-23
CN102065220A (en) 2011-05-18
KR20110053191A (en) 2011-05-19
JP6240642B2 (en) 2017-11-29
CN104935818A (en) 2015-09-23
US20130265455A1 (en) 2013-10-10
EP2963916A2 (en) 2016-01-06
JP2011109657A (en) 2011-06-02
EP2334050A3 (en) 2012-01-11
EP2334050A2 (en) 2011-06-15

Similar Documents

Publication Publication Date Title
WO2011059246A2 (en) Method and apparatus for providing image in camera or remote-controller for camera
JP3839526B2 (en) Digital camera
JP4612866B2 (en) Imaging method and imaging system
TWI338501B (en)
JPH09289631A (en) Image pickup control method and device, image pickup system and storage medium storing program to execute the method
KR101469838B1 (en) Image sensor and observing system having the same
KR101932539B1 (en) Method for recording moving-image data, and photographing apparatus adopting the method
WO2013073791A1 (en) Digital photographing apparatus and method of controlling continuous photographing thereof
JP5307577B2 (en) Intercom device
JP2009088666A (en) Image processor
JP2001145093A (en) Supervisory camera system and its controller
WO2013032165A1 (en) Network camera and photographing method thereof
JP4095171B2 (en) Wireless communication apparatus and control method thereof
WO2011105709A2 (en) High definition digital cctv system
TWI493445B (en) Video processing apparatus and method thereof
WO2021049703A1 (en) Surveillance camera system that allows client cameras to indirectly access other network services through server camera
JPH0951516A (en) Device for connection video camera and computer and video conference system using same
KR100549960B1 (en) Wireless network camera having a function of access point/bridge, and data processing method for cascade type in wireless camera
JP4514167B2 (en) Information communication apparatus, control method therefor, and computer-readable memory
TWI442771B (en) Method for processing multi-media stream and multi-media stream device with time-shift function
JP2005260540A (en) Network camera
JP4670782B2 (en) Image transfer device
JP2003174640A (en) Image photographing system, photographing apparatus, and photographing controller
WO2014046338A1 (en) Cctv image managing terminal and cctv image managing system
JP2000253388A (en) Video doorphone system

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10830178

Country of ref document: EP

Kind code of ref document: A2