WO2006083563A2 - Camera with acceleration sensor - Google Patents

Camera with acceleration sensor Download PDF

Info

Publication number
WO2006083563A2
WO2006083563A2 PCT/US2006/001816 US2006001816W WO2006083563A2 WO 2006083563 A2 WO2006083563 A2 WO 2006083563A2 US 2006001816 W US2006001816 W US 2006001816W WO 2006083563 A2 WO2006083563 A2 WO 2006083563A2
Authority
WO
WIPO (PCT)
Prior art keywords
camera
orientation
accelerometer
peak
determining
Prior art date
Application number
PCT/US2006/001816
Other languages
French (fr)
Other versions
WO2006083563A3 (en
Inventor
Harvey Weinberg
Christophe Lemaire
Howard Samuels
Michael Judy
Original Assignee
Analog Devices, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Analog Devices, Inc. filed Critical Analog Devices, Inc.
Publication of WO2006083563A2 publication Critical patent/WO2006083563A2/en
Publication of WO2006083563A3 publication Critical patent/WO2006083563A3/en

Links

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/02Bodies
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/18Signals indicating condition of a camera member or suitability of light
    • G03B17/20Signals indicating condition of a camera member or suitability of light visible in viewfinder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/65Control of camera operation in relation to power supply
    • H04N23/651Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • H04N23/684Vibration or motion blur correction performed by controlling the image sensor readout, e.g. by controlling the integration time

Definitions

  • the invention generally relates to cameras and, more particularly, the invention relates to detecting motion of a camera.
  • a digital camera could use this information to store the image such that it displays "right side up” on a computer display.
  • Ball and cage type mechanical switches can be used to ascertain orientation, but they have reliability problems.
  • a digital camera includes an accelerometer mounted on the camera.
  • the accelerometer measures camera movement and/or orientation. In various embodiments of the invention, this information can be used to:
  • the accelerometer provides orientation information for the camera with respect to the earth's gravity. This orientation information allows an artificial horizon indicator to be displayed on an image on a display surface, such as a viewfinder display attached to the camera. The user views the artificial horizon indicator and may realign the camera based on the relationship between the image and the indicator.
  • the accelerometer provides orientation information for the camera with respect to the earth's gravity. Icons consisting of text and/or graphics are displayed on an image produced by the camera in a "right side up" orientation based on the camera orientation information received from the accelerometer. The image may be displayed on a viewfinder display or on a printed image of a picture.
  • a further embodiment of the invention adjusts image exposure time for a camera to reduce movement-induced image blurring.
  • An accelerometer mounted to the camera provides acceleration information. The information is stored and peak-to-peak acceleration magnitude is calculated for the most recent time period. When picture taking is initiated, a minimum shutter speed is calculated as a function of the peak-to-peak acceleration magnitude over the most recent time period and the focal length of the camera. The exposure time of the picture may be adjusted accordingly.
  • Another embodiment of the invention determines if a camera is in use using camera orientation and camera movement information calculated from the outputs of the accelerometer. If a camera is determined not to be in use, elements of the camera can be placed in a low-power state and reenergized when the camera usage changes.
  • Fig. IA shows a simplified perspective view of the front of a camera, according to an embodiment of the present invention
  • Fig. IB shows a plan view of the rear of the camera of fig. IA;
  • Fig. 2 A shows schematically typical accelerometer outputs for two orientations of the camera of fig. 1;
  • Fig. 2B shows possible orientation of the camera body vector relative to earth's gravity vector for orienting text and graphics, according to an embodiment of the invention.
  • Fig. 3 schematically shows a circuit for controlling a camera according to embodiments of the present invention
  • Fig. 4 illustrates right-side-up graphics on a camera viewf ⁇ nder, generated by an embodiment of the invention
  • Fig. 5 is a flow diagram for an illustrative method of using orientation information to display "right side up" graphics on a picture image, according to an embodiment of the invention
  • Fig. 6 illustrates display of an artificial horizon indicator to aid in framing a picture, according to an embodiment of the invention
  • Fig. 7 is a flow diagram for an illustrative method of using orientation information to create an artificial horizon indicator on a display to aid in framing a picture, according to an embodiment of the invention
  • Fig. 8 is a flow diagram for a method of using vibration data to determine minimum shutter speed, according to an embodiment of the invention.
  • Fig. 9 is a flow diagram for a method of using orientation and vibration data to determine when a camera is in use, according to an embodiment of the invention.
  • an accelerometer can be used to determine the static orientation of a camera by measuring the direction of the earth gravity's (gravity vector) relative to the camera body.
  • Other embodiments of the invention use an accelerometer to detect the dynamic movement of a camera. Orientation and/or dynamic movement information for a camera enable a variety of functions. Several such functions are discussed below in separate sections.
  • Fig. IA is a simplified perspective view of the front of an exemplary camera 10, according to an embodiment of the invention.
  • the camera 10 includes a lens 12 with a lens aperture 14.
  • a viewfinder window 16 allows a user to frame a picture. Pressing a shutter switch 18 initiates picture taking.
  • Fig. IB shows a plan view of the rear of the camera. The user looks into the viewfinder window 16 and adjusts the camera's orientation to frame the picture. Alternatively, the user may look at a viewfinder display screen 18 on the back of the camera to frame the picture.
  • a "viewfinder,” “viewfinder window” or a “viewfinder display” shall mean any visual display employed in a camera to aid in framing a picture.
  • a circuit board 22 which contains processing logic (e.g., microprocessor, ASICs, etc.) to control camera functions.
  • processing logic e.g., microprocessor, ASICs, etc.
  • accelerometers 20 mounted internal to the camera body.
  • the accelerometer may be a microelectromechanical system (“MEMS") device or another type of accelerometer capable of measurement of orientation or movement, as needed for each of the functions described below.
  • MEMS microelectromechanical system
  • the accelerometer may be a dual-axis device, or a plurality of single-axis accelerometers may be used.
  • Fig. 2A shows a coordinate system applied to the camera of figs. 1 A-IB.
  • Fig. 3 is a schematic diagram of a circuit for controlling the camera 10 of figs. IA and IB, according to an embodiment of the invention.
  • the outputs of accelerometer 20 are voltage levels, Ax 21 and Ay 22, whose values correspond the magnitude of the acceleration along "X" and “Y” axes, respectively.
  • These accelerometer outputs are input to analog-to- digital converters 32 ("A/D"), which quantize the signals.
  • the A/D output 34 is input to processing logic 30.
  • the processing logic 30 may take a variety of forms, as are known in the art, including a microprocessor with memory and a stored program together with appropriate interface circuitry. Alternatively, the processing logic may take the form of dedicated logic elements ("ASIC") or the processing logic may be a mix of a microprocessor with dedicated logic elements.
  • ASIC dedicated logic elements
  • the output of a shutter switch 20 is input to the processing logic to allow a user to initiate picture taking.
  • the processing logic provides outputs signals to control the shutter 34, to control the lens aperture 35, and to generate displays on the viewfinder 36 and on a viewfinder display screen 37, 18.
  • the processing logic may also provide a variety of power conditioning outputs 38 to functional elements of the camera to put individual elements into a low power state.
  • the display on the viewfinder and on the display window may be formed by combining text and graphics generated by the processing logic with the output of an image sensor, as is known in the art.
  • the circuit elements for controlling the camera may take on other forms that provide similar functionality.
  • Other embodiments of the invention may not have every element shown in fig. 3. For example, if the camera does not include a viewfmder display screen 18 on the back of the camera, the processing logic need not provide an output 37 to it.
  • accelerometer(s) 20 help determine the orientation of the camera with respect to earth's gravity. Based upon this determination, text and graphics information that is normally overlaid on an image in the viewfinder, or on another display, can be automatically rotated to be "right side up" to the user, as the camera is oriented in various directions.
  • An example is shown in Fig. 4.
  • Camera 10 in the leftmost instance 40 is oriented in the portrait mode and the caption 44 in the viewfinder is oriented so that the text is upright for the longer dimension of the picture.
  • the caption in the viewfinder 46 is rotated to be upright for the shorter dimension of the picture.
  • caption 48 is again shown upright for the longer dimension of the picture 42.
  • the captions 44, 48 for the leftmost instance 40 and the rightmost instance 42 have opposite orientations with respect to the camera body, but the same orientation with respect to the image. This occurs because the camera body is rotated 180 degrees between the leftmost and rightmost instances.
  • captions such as the date and time can be added to the image captured by the camera and the caption can be oriented so that it is "right side up.” That is, the caption on the image may be oriented so that it is opposite to the direction of the gravity vector for the camera's orientation, (i.e., pointing in an approximately vertical direction).
  • FIG. 5 shows a flow diagram 500 for user interface orientation according to an embodiment of the invention.
  • Outputs Ax 21, Ay 22 of the accelerometers 20 are sampled 510 to determine the orientation of the camera body vector 28 with respect to the earth's gravity vector 11.
  • An accelerometer(s) capable of measuring static (non- varying) accelerations along two axes is used.
  • Ax 0 is the value along the x-axis when the camera body vector is aligned, as shown in the upper drawing in fig. 2A;
  • Ay 0 is the value for the y-axis for alignment of camera body vector 28 perpendicular to the gravity vector, as shown in the lower drawing in fig. 2).
  • the orientation of the camera body vector 28 with respect to the gravity vector 11 is resolved 520 into one of four quadrants (24, 25, 26, 27) shown in fig. 2B. Text and graphics are then oriented 530, 540 as follows on the display:
  • Text and graphics captions are rendered 530, 540 in the viewfinder display (e.g., 44, 46, 48) with the orientation so that it most nearly matches the direction that is upright (i.e., opposite to the direction of the gravity vector).
  • the process is repeated 550 so that as the camera body is reoriented, the orientation of the text and graphic captions in the viewfinder display track the orientation of the camera with respect to the gravity vector. In specific embodiments of the invention, this process is repeated at a set time interval.
  • a further embodiment of the invention produces an artificial horizon display in the camera viewfinder based upon the gravity vector 11.
  • the artificial horizon enables the picture to be framed so that one edge is parallel to the surface of the Earth.
  • an "artificial horizon" indicator 64 can be displayed in the viewfinder display 60 as a dashed line to aid the user in framing the photograph. The user can then rotate the camera to align the artificial horizon indicator 64 with the subject.
  • the "artificial horizon" indicator can be reoriented in the viewfinder based on the gross orientation of the camera (portrait or landscape), as determined from the accelerometer outputs. This determination would be similar to that shown above for the "user interface orientation" embodiment of the invention.
  • Fig. 7 shows a flow diagram 700 for display of an artificial horizon on a camera viewfinder display according an embodiment of the invention.
  • Outputs Ax 21, Ay 22 of the accelerometers 20 are sampled 710 to determine the orientation of the camera body with respect to the earth's gravity vector 11.
  • the same accelerometer arrangement and calculations 720 may be used to determine camera body vector 28 orientation relative to the earth's gravity vector 11, as described above for the "right-side up" caption display embodiment of the invention.
  • An artificial horizon vector 64 is rendered 730 on the camera viewfinder display as a dashed line based on the determined camera orientation.
  • a reference vector 62 aligned with the viewfinder edge may also be displayed to aid in framing the picture.
  • the misalignment of the two vectors is exaggerated in fig. 6 to illustrate the concept.
  • the process is repeated 740 so that as the camera body moves, the orientation of the artificial horizon vector in the viewfinder display tracks the orientation of the camera with respect to the gravity vector.
  • the repetition rate of the process may be determined by a time interval.
  • the display of the artificial horizon may take other forms besides a vector. All such displays are intended to be within the scope of the present invention and will be referred to below, including in the appended claims as an "artificial horizon indicator.”
  • camera vibration is used as one input (along with lighting conditions) to determine image exposure values.
  • An accelerometer mounted to a camera measures the vibration (i.e., acceleration variation) experienced by the camera for a few hundred milliseconds before exposure to determine an appropriate minimum shutter speed to ensure a sharp picture.
  • the minimum shutter speed would be 1/20 second.
  • a table of minimum shutter speeds is calculated according to equation (2) and a table look-up can then be performed to determine minimum shutter speed.
  • the outputs of an accelerometer are connected to the input of an analog-to-digital ("A/D") converter 32.
  • the output of the A/D converter is connected to processing logic 30.
  • the accelerometer needs to measure dynamic acceleration, but need not measure orientation.
  • the processing logic 30 periodically receives 810 the outputs of the A/D converter 32 and stores the A/D converter outputs and time of observation 820.
  • the peak-to-peak acceleration magnitude is calculated 840 for the preceding time interval based on the stored accelerometer values. Values older than the most recent time interval may be discarded.
  • the minimum shutter speed, 850, 860 is then determined from equation 2.
  • the peak-to-peak acceleration magnitude is calculated for more than one axis. The larger of the values of peak-to-peak acceleration magnitude for the respective axes is then used for the minimum shutter speed calculations.
  • the time interval over which the peak-to-peak acceleration magnitude is determined may range from about 100 milliseconds to about 500 milliseconds.
  • Other embodiments of the invention use accelerometers to determine if a camera is in use. For example, a camera oriented such that the lens is pointing up and experiencing very little vibration is likely set on a table and is not about to take a picture. To that end, such embodiments use an accelerometer to measure the orientation of the camera and to measure vibration. These measurements are used to determine whether the camera is in use. The determination of camera use, in turn, can be used to perform tasks to improve camera function, such as reducing power consumption.
  • the orientation of the camera and peak-to-peak acceleration magnitude over a given duration are determined, as described in connection with the preceding embodiments of the invention. These values are then used to determine camera use.
  • An exemplary algorithm for determining camera use is shown in fig. 9.
  • First accelerometer outputs are read 910.
  • accelerometers to determine static acceleration (orientation) and dynamic acceleration Ax, Ay, Az along three orthogonal axes are provided. In other embodiments less than three axes may be sensed.
  • the absolute magnitude along an axis aligned with the camera lens, Az, is measured 920 to determine if the magnitude is approximately equal to one g.
  • the camera is not face up or face down, and the peak-to-peak magnitude of the acceleration (vibration) for the preceding ten seconds is compared to 15 mg. If vibration exceeds 15 mg, the camera is determined to be in use. The accelerometer outputs are then read again 910 and the process repeated. If the absolute magnitude along an axis aligned with the camera lens, Az, is approximately equal to one g 920, then the camera is face up or face down. The peak-to-peak magnitude of the acceleration (vibration) for the preceding three seconds is compared 930 to 15 mg. If vibration exceeds 15 mg, the camera is determined to be in use. The accelerometer outputs will the be read again 910 and the process repeated.
  • the camera is determined to be idle and the camera may enter 950 a "sleep" mode.
  • sleep mode the accelerometer outputs are measured periodically 960. If the vibration equals or exceeds 50 mg, the camera has been picked up and the camera enters a "wake-up" state 980. The process then repeats 910.
  • the values for vibration magnitude and duration in this algorithm are provided for example only, and not by way of limitation. Other time duration thresholds and vibration magnitude thresholds may be used in other embodiments of the invention.
  • processing logic 30 place elements of the camera into a low power state.
  • Embodiments of the invention can use a wide variety of accelerometers.
  • the accelerometer may be similar to that disclosed by U.S. Patent Number 5,939,633, which is assigned to Analog Devices, Inc. of Norwood, Massachusetts, the disclosure of which is incorporated herein, in its entirety, by reference. Accelerometers implementing non-MEMS technologies also may be used in other embodiments. Accordingly, discussion of MEMS accelerometers is by way of example only.
  • a camera system for aligning a camera to the Earth' horizon comprising: a camera including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera with respect to gravity using the accelerometer; and display an artificial horizon indicator on the viewfinder display based on the determined orientation of the camera.
  • a camera system for orienting icons displayed in a camera viewfinder comprising: a camera including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera with respect to gravity using the accelerometer; and display a given icon on an image produced by the camera, wherein the given icon's orientation is based at least in part on the determination of the orientation of the camera using the accelerometer.
  • a camera system for adjusting image exposure time for a camera to reduce movement- induced image blurring comprising: the camera including an accelerometer mounted on the camera for determining camera movement; and a processor including a memory, the memory containing instructions that cause the processor to: measure a peak-to-peak acceleration magnitude using the accelerometer for a given time duration for the camera; adjust the image exposure time based at least in part on the peak-to-peak acceleration magnitude over the given time duration.
  • adjusting the image exposure time includes calculating a minimum shutter speed.
  • a camera system for determining a state of utilization for a camera comprising: a camera including an accelerometer mounted on the camera for determining an orientation of the camera with respect to gravity and a peak-to-peak acceleration magnitude over a given duration; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera using the accelerometer; determine a peak-to-peak acceleration magnitude over a given duration using the accelerometer; and identify the state of utilization for the camera based at least in part on the camera orientation determination and the peak-to-peak acceleration magnitude over a given duration.
  • a computer program product for use on a processor in a camera system, the camera system including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: determining an orientation of the camera with respect to gravity using the accelerometer; and displaying an artificial horizon indicator on the viewfinder display based on the determined orientation of the camera.
  • a computer program product for use on a processor in a camera system, the camera system including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: determining an orientation of the camera with respect to gravity using the accelerometer; and displaying a given icon on an image produced by the camera, wherein the given icon's orientation is based at least in part on the determination of the orientation of the camera using the accelerometer.
  • a computer program product for use on a processor in a camera system, the product for adjusting image exposure time for a camera to reduce movement-induced image blurring, the camera system including an accelerometer mounted on the camera for determining camera movement; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: measureing a peak-to-peak acceleration magnitude using the accelerometer for a given time duration for the camera; adjusting the image exposure time based at least in part on the peak-to-peak acceleration magnitude over the given time duration.
  • adjusting the image exposure time includes calculating a minimum shutter speed.
  • a computer program product for use on a processor in a camera system, the product for determining a state of utilization for the camera system, the camera system including an accelerometer mounted on the camera for determining camera movement and orientation; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for determining an orientation of the camera using the accelerometer; determining a peak-to-peak acceleration magnitude over a given duration using the accelerometer; and identifing the state of utilization for the camera based at least in part on the camera orientation determination and the peak-to-peak acceleration magnitude over a given duration.
  • Logic performing the processing functions may be partitioned into different logic blocks (e.g., programs, modules, functions, or subroutines) without changing the overall results or otherwise departing from the true scope of the invention.
  • logic elements may be added, modified, omitted, performed in a different order, or implemented using different logic constructs (e.g., logic gates, looping primitives, conditional logic, and other logic constructs) without changing the overall results or otherwise departing from the true scope of the invention.
  • the present invention may be embodied in many different forms, including, but in no way limited to, computer program logic for use with a processor (e.g., a microprocessor, microcontroller, digital signal processor, or general purpose computer), programmable logic for use with a programmable logic device (e.g., a Field Programmable Gate Array (FPGA) or other PLD), discrete components, integrated circuitry (e.g., an Application Specific Integrated Circuit (ASIC)), or any other means including any combination thereof.
  • a processor e.g., a microprocessor, microcontroller, digital signal processor, or general purpose computer
  • programmable logic for use with a programmable logic device
  • FPGA Field Programmable Gate Array
  • ASIC Application Specific Integrated Circuit
  • Source code may include a series of computer program instructions implemented in any of various programming languages (e.g., an object code, an assembly language, or a high-level language such as FORTRAN, C, C++, JAVA, or HTML) for use with various operating systems or operating environments.
  • the source code may define and use various data structures and communication messages.
  • the source code may be in a computer execustructure form (e.g., via an interpreter), or the source code may be converted (e.g., via a translator, assembler, or compiler) into a computer executable structure form.
  • the computer program may be fixed in any form (e.g., source code form, computer execustructure form, or an intermediate form) either permanently or transitorily in a tangible storage medium, such as a semiconductor memory device (e.g., a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM), a magnetic memory device (e.g., a diskette or fixed disk), an optical memory device (e.g., a CD-ROM), a PC card (e.g., PCMCIA card), or other memory device.
  • the computer program may be fixed in any form in a signal that is transmittable to a computer using any of various communication technologies, including, but in no way limited to, analog technologies, digital technologies, optical technologies, wireless technologies, networking technologies, and internetworking technologies.
  • the computer program may be distributed in any form as a removable storage medium with accompanying printed or electronic documentation (e.g., shrink wrapped software or a magnetic tape), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the communication system (e.g., the Internet or World Wide Web.)
  • printed or electronic documentation e.g., shrink wrapped software or a magnetic tape
  • a computer system e.g., on system ROM or fixed disk
  • a server or electronic bulletin board over the communication system (e.g., the Internet or World Wide Web.)
  • Hardware logic including programmable logic for use with a programmable logic device
  • implementing all or part of the functionality previously described herein may be designed using traditional manual methods, or may be designed, captured, simulated, or documented electronically using various tools, such as Computer Aided Design (CAD), a hardware description language (e.g., VHDL or AHDL), or a PLD programming language (e.g., PALASM, ABEL, or CUPL.)
  • CAD Computer Aided Design
  • a hardware description language e.g., VHDL or AHDL
  • PLD programming language e.g., PALASM, ABEL, or CUPL.

Abstract

A method and system for determining camera positioning information from an accelerometer mounted on a camera. The accelerometer measures the orientation of the camera with respect to gravity. Orientation measurement allows user interface information to be displayed in a 'right side up' orientation on a viewfinder for any camera orientation. Alternatively, an artificial horizon indicator may be displayed in the viewfinder. The accelerometer may also measure camera movement. Camera movement information together with camera orientation can be used to determine camera usage. Additionally, camera movement information can be used to determine a minimum shutter speed for a sharp picture.

Description

CAMERA WITH ACCELERATION SENSOR
Field of the Invention
The invention generally relates to cameras and, more particularly, the invention relates to detecting motion of a camera.
Background
In many cases, it is desirable to know the orientation of a camera. A digital camera, for example, could use this information to store the image such that it displays "right side up" on a computer display. Ball and cage type mechanical switches can be used to ascertain orientation, but they have reliability problems.
Summary of the Invention
In accordance with embodiments of the invention, a digital camera includes an accelerometer mounted on the camera. The accelerometer measures camera movement and/or orientation. In various embodiments of the invention, this information can be used to:
• display an artificial horizon indicator on a viewfinder to aid in orienting the camera;
• display icons on the viewfinder in a "right side up" orientation according to the camera's orientation;
• use camera movement information to determine a minimum shutter speed, to reduce motion-induced picture blurring; and
• use camera movement and orientation to determine if a camera is in use; such "in-use" information can be used, for example, to power down an idle camera or to power-up a camera that is about to be used.
In one embodiment, the accelerometer provides orientation information for the camera with respect to the earth's gravity. This orientation information allows an artificial horizon indicator to be displayed on an image on a display surface, such as a viewfinder display attached to the camera. The user views the artificial horizon indicator and may realign the camera based on the relationship between the image and the indicator.
In another embodiment of the invention, the accelerometer provides orientation information for the camera with respect to the earth's gravity. Icons consisting of text and/or graphics are displayed on an image produced by the camera in a "right side up" orientation based on the camera orientation information received from the accelerometer. The image may be displayed on a viewfinder display or on a printed image of a picture.
A further embodiment of the invention adjusts image exposure time for a camera to reduce movement-induced image blurring. An accelerometer mounted to the camera provides acceleration information. The information is stored and peak-to-peak acceleration magnitude is calculated for the most recent time period. When picture taking is initiated, a minimum shutter speed is calculated as a function of the peak-to-peak acceleration magnitude over the most recent time period and the focal length of the camera. The exposure time of the picture may be adjusted accordingly. Another embodiment of the invention determines if a camera is in use using camera orientation and camera movement information calculated from the outputs of the accelerometer. If a camera is determined not to be in use, elements of the camera can be placed in a low-power state and reenergized when the camera usage changes.
I
Brief Description of the Drawings The foregoing features of the invention will be more readily understood by reference to the following detailed description, taken with reference to the accompanying drawings, in which:
Fig. IA shows a simplified perspective view of the front of a camera, according to an embodiment of the present invention; Fig. IB shows a plan view of the rear of the camera of fig. IA;
Fig. 2 A shows schematically typical accelerometer outputs for two orientations of the camera of fig. 1;
Fig. 2B shows possible orientation of the camera body vector relative to earth's gravity vector for orienting text and graphics, according to an embodiment of the invention. Fig. 3 schematically shows a circuit for controlling a camera according to embodiments of the present invention;
Fig. 4 illustrates right-side-up graphics on a camera viewfϊnder, generated by an embodiment of the invention; Fig. 5 is a flow diagram for an illustrative method of using orientation information to display "right side up" graphics on a picture image, according to an embodiment of the invention;
Fig. 6 illustrates display of an artificial horizon indicator to aid in framing a picture, according to an embodiment of the invention; Fig. 7 is a flow diagram for an illustrative method of using orientation information to create an artificial horizon indicator on a display to aid in framing a picture, according to an embodiment of the invention;
Fig. 8 is a flow diagram for a method of using vibration data to determine minimum shutter speed, according to an embodiment of the invention; and Fig. 9 is a flow diagram for a method of using orientation and vibration data to determine when a camera is in use, according to an embodiment of the invention.
Detailed Description of Specific Embodiments
In various embodiments of the invention, an accelerometer can be used to determine the static orientation of a camera by measuring the direction of the earth gravity's (gravity vector) relative to the camera body. Other embodiments of the invention use an accelerometer to detect the dynamic movement of a camera. Orientation and/or dynamic movement information for a camera enable a variety of functions. Several such functions are discussed below in separate sections.
Fig. IA is a simplified perspective view of the front of an exemplary camera 10, according to an embodiment of the invention. The camera 10 includes a lens 12 with a lens aperture 14. A viewfinder window 16 allows a user to frame a picture. Pressing a shutter switch 18 initiates picture taking. Fig. IB shows a plan view of the rear of the camera. The user looks into the viewfinder window 16 and adjusts the camera's orientation to frame the picture. Alternatively, the user may look at a viewfinder display screen 18 on the back of the camera to frame the picture. In this description and in any appended claims, a "viewfinder," "viewfinder window" or a "viewfinder display" shall mean any visual display employed in a camera to aid in framing a picture. Mounted in the camera body may be a circuit board 22 which contains processing logic (e.g., microprocessor, ASICs, etc.) to control camera functions. Also mounted internal to the camera body is one or more accelerometers 20 to allow camera orientation and/or movement to be determined. The accelerometer may be a microelectromechanical system ("MEMS") device or another type of accelerometer capable of measurement of orientation or movement, as needed for each of the functions described below. As will be apparent, the accelerometer may be a dual-axis device, or a plurality of single-axis accelerometers may be used. Fig. 2A shows a coordinate system applied to the camera of figs. 1 A-IB. Earth's gravity is shown as a gravity vector 11 in the coordinate system, aligned along the "Y" axis. A "camera body vector" 28 is shown which is perpendicular to the long dimension of the camera. In exemplary embodiments, the orientation of the camera body vector 28 relative to the gravity vector 11 is determined from the outputs of the accelerometer. Fig. 3 is a schematic diagram of a circuit for controlling the camera 10 of figs. IA and IB, according to an embodiment of the invention. The outputs of accelerometer 20 are voltage levels, Ax 21 and Ay 22, whose values correspond the magnitude of the acceleration along "X" and "Y" axes, respectively. These accelerometer outputs are input to analog-to- digital converters 32 ("A/D"), which quantize the signals. The A/D output 34 is input to processing logic 30. The processing logic 30 may take a variety of forms, as are known in the art, including a microprocessor with memory and a stored program together with appropriate interface circuitry. Alternatively, the processing logic may take the form of dedicated logic elements ("ASIC") or the processing logic may be a mix of a microprocessor with dedicated logic elements. The output of a shutter switch 20 is input to the processing logic to allow a user to initiate picture taking. The processing logic provides outputs signals to control the shutter 34, to control the lens aperture 35, and to generate displays on the viewfinder 36 and on a viewfinder display screen 37, 18. The processing logic may also provide a variety of power conditioning outputs 38 to functional elements of the camera to put individual elements into a low power state. The display on the viewfinder and on the display window may be formed by combining text and graphics generated by the processing logic with the output of an image sensor, as is known in the art. In other embodiments of the invention, the circuit elements for controlling the camera may take on other forms that provide similar functionality. Other embodiments of the invention may not have every element shown in fig. 3. For example, if the camera does not include a viewfmder display screen 18 on the back of the camera, the processing logic need not provide an output 37 to it.
User Interface Orientation
In a first embodiment of the invention, accelerometer(s) 20 help determine the orientation of the camera with respect to earth's gravity. Based upon this determination, text and graphics information that is normally overlaid on an image in the viewfinder, or on another display, can be automatically rotated to be "right side up" to the user, as the camera is oriented in various directions. An example is shown in Fig. 4. Camera 10 in the leftmost instance 40 is oriented in the portrait mode and the caption 44 in the viewfinder is oriented so that the text is upright for the longer dimension of the picture. When the camera is rotated 90 degrees, to the landscape mode, as shown in the middle instance 41, the caption in the viewfinder 46 is rotated to be upright for the shorter dimension of the picture. When the camera is rotated an additional 90 degrees, the caption 48 is again shown upright for the longer dimension of the picture 42. Note that the captions 44, 48 for the leftmost instance 40 and the rightmost instance 42 have opposite orientations with respect to the camera body, but the same orientation with respect to the image. This occurs because the camera body is rotated 180 degrees between the leftmost and rightmost instances. In specific embodiments of the invention, captions such as the date and time can be added to the image captured by the camera and the caption can be oriented so that it is "right side up." That is, the caption on the image may be oriented so that it is opposite to the direction of the gravity vector for the camera's orientation, (i.e., pointing in an approximately vertical direction). Note that the camera's orientation (long dimension) will not, in general, align with the gravity vector (as in the leftmost instance in fig. 3) or perpendicular to it (as in the middle instance in fig. 3). For such intermediate situations, in embodiments of the invention, the caption will be oriented so that it is most nearly right side up. Fig. 5 shows a flow diagram 500 for user interface orientation according to an embodiment of the invention. Outputs Ax 21, Ay 22 of the accelerometers 20 are sampled 510 to determine the orientation of the camera body vector 28 with respect to the earth's gravity vector 11. An accelerometer(s) capable of measuring static (non- varying) accelerations along two axes is used. The angle θ between the camera body vector 28 and the gravity vector 11 is given by: θ = Arctan ((Ay- Ayo)/( Ax- Ax0)). (1)
(The output of the accelerometer along each axis has previously been calibrated for reference orientations of the camera body vector with respect to the gravity vector, yielding values of Ax0 and Ay0. Ax0 is the value along the x-axis when the camera body vector is aligned, as shown in the upper drawing in fig. 2A; Ay0 is the value for the y-axis for alignment of camera body vector 28 perpendicular to the gravity vector, as shown in the lower drawing in fig. 2).
The orientation of the camera body vector 28 with respect to the gravity vector 11 is resolved 520 into one of four quadrants (24, 25, 26, 27) shown in fig. 2B. Text and graphics are then oriented 530, 540 as follows on the display:
Figure imgf000008_0001
Text and graphics captions are rendered 530, 540 in the viewfinder display (e.g., 44, 46, 48) with the orientation so that it most nearly matches the direction that is upright (i.e., opposite to the direction of the gravity vector). The process is repeated 550 so that as the camera body is reoriented, the orientation of the text and graphic captions in the viewfinder display track the orientation of the camera with respect to the gravity vector. In specific embodiments of the invention, this process is repeated at a set time interval. Artificial Horizon Display
A further embodiment of the invention produces an artificial horizon display in the camera viewfinder based upon the gravity vector 11. The artificial horizon enables the picture to be framed so that one edge is parallel to the surface of the Earth. As shown in fig. 6, for example, an "artificial horizon" indicator 64 can be displayed in the viewfinder display 60 as a dashed line to aid the user in framing the photograph. The user can then rotate the camera to align the artificial horizon indicator 64 with the subject. Of course, the "artificial horizon" indicator can be reoriented in the viewfinder based on the gross orientation of the camera (portrait or landscape), as determined from the accelerometer outputs. This determination would be similar to that shown above for the "user interface orientation" embodiment of the invention.
Fig. 7 shows a flow diagram 700 for display of an artificial horizon on a camera viewfinder display according an embodiment of the invention. Outputs Ax 21, Ay 22 of the accelerometers 20 are sampled 710 to determine the orientation of the camera body with respect to the earth's gravity vector 11. The same accelerometer arrangement and calculations 720 may be used to determine camera body vector 28 orientation relative to the earth's gravity vector 11, as described above for the "right-side up" caption display embodiment of the invention. An artificial horizon vector 64 is rendered 730 on the camera viewfinder display as a dashed line based on the determined camera orientation. A reference vector 62 aligned with the viewfinder edge, may also be displayed to aid in framing the picture. Note that the misalignment of the two vectors is exaggerated in fig. 6 to illustrate the concept. The process is repeated 740 so that as the camera body moves, the orientation of the artificial horizon vector in the viewfinder display tracks the orientation of the camera with respect to the gravity vector. In specific embodiments of the invention, the repetition rate of the process may be determined by a time interval. In other embodiments of the invention, the display of the artificial horizon may take other forms besides a vector. All such displays are intended to be within the scope of the present invention and will be referred to below, including in the appended claims as an "artificial horizon indicator." Shutter Speed Control
Sharp photographs generally require that the camera not move during exposure. The ability to hold a camera steady, however, varies a great deal from person to person. In some cases, such as when on a moving vehicle, even an experienced photographer may not be able to hold a camera very steady. In illustrative embodiments of the invention, camera vibration is used as one input (along with lighting conditions) to determine image exposure values. An accelerometer mounted to a camera measures the vibration (i.e., acceleration variation) experienced by the camera for a few hundred milliseconds before exposure to determine an appropriate minimum shutter speed to ensure a sharp picture. The peak-to-peak acceleration is used along with the focal length of the lens to determine the minimum shutter speed allowable. In a specific embodiment of the invention: minimum shutter speed = (0.5 / peak-to-peak acceleration)2 / (focal length) (2)
For example, with a 20 mm focal length and 0.5 m/s2 of vibration, the minimum shutter speed would be 1/20 second. In some embodiments of the invention, a table of minimum shutter speeds is calculated according to equation (2) and a table look-up can then be performed to determine minimum shutter speed.
As shown in fig. 3, according to an embodiment of the invention, the outputs of an accelerometer are connected to the input of an analog-to-digital ("A/D") converter 32. The output of the A/D converter is connected to processing logic 30. In this embodiment of the invention, the accelerometer needs to measure dynamic acceleration, but need not measure orientation. As shown in the flow diagram of fig. 8 800, the processing logic 30 periodically receives 810 the outputs of the A/D converter 32 and stores the A/D converter outputs and time of observation 820. When picture taking is initiated, 830, the peak-to-peak acceleration magnitude is calculated 840 for the preceding time interval based on the stored accelerometer values. Values older than the most recent time interval may be discarded. The minimum shutter speed, 850, 860 is then determined from equation 2.
In some embodiments, the peak-to-peak acceleration magnitude is calculated for more than one axis. The larger of the values of peak-to-peak acceleration magnitude for the respective axes is then used for the minimum shutter speed calculations. In preferred embodiments of the invention, the time interval over which the peak-to-peak acceleration magnitude is determined may range from about 100 milliseconds to about 500 milliseconds.
Camera use detector
Other embodiments of the invention use accelerometers to determine if a camera is in use. For example, a camera oriented such that the lens is pointing up and experiencing very little vibration is likely set on a table and is not about to take a picture. To that end, such embodiments use an accelerometer to measure the orientation of the camera and to measure vibration. These measurements are used to determine whether the camera is in use. The determination of camera use, in turn, can be used to perform tasks to improve camera function, such as reducing power consumption.
In an embodiment of the invention, the orientation of the camera and peak-to-peak acceleration magnitude over a given duration are determined, as described in connection with the preceding embodiments of the invention. These values are then used to determine camera use. An exemplary algorithm for determining camera use is shown in fig. 9. First accelerometer outputs are read 910. In this embodiment, accelerometers to determine static acceleration (orientation) and dynamic acceleration Ax, Ay, Az along three orthogonal axes are provided. In other embodiments less than three axes may be sensed. The absolute magnitude along an axis aligned with the camera lens, Az, is measured 920 to determine if the magnitude is approximately equal to one g. If it is not, then the camera is not face up or face down, and the peak-to-peak magnitude of the acceleration (vibration) for the preceding ten seconds is compared to 15 mg. If vibration exceeds 15 mg, the camera is determined to be in use. The accelerometer outputs are then read again 910 and the process repeated. If the absolute magnitude along an axis aligned with the camera lens, Az, is approximately equal to one g 920, then the camera is face up or face down. The peak-to-peak magnitude of the acceleration (vibration) for the preceding three seconds is compared 930 to 15 mg. If vibration exceeds 15 mg, the camera is determined to be in use. The accelerometer outputs will the be read again 910 and the process repeated. If the vibration is less than 15 mg, then the camera is determined to be idle and the camera may enter 950 a "sleep" mode. In sleep mode, the accelerometer outputs are measured periodically 960. If the vibration equals or exceeds 50 mg, the camera has been picked up and the camera enters a "wake-up" state 980. The process then repeats 910. The values for vibration magnitude and duration in this algorithm are provided for example only, and not by way of limitation. Other time duration thresholds and vibration magnitude thresholds may be used in other embodiments of the invention. In embodiments of the invention, when the camera enters the sleep mode 950, as described above, processing logic 30 place elements of the camera into a low power state. For instance, viewfinder displays may be de-energized and motors that cause optical lens zoom may be powered down. When the camera enters the wake-up state 980, these actions may be reversed to ready the camera for use. Embodiments of the invention can use a wide variety of accelerometers. For example, if implemented as a MEMS device, the accelerometer may be similar to that disclosed by U.S. Patent Number 5,939,633, which is assigned to Analog Devices, Inc. of Norwood, Massachusetts, the disclosure of which is incorporated herein, in its entirety, by reference. Accelerometers implementing non-MEMS technologies also may be used in other embodiments. Accordingly, discussion of MEMS accelerometers is by way of example only.
Systems according to embodiments of the invention may be described by the following clauses:
1. A camera system for aligning a camera to the Earth' horizon, the system comprising: a camera including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera with respect to gravity using the accelerometer; and display an artificial horizon indicator on the viewfinder display based on the determined orientation of the camera.
2. A camera system for orienting icons displayed in a camera viewfinder comprising: a camera including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera with respect to gravity using the accelerometer; and display a given icon on an image produced by the camera, wherein the given icon's orientation is based at least in part on the determination of the orientation of the camera using the accelerometer.
3. A camera system for adjusting image exposure time for a camera to reduce movement- induced image blurring, the system comprising: the camera including an accelerometer mounted on the camera for determining camera movement; and a processor including a memory, the memory containing instructions that cause the processor to: measure a peak-to-peak acceleration magnitude using the accelerometer for a given time duration for the camera; adjust the image exposure time based at least in part on the peak-to-peak acceleration magnitude over the given time duration.
4. A camera system according to clause 3, wherein adjusting the image exposure time includes calculating a minimum shutter speed.
5. A camera system for determining a state of utilization for a camera comprising: a camera including an accelerometer mounted on the camera for determining an orientation of the camera with respect to gravity and a peak-to-peak acceleration magnitude over a given duration; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera using the accelerometer; determine a peak-to-peak acceleration magnitude over a given duration using the accelerometer; and identify the state of utilization for the camera based at least in part on the camera orientation determination and the peak-to-peak acceleration magnitude over a given duration.
Computer program products according to embodiments of the invention may be described by the following clauses:
I l 1. A computer program product for use on a processor in a camera system, the camera system including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: determining an orientation of the camera with respect to gravity using the accelerometer; and displaying an artificial horizon indicator on the viewfinder display based on the determined orientation of the camera.
2. A computer program product for use on a processor in a camera system, the camera system including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: determining an orientation of the camera with respect to gravity using the accelerometer; and displaying a given icon on an image produced by the camera, wherein the given icon's orientation is based at least in part on the determination of the orientation of the camera using the accelerometer.
3. A computer program product for use on a processor in a camera system, the product for adjusting image exposure time for a camera to reduce movement-induced image blurring, the camera system including an accelerometer mounted on the camera for determining camera movement; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: measureing a peak-to-peak acceleration magnitude using the accelerometer for a given time duration for the camera; adjusting the image exposure time based at least in part on the peak-to-peak acceleration magnitude over the given time duration.
4. A computer program product according to clause 3, wherein adjusting the image exposure time includes calculating a minimum shutter speed.
5. A computer program product for use on a processor in a camera system, the product for determining a state of utilization for the camera system, the camera system including an accelerometer mounted on the camera for determining camera movement and orientation; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for determining an orientation of the camera using the accelerometer; determining a peak-to-peak acceleration magnitude over a given duration using the accelerometer; and identifing the state of utilization for the camera based at least in part on the camera orientation determination and the peak-to-peak acceleration magnitude over a given duration.
Logic performing the processing functions may be partitioned into different logic blocks (e.g., programs, modules, functions, or subroutines) without changing the overall results or otherwise departing from the true scope of the invention. Oftentimes, logic elements may be added, modified, omitted, performed in a different order, or implemented using different logic constructs (e.g., logic gates, looping primitives, conditional logic, and other logic constructs) without changing the overall results or otherwise departing from the true scope of the invention.
The present invention may be embodied in many different forms, including, but in no way limited to, computer program logic for use with a processor (e.g., a microprocessor, microcontroller, digital signal processor, or general purpose computer), programmable logic for use with a programmable logic device (e.g., a Field Programmable Gate Array (FPGA) or other PLD), discrete components, integrated circuitry (e.g., an Application Specific Integrated Circuit (ASIC)), or any other means including any combination thereof.
Computer program logic implementing all or part of the functionality previously described herein may be embodied in various forms, including, but in no way limited to, a source code form, a computer exec structure form, and various intermediate forms (e.g., forms generated by an assembler, compiler, linker, or locator.) Source code may include a series of computer program instructions implemented in any of various programming languages (e.g., an object code, an assembly language, or a high-level language such as FORTRAN, C, C++, JAVA, or HTML) for use with various operating systems or operating environments. The source code may define and use various data structures and communication messages. The source code may be in a computer execustructure form (e.g., via an interpreter), or the source code may be converted (e.g., via a translator, assembler, or compiler) into a computer executable structure form.
The computer program may be fixed in any form (e.g., source code form, computer execustructure form, or an intermediate form) either permanently or transitorily in a tangible storage medium, such as a semiconductor memory device (e.g., a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM), a magnetic memory device (e.g., a diskette or fixed disk), an optical memory device (e.g., a CD-ROM), a PC card (e.g., PCMCIA card), or other memory device. The computer program may be fixed in any form in a signal that is transmittable to a computer using any of various communication technologies, including, but in no way limited to, analog technologies, digital technologies, optical technologies, wireless technologies, networking technologies, and internetworking technologies. The computer program may be distributed in any form as a removable storage medium with accompanying printed or electronic documentation (e.g., shrink wrapped software or a magnetic tape), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the communication system (e.g., the Internet or World Wide Web.)
Hardware logic (including programmable logic for use with a programmable logic device) implementing all or part of the functionality previously described herein may be designed using traditional manual methods, or may be designed, captured, simulated, or documented electronically using various tools, such as Computer Aided Design (CAD), a hardware description language (e.g., VHDL or AHDL), or a PLD programming language (e.g., PALASM, ABEL, or CUPL.)
Although the above discussion discloses various exemplary embodiments of the invention, it should be apparent that those skilled in the art can make various modifications that will achieve some of the advantages of the invention without departing from the true scope of the invention . Other variations and modifications of the embodiments described above are intended to be within the scope of the present invention as defined in the appended claims

Claims

What is claimed is:
1. A method for aligning a camera to the Earth's horizon, the method comprising: a. providing the camera having a viewfinder display and an accelerometer for determining camera orientation with respect to gravity ; b. determining an orientation of the camera with respect to gravity using the accelerometer; and c. displaying an artificial horizon indicator on the viewfinder display based on the determined orientation of the camera.
2. A method according to claim 1 further comprising: d. aligning the camera with respect to the earth's surface using the artificial horizon indicator on the viewfinder display.
3. A method according to claim 1 further comprising: d. displaying an reference indicator for the camera on the viewfinder display to aid in aligning the camera with respect to the earth's surface.
4. A method for orienting icons displayed in a camera image comprising: a. providing a camera, the camera including an accelerometer for determining an orientation of the camera with respect to gravity and a viewfinder display; b. determining an orientation of the camera with respect to gravity using the accelerometer; and c. displaying a given icon on an image produced by the camera, wherein the given icon's orientation is based at least in part on the determination of the orientation of the camera using the accelerometer.
5. A method according to claim 4, where the image produced by the camera is displayed on the viewfinder display.
6. A method according to claim 4, wherein displaying the given icon on an image produced by the camera includes printing the icon on a printed image.
7. A method for adjusting image exposure time for a camera to reduce movement-induced image blurring, a. providing the camera, the camera including an accelerometer; b. measuring a peak-to-peak acceleration magnitude using the accelerometer for a given time duration; and c. adjusting the image exposure time based at least in part on the peak-to-peak acceleration magnitude over the given time duration.
8. A method according to claim 8, wherein adjusting the image exposure time includes calculating a minimum shutter speed.
9. A method according to claim 9, wherein the minimum shutter speed is calculated as a function of the square of the inverse of the peak-to-peak acceleration magnitude divided by the camera focal length.
10. A method according to claim 4 wherein adjusting the image exposure time includes looking up a minimum shutter speed versus the peak-to-peak acceleration magnitude over the given time duration in a look-up table.
11. A method for determining a state of utilization for a camera comprising: a. providing the camera, the camera including an accelerometer for determining an orientation of the camera with respect to gravity and a peak-to-peak acceleration magnitude over a given duration; b. determining an orientation of the camera using the accelerometer; c. determining a peak-to-peak acceleration magnitude over a given duration using the accelerometer; d. identifying the state of utilization for the camera based at least in part on the camera orientation determination and the peak-to-peak acceleration magnitude over a given duration.
12. A method according to claim 6 further including: e. placing the camera in a lower power state based on the state of utilization.
02550/A90WO 460751.1
PCT/US2006/001816 2005-02-01 2006-01-19 Camera with acceleration sensor WO2006083563A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US64878005P 2005-02-01 2005-02-01
US60/648,780 2005-02-01

Publications (2)

Publication Number Publication Date
WO2006083563A2 true WO2006083563A2 (en) 2006-08-10
WO2006083563A3 WO2006083563A3 (en) 2006-12-21

Family

ID=36238458

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/001816 WO2006083563A2 (en) 2005-02-01 2006-01-19 Camera with acceleration sensor

Country Status (3)

Country Link
US (2) US20060204232A1 (en)
TW (1) TWI387327B (en)
WO (1) WO2006083563A2 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102183233A (en) * 2010-01-19 2011-09-14 罗伯特·博世有限公司 Recognition method for automatic orientation
CN102183232A (en) * 2010-01-15 2011-09-14 罗伯特·博世有限公司 Orientation sensor
CN103206946A (en) * 2013-03-25 2013-07-17 成都西可科技有限公司 System for correcting positional deflection angles of intelligent terminal
US8493453B2 (en) 2009-06-05 2013-07-23 Apple Inc. Image capturing devices using orientation detectors to implement automatic exposure mechanisms
US9800778B2 (en) 2015-07-21 2017-10-24 Qualcomm Incorporated Camera orientation notification system

Families Citing this family (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7933001B2 (en) * 2005-07-11 2011-04-26 Kabushiki Kaisha Topcon Geographic data collecting system
KR100708178B1 (en) 2005-09-01 2007-04-16 삼성전자주식회사 Method for image processing, apparatus and information storage medium storing image information therefor
JP2007180931A (en) 2005-12-28 2007-07-12 Samsung Techwin Co Ltd Image display device and imaging device
US7593627B2 (en) * 2006-08-18 2009-09-22 Sony Ericsson Mobile Communications Ab Angle correction for camera
US7907836B2 (en) 2007-09-12 2011-03-15 Ricoh Company, Ltd. Imaging apparatus
GB0717858D0 (en) * 2007-09-13 2007-10-24 Ibp Group Ltd Security system
US8089549B2 (en) 2007-09-19 2012-01-03 Ricoh Company, Ltd. Imaging apparatus capable of detecting and displaying information with respect to an incline thereof
JP2009237530A (en) * 2007-11-14 2009-10-15 Ricoh Co Ltd Lens drive device, image pickup device and lens drive method
JP5094359B2 (en) * 2007-12-14 2012-12-12 キヤノン株式会社 Imaging device
US7857218B2 (en) * 2007-12-21 2010-12-28 Cognex Corporation Handheld code reader having a motion sensor
US10127422B1 (en) 2007-12-21 2018-11-13 Cognex Corporation Handheld code reader having a motion sensor
JP5065060B2 (en) * 2008-01-16 2012-10-31 キヤノン株式会社 Imaging apparatus and control method thereof
US20090206548A1 (en) * 2008-02-15 2009-08-20 Scott Allan Hawkins Protective game piece cover and faceplates
JP5150307B2 (en) * 2008-03-03 2013-02-20 株式会社トプコン Geographic data collection device
JP5150310B2 (en) * 2008-03-04 2013-02-20 株式会社トプコン Geographic data collection device
TWI558199B (en) 2008-08-08 2016-11-11 尼康股份有限公司 Carry information machine and information acquisition system
US8228381B2 (en) * 2008-09-03 2012-07-24 Walter Accurso Video and data capturing system and method
US8138708B2 (en) 2008-11-26 2012-03-20 Allegro Microsystems, Inc. Closed-loop motor driver compensation
US8159363B2 (en) * 2009-02-16 2012-04-17 Research In Motion Limited Using gravity to direct a rotatable camera in a handheld electronic device
JP5495602B2 (en) * 2009-04-02 2014-05-21 オリンパスイメージング株式会社 Imaging apparatus and imaging method
US9014685B2 (en) * 2009-06-12 2015-04-21 Microsoft Technology Licensing, Llc Mobile device which automatically determines operating mode
US8732728B2 (en) * 2009-07-20 2014-05-20 Samsung Electronics Co., Ltd. System and method to allow multiple plug-in applications real-time access to a camera application in a mobile device
JP5127792B2 (en) 2009-08-18 2013-01-23 キヤノン株式会社 Information processing apparatus, control method therefor, program, and recording medium
JP5491101B2 (en) * 2009-08-26 2014-05-14 キヤノン株式会社 Imaging device
KR101617289B1 (en) * 2009-09-30 2016-05-02 엘지전자 주식회사 Mobile terminal and operation control method thereof
KR20110061063A (en) * 2009-12-01 2011-06-09 삼성전자주식회사 Apparatus and method for photographing of a portable terminal
US20110298887A1 (en) * 2010-06-02 2011-12-08 Maglaque Chad L Apparatus Using an Accelerometer to Capture Photographic Images
JP5570316B2 (en) * 2010-06-17 2014-08-13 キヤノン株式会社 Imaging apparatus, control method thereof, and program
KR101643617B1 (en) * 2010-07-28 2016-08-10 삼성전자주식회사 Digital photographing apparatus and method for controlling thereof
JP5698480B2 (en) 2010-09-02 2015-04-08 株式会社トプコン Measuring method and measuring device
US8588550B2 (en) * 2010-10-04 2013-11-19 Sony Corporation Virtual level for a digital camera
JP5250598B2 (en) * 2010-10-05 2013-07-31 株式会社ソニー・コンピュータエンタテインメント Image display device and image display method
KR101752698B1 (en) * 2011-01-06 2017-07-04 삼성전자주식회사 Photographing device and methods thereof
US8224176B1 (en) 2011-01-10 2012-07-17 Eastman Kodak Company Combined ambient and flash exposure for improved image quality
US8428308B2 (en) * 2011-02-04 2013-04-23 Apple Inc. Estimating subject motion for capture setting determination
US8379934B2 (en) 2011-02-04 2013-02-19 Eastman Kodak Company Estimating subject motion between image frames
JP2012171088A (en) * 2011-02-24 2012-09-10 Olympus Corp Master operation input device, and master-slave manipulator
US8736697B2 (en) 2011-03-25 2014-05-27 Apple Inc. Digital camera having burst image capture mode
US8736704B2 (en) 2011-03-25 2014-05-27 Apple Inc. Digital camera for capturing an image sequence
US8736716B2 (en) 2011-04-06 2014-05-27 Apple Inc. Digital camera having variable duration burst mode
EP2699963A1 (en) * 2011-04-18 2014-02-26 EyeSee360, Inc. Apparatus and method for panoramic video imaging with mobile computing devices
US8560004B1 (en) 2012-08-31 2013-10-15 Google Inc. Sensor-based activation of an input device
US9648283B2 (en) 2013-05-16 2017-05-09 Verint Americas Inc. Distributed sensing and video capture system and apparatus
JP6150652B2 (en) * 2013-07-29 2017-06-21 キヤノン株式会社 IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, PROGRAM, AND RECORDING MEDIUM
US9942384B2 (en) 2013-09-10 2018-04-10 Google Technology Holdings LLC Method and apparatus for device mode detection
US9159294B2 (en) 2014-01-31 2015-10-13 Google Inc. Buttonless display activation
EP4250738A3 (en) 2014-04-22 2023-10-11 Snap-Aid Patents Ltd. Method for controlling a camera based on processing an image captured by other camera
US9560260B2 (en) * 2014-10-02 2017-01-31 Sensors Unlimited, Inc. System for determining a lens position
CN108471725B (en) * 2015-08-24 2021-09-14 伊利诺斯工具制品有限公司 Multifunctional livestock measuring station
TWI689708B (en) 2018-12-24 2020-04-01 財團法人工業技術研究院 Vibration sensor with monitoring function and vibration signal monitoring method thereof
JP7450395B2 (en) * 2020-02-03 2024-03-15 キヤノン株式会社 Display control device and its control method, program, storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19531289A1 (en) * 1995-08-25 1997-02-27 Telefunken Microelectron Optical image recorder
US20020030856A1 (en) * 2000-09-14 2002-03-14 Atsushi Kumagai Image processing apparatus, image processing method, storage medium, and image information printing system
JP2002271654A (en) * 2001-03-12 2002-09-20 Fuji Photo Film Co Ltd Electronic camera

Family Cites Families (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5870217A (en) * 1981-10-23 1983-04-26 Fuji Photo Film Co Ltd Camera-shake detecting device
US4787051A (en) * 1986-05-16 1988-11-22 Tektronix, Inc. Inertial mouse system
US4862172A (en) * 1987-09-14 1989-08-29 Texas Scottish Rite Hospital For Crippled Children Computer control apparatus including a gravity referenced inclinometer
US5363120A (en) * 1987-10-14 1994-11-08 Wang Laboratories, Inc. Computer input device using orientation sensor
US5826115A (en) * 1987-11-16 1998-10-20 Canon Kabushiki Kaisha Camera with an image stabilizing function
US4801793A (en) * 1988-01-13 1989-01-31 Eastman Kodak Company Orientation indicating device
US4996545A (en) * 1989-04-03 1991-02-26 Asahi Kogaku Kogyo Kabushiki Kaisha Apparatus for correcting blurred image of camera using angular acceleration sensor and angular acceleration sensor
USRE35583E (en) * 1989-11-29 1997-08-12 Minolta Camera Kabushiki Kaisha Camera capable of correcting blurring
US5440326A (en) * 1990-03-21 1995-08-08 Gyration, Inc. Gyroscopic pointer
EP0456414A3 (en) * 1990-05-11 1992-05-20 Matsushita Electric Industrial Co., Ltd Slant correction for a video camera apparatus
US5335032A (en) * 1991-04-26 1994-08-02 Canon Kabushiki Kaisha Image stabilizing apparatus
JPH0792533A (en) * 1993-09-27 1995-04-07 Nikon Corp Still camera with vibration proof photographing function
US5448322A (en) * 1993-11-05 1995-09-05 Vision Iii Imaging, Inc. Autostereoscopic imaging apparatus and method using a parallax scanning lens aperture
US6091448A (en) * 1993-12-27 2000-07-18 Canon Kabushiki Kaisha Apparatus for preventing an image blur prevention device from changing states during an image recording operation
JP3112383B2 (en) * 1994-06-27 2000-11-27 矢崎総業株式会社 Lock structure
WO1996024822A1 (en) * 1995-02-07 1996-08-15 Anatoly Akimovich Kokush Triaxial gyroscopic stabiliser for a movie or television camera
US5604534A (en) * 1995-05-24 1997-02-18 Omni Solutions International, Ltd. Direct digital airborne panoramic camera system and method
US5794078A (en) * 1995-09-11 1998-08-11 Nikon Corporation Image movement correction of camera
US5878283A (en) * 1996-09-05 1999-03-02 Eastman Kodak Company Single-use camera with motion sensor
JP3480206B2 (en) * 1996-11-26 2003-12-15 ミノルタ株式会社 Position detecting device and camera
US5881321A (en) * 1997-05-09 1999-03-09 Cammotion, Inc.. Camera motion sensing system
FI981469A (en) * 1998-06-25 1999-12-26 Nokia Mobile Phones Ltd Integrated motion detector in a mobile telecommunications device
US6011926A (en) * 1998-07-09 2000-01-04 Cockell; Patrick G. Horizon control
GB2359895B (en) * 2000-03-03 2003-09-10 Hewlett Packard Co Camera projected viewfinder
US6709387B1 (en) * 2000-05-15 2004-03-23 Given Imaging Ltd. System and method for controlling in vivo camera capture and display rate
US6747690B2 (en) * 2000-07-11 2004-06-08 Phase One A/S Digital camera with integrated accelerometers
US7554578B2 (en) * 2000-07-11 2009-06-30 Phase One A/S Digital camera with integrated accelerometers
JP2002156676A (en) * 2000-11-20 2002-05-31 Olympus Optical Co Ltd Photographing device with shake detecting function
JP2002209136A (en) * 2001-01-05 2002-07-26 Canon Inc Photographing device
JP2002374572A (en) * 2001-06-15 2002-12-26 Yamaha Corp Mobile phone
GB0116113D0 (en) 2001-06-30 2001-08-22 Hewlett Packard Co Tilt correction of electronic images
US20030038779A1 (en) * 2001-08-22 2003-02-27 Baron John M. Acceleration-responsive navigation among mode variables
JP2003098566A (en) * 2001-09-20 2003-04-03 Canon Inc Signal controller for oscillation detection means
US20030076408A1 (en) * 2001-10-18 2003-04-24 Nokia Corporation Method and handheld device for obtaining an image of an object by combining a plurality of images
US6912386B1 (en) * 2001-11-13 2005-06-28 Nokia Corporation Method for controlling operation of a mobile device by detecting usage situations
KR100461787B1 (en) * 2002-04-10 2004-12-14 학교법인 포항공과대학교 Accelerometers using mems technology and method for manufacturing the same
GB0208654D0 (en) 2002-04-16 2002-05-29 Koninkl Philips Electronics Nv Image processing for video or photographic equipment
JP2003309797A (en) * 2002-04-17 2003-10-31 Sharp Corp Hard disk video camera provided with low power consumption mode
US6810207B2 (en) * 2002-05-13 2004-10-26 Olympus Corporation Camera
EP1394555B1 (en) * 2002-08-30 2012-04-25 STMicroelectronics S.r.l. Threshold acceleration sensor
US7212230B2 (en) * 2003-01-08 2007-05-01 Hewlett-Packard Development Company, L.P. Digital camera having a motion tracking subsystem responsive to input control for tracking motion of the digital camera
US8508643B2 (en) * 2003-01-17 2013-08-13 Hewlett-Packard Development Company, L.P. Method and system for processing an image
JP3976061B2 (en) * 2003-01-21 2007-09-12 松下電器産業株式会社 Mobile device with camera
US20040145613A1 (en) * 2003-01-29 2004-07-29 Stavely Donald J. User Interface using acceleration for input
US7265790B2 (en) * 2003-07-07 2007-09-04 Hewlett-Packard Development Company, L.P. System and method for setting an image capture device to an operational mode
US6751410B1 (en) * 2003-07-10 2004-06-15 Hewlett-Packard Development Company, L.P. Inertial camera stabilization apparatus and method
KR100595617B1 (en) * 2003-11-29 2006-06-30 엘지전자 주식회사 Horizontal and vertical of angle display method for mobile station
US20050146620A1 (en) * 2004-01-02 2005-07-07 Monroe Darrin D. Electronic device with image capturing and method therefor
US7142004B2 (en) * 2004-01-15 2006-11-28 Honeywell International Inc. Radiation hardening of logic circuitry using a cross enabled, interlocked logic system and method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19531289A1 (en) * 1995-08-25 1997-02-27 Telefunken Microelectron Optical image recorder
US20020030856A1 (en) * 2000-09-14 2002-03-14 Atsushi Kumagai Image processing apparatus, image processing method, storage medium, and image information printing system
JP2002271654A (en) * 2001-03-12 2002-09-20 Fuji Photo Film Co Ltd Electronic camera

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 2003, no. 01, 14 January 2003 (2003-01-14) -& JP 2002 271654 A (FUJI PHOTO FILM CO LTD), 20 September 2002 (2002-09-20) *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8493453B2 (en) 2009-06-05 2013-07-23 Apple Inc. Image capturing devices using orientation detectors to implement automatic exposure mechanisms
US9007485B2 (en) 2009-06-05 2015-04-14 Apple Inc. Image capturing devices using orientation detectors to implement automatic exposure mechanisms
CN102183232A (en) * 2010-01-15 2011-09-14 罗伯特·博世有限公司 Orientation sensor
CN102183233A (en) * 2010-01-19 2011-09-14 罗伯特·博世有限公司 Recognition method for automatic orientation
CN103206946A (en) * 2013-03-25 2013-07-17 成都西可科技有限公司 System for correcting positional deflection angles of intelligent terminal
US9800778B2 (en) 2015-07-21 2017-10-24 Qualcomm Incorporated Camera orientation notification system

Also Published As

Publication number Publication date
US7720376B2 (en) 2010-05-18
US20060204232A1 (en) 2006-09-14
US20090154910A1 (en) 2009-06-18
TW200644620A (en) 2006-12-16
WO2006083563A3 (en) 2006-12-21
TWI387327B (en) 2013-02-21

Similar Documents

Publication Publication Date Title
US7720376B2 (en) Camera with acceleration sensor
CN107018357B (en) Method and apparatus for event sampling for dynamic vision sensor with respect to image formation
JP3513950B2 (en) Image stabilization camera
KR101107537B1 (en) Sensor-based orientation system
US7564482B2 (en) Image capturing device, correction device, mobile phone, and correcting method
US8854482B2 (en) Digital camera with integrated accelerometers
JP6098874B2 (en) Imaging apparatus and image processing apparatus
US20060185432A1 (en) Five degree of freedom intertial measurement device
EP2157783B1 (en) Eyeball movement controller using principle of vestibulo-ocular reflex
EP1932336B1 (en) Image stabilizing device of the mems type, in particular for image acquisition using a digital-image sensor
US10216002B2 (en) Anti-shake correction system for curved optical sensor
WO2012153281A1 (en) Image capturing apparatus with management and correction of inclinations
JP2006099109A (en) System and method for detecting image capture device movement with two dual axis linear accelerometers
BRPI1013048B1 (en) IMAGE STABILIZATION AND IMAGE CAPTURE APPARATUS
US20230119687A1 (en) Multi-sensor handle controller hybrid tracking method and device
Bae et al. Accurate motion deblurring using camera motion tracking and scene depth
JP2010160379A (en) Camera calibration method and camera calibration device
JP3729214B2 (en) Image stabilization camera
CN108322698A (en) The system and method merged based on multiple-camera and Inertial Measurement Unit
JPH0980523A (en) Image blurring correction camera
Hansson et al. PTZ Camera Tampering Correction Using IMUs
KR19990073928A (en) Head movement detection device and detection method
JP2008029428A (en) Motion detector

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06718829

Country of ref document: EP

Kind code of ref document: A2