WO2006083563A2 - Camera with acceleration sensor - Google Patents
Camera with acceleration sensor Download PDFInfo
- Publication number
- WO2006083563A2 WO2006083563A2 PCT/US2006/001816 US2006001816W WO2006083563A2 WO 2006083563 A2 WO2006083563 A2 WO 2006083563A2 US 2006001816 W US2006001816 W US 2006001816W WO 2006083563 A2 WO2006083563 A2 WO 2006083563A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- camera
- orientation
- accelerometer
- peak
- determining
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/02—Bodies
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/18—Signals indicating condition of a camera member or suitability of light
- G03B17/20—Signals indicating condition of a camera member or suitability of light visible in viewfinder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
- H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
- H04N23/684—Vibration or motion blur correction performed by controlling the image sensor readout, e.g. by controlling the integration time
Definitions
- the invention generally relates to cameras and, more particularly, the invention relates to detecting motion of a camera.
- a digital camera could use this information to store the image such that it displays "right side up” on a computer display.
- Ball and cage type mechanical switches can be used to ascertain orientation, but they have reliability problems.
- a digital camera includes an accelerometer mounted on the camera.
- the accelerometer measures camera movement and/or orientation. In various embodiments of the invention, this information can be used to:
- the accelerometer provides orientation information for the camera with respect to the earth's gravity. This orientation information allows an artificial horizon indicator to be displayed on an image on a display surface, such as a viewfinder display attached to the camera. The user views the artificial horizon indicator and may realign the camera based on the relationship between the image and the indicator.
- the accelerometer provides orientation information for the camera with respect to the earth's gravity. Icons consisting of text and/or graphics are displayed on an image produced by the camera in a "right side up" orientation based on the camera orientation information received from the accelerometer. The image may be displayed on a viewfinder display or on a printed image of a picture.
- a further embodiment of the invention adjusts image exposure time for a camera to reduce movement-induced image blurring.
- An accelerometer mounted to the camera provides acceleration information. The information is stored and peak-to-peak acceleration magnitude is calculated for the most recent time period. When picture taking is initiated, a minimum shutter speed is calculated as a function of the peak-to-peak acceleration magnitude over the most recent time period and the focal length of the camera. The exposure time of the picture may be adjusted accordingly.
- Another embodiment of the invention determines if a camera is in use using camera orientation and camera movement information calculated from the outputs of the accelerometer. If a camera is determined not to be in use, elements of the camera can be placed in a low-power state and reenergized when the camera usage changes.
- Fig. IA shows a simplified perspective view of the front of a camera, according to an embodiment of the present invention
- Fig. IB shows a plan view of the rear of the camera of fig. IA;
- Fig. 2 A shows schematically typical accelerometer outputs for two orientations of the camera of fig. 1;
- Fig. 2B shows possible orientation of the camera body vector relative to earth's gravity vector for orienting text and graphics, according to an embodiment of the invention.
- Fig. 3 schematically shows a circuit for controlling a camera according to embodiments of the present invention
- Fig. 4 illustrates right-side-up graphics on a camera viewf ⁇ nder, generated by an embodiment of the invention
- Fig. 5 is a flow diagram for an illustrative method of using orientation information to display "right side up" graphics on a picture image, according to an embodiment of the invention
- Fig. 6 illustrates display of an artificial horizon indicator to aid in framing a picture, according to an embodiment of the invention
- Fig. 7 is a flow diagram for an illustrative method of using orientation information to create an artificial horizon indicator on a display to aid in framing a picture, according to an embodiment of the invention
- Fig. 8 is a flow diagram for a method of using vibration data to determine minimum shutter speed, according to an embodiment of the invention.
- Fig. 9 is a flow diagram for a method of using orientation and vibration data to determine when a camera is in use, according to an embodiment of the invention.
- an accelerometer can be used to determine the static orientation of a camera by measuring the direction of the earth gravity's (gravity vector) relative to the camera body.
- Other embodiments of the invention use an accelerometer to detect the dynamic movement of a camera. Orientation and/or dynamic movement information for a camera enable a variety of functions. Several such functions are discussed below in separate sections.
- Fig. IA is a simplified perspective view of the front of an exemplary camera 10, according to an embodiment of the invention.
- the camera 10 includes a lens 12 with a lens aperture 14.
- a viewfinder window 16 allows a user to frame a picture. Pressing a shutter switch 18 initiates picture taking.
- Fig. IB shows a plan view of the rear of the camera. The user looks into the viewfinder window 16 and adjusts the camera's orientation to frame the picture. Alternatively, the user may look at a viewfinder display screen 18 on the back of the camera to frame the picture.
- a "viewfinder,” “viewfinder window” or a “viewfinder display” shall mean any visual display employed in a camera to aid in framing a picture.
- a circuit board 22 which contains processing logic (e.g., microprocessor, ASICs, etc.) to control camera functions.
- processing logic e.g., microprocessor, ASICs, etc.
- accelerometers 20 mounted internal to the camera body.
- the accelerometer may be a microelectromechanical system (“MEMS") device or another type of accelerometer capable of measurement of orientation or movement, as needed for each of the functions described below.
- MEMS microelectromechanical system
- the accelerometer may be a dual-axis device, or a plurality of single-axis accelerometers may be used.
- Fig. 2A shows a coordinate system applied to the camera of figs. 1 A-IB.
- Fig. 3 is a schematic diagram of a circuit for controlling the camera 10 of figs. IA and IB, according to an embodiment of the invention.
- the outputs of accelerometer 20 are voltage levels, Ax 21 and Ay 22, whose values correspond the magnitude of the acceleration along "X" and “Y” axes, respectively.
- These accelerometer outputs are input to analog-to- digital converters 32 ("A/D"), which quantize the signals.
- the A/D output 34 is input to processing logic 30.
- the processing logic 30 may take a variety of forms, as are known in the art, including a microprocessor with memory and a stored program together with appropriate interface circuitry. Alternatively, the processing logic may take the form of dedicated logic elements ("ASIC") or the processing logic may be a mix of a microprocessor with dedicated logic elements.
- ASIC dedicated logic elements
- the output of a shutter switch 20 is input to the processing logic to allow a user to initiate picture taking.
- the processing logic provides outputs signals to control the shutter 34, to control the lens aperture 35, and to generate displays on the viewfinder 36 and on a viewfinder display screen 37, 18.
- the processing logic may also provide a variety of power conditioning outputs 38 to functional elements of the camera to put individual elements into a low power state.
- the display on the viewfinder and on the display window may be formed by combining text and graphics generated by the processing logic with the output of an image sensor, as is known in the art.
- the circuit elements for controlling the camera may take on other forms that provide similar functionality.
- Other embodiments of the invention may not have every element shown in fig. 3. For example, if the camera does not include a viewfmder display screen 18 on the back of the camera, the processing logic need not provide an output 37 to it.
- accelerometer(s) 20 help determine the orientation of the camera with respect to earth's gravity. Based upon this determination, text and graphics information that is normally overlaid on an image in the viewfinder, or on another display, can be automatically rotated to be "right side up" to the user, as the camera is oriented in various directions.
- An example is shown in Fig. 4.
- Camera 10 in the leftmost instance 40 is oriented in the portrait mode and the caption 44 in the viewfinder is oriented so that the text is upright for the longer dimension of the picture.
- the caption in the viewfinder 46 is rotated to be upright for the shorter dimension of the picture.
- caption 48 is again shown upright for the longer dimension of the picture 42.
- the captions 44, 48 for the leftmost instance 40 and the rightmost instance 42 have opposite orientations with respect to the camera body, but the same orientation with respect to the image. This occurs because the camera body is rotated 180 degrees between the leftmost and rightmost instances.
- captions such as the date and time can be added to the image captured by the camera and the caption can be oriented so that it is "right side up.” That is, the caption on the image may be oriented so that it is opposite to the direction of the gravity vector for the camera's orientation, (i.e., pointing in an approximately vertical direction).
- FIG. 5 shows a flow diagram 500 for user interface orientation according to an embodiment of the invention.
- Outputs Ax 21, Ay 22 of the accelerometers 20 are sampled 510 to determine the orientation of the camera body vector 28 with respect to the earth's gravity vector 11.
- An accelerometer(s) capable of measuring static (non- varying) accelerations along two axes is used.
- Ax 0 is the value along the x-axis when the camera body vector is aligned, as shown in the upper drawing in fig. 2A;
- Ay 0 is the value for the y-axis for alignment of camera body vector 28 perpendicular to the gravity vector, as shown in the lower drawing in fig. 2).
- the orientation of the camera body vector 28 with respect to the gravity vector 11 is resolved 520 into one of four quadrants (24, 25, 26, 27) shown in fig. 2B. Text and graphics are then oriented 530, 540 as follows on the display:
- Text and graphics captions are rendered 530, 540 in the viewfinder display (e.g., 44, 46, 48) with the orientation so that it most nearly matches the direction that is upright (i.e., opposite to the direction of the gravity vector).
- the process is repeated 550 so that as the camera body is reoriented, the orientation of the text and graphic captions in the viewfinder display track the orientation of the camera with respect to the gravity vector. In specific embodiments of the invention, this process is repeated at a set time interval.
- a further embodiment of the invention produces an artificial horizon display in the camera viewfinder based upon the gravity vector 11.
- the artificial horizon enables the picture to be framed so that one edge is parallel to the surface of the Earth.
- an "artificial horizon" indicator 64 can be displayed in the viewfinder display 60 as a dashed line to aid the user in framing the photograph. The user can then rotate the camera to align the artificial horizon indicator 64 with the subject.
- the "artificial horizon" indicator can be reoriented in the viewfinder based on the gross orientation of the camera (portrait or landscape), as determined from the accelerometer outputs. This determination would be similar to that shown above for the "user interface orientation" embodiment of the invention.
- Fig. 7 shows a flow diagram 700 for display of an artificial horizon on a camera viewfinder display according an embodiment of the invention.
- Outputs Ax 21, Ay 22 of the accelerometers 20 are sampled 710 to determine the orientation of the camera body with respect to the earth's gravity vector 11.
- the same accelerometer arrangement and calculations 720 may be used to determine camera body vector 28 orientation relative to the earth's gravity vector 11, as described above for the "right-side up" caption display embodiment of the invention.
- An artificial horizon vector 64 is rendered 730 on the camera viewfinder display as a dashed line based on the determined camera orientation.
- a reference vector 62 aligned with the viewfinder edge may also be displayed to aid in framing the picture.
- the misalignment of the two vectors is exaggerated in fig. 6 to illustrate the concept.
- the process is repeated 740 so that as the camera body moves, the orientation of the artificial horizon vector in the viewfinder display tracks the orientation of the camera with respect to the gravity vector.
- the repetition rate of the process may be determined by a time interval.
- the display of the artificial horizon may take other forms besides a vector. All such displays are intended to be within the scope of the present invention and will be referred to below, including in the appended claims as an "artificial horizon indicator.”
- camera vibration is used as one input (along with lighting conditions) to determine image exposure values.
- An accelerometer mounted to a camera measures the vibration (i.e., acceleration variation) experienced by the camera for a few hundred milliseconds before exposure to determine an appropriate minimum shutter speed to ensure a sharp picture.
- the minimum shutter speed would be 1/20 second.
- a table of minimum shutter speeds is calculated according to equation (2) and a table look-up can then be performed to determine minimum shutter speed.
- the outputs of an accelerometer are connected to the input of an analog-to-digital ("A/D") converter 32.
- the output of the A/D converter is connected to processing logic 30.
- the accelerometer needs to measure dynamic acceleration, but need not measure orientation.
- the processing logic 30 periodically receives 810 the outputs of the A/D converter 32 and stores the A/D converter outputs and time of observation 820.
- the peak-to-peak acceleration magnitude is calculated 840 for the preceding time interval based on the stored accelerometer values. Values older than the most recent time interval may be discarded.
- the minimum shutter speed, 850, 860 is then determined from equation 2.
- the peak-to-peak acceleration magnitude is calculated for more than one axis. The larger of the values of peak-to-peak acceleration magnitude for the respective axes is then used for the minimum shutter speed calculations.
- the time interval over which the peak-to-peak acceleration magnitude is determined may range from about 100 milliseconds to about 500 milliseconds.
- Other embodiments of the invention use accelerometers to determine if a camera is in use. For example, a camera oriented such that the lens is pointing up and experiencing very little vibration is likely set on a table and is not about to take a picture. To that end, such embodiments use an accelerometer to measure the orientation of the camera and to measure vibration. These measurements are used to determine whether the camera is in use. The determination of camera use, in turn, can be used to perform tasks to improve camera function, such as reducing power consumption.
- the orientation of the camera and peak-to-peak acceleration magnitude over a given duration are determined, as described in connection with the preceding embodiments of the invention. These values are then used to determine camera use.
- An exemplary algorithm for determining camera use is shown in fig. 9.
- First accelerometer outputs are read 910.
- accelerometers to determine static acceleration (orientation) and dynamic acceleration Ax, Ay, Az along three orthogonal axes are provided. In other embodiments less than three axes may be sensed.
- the absolute magnitude along an axis aligned with the camera lens, Az, is measured 920 to determine if the magnitude is approximately equal to one g.
- the camera is not face up or face down, and the peak-to-peak magnitude of the acceleration (vibration) for the preceding ten seconds is compared to 15 mg. If vibration exceeds 15 mg, the camera is determined to be in use. The accelerometer outputs are then read again 910 and the process repeated. If the absolute magnitude along an axis aligned with the camera lens, Az, is approximately equal to one g 920, then the camera is face up or face down. The peak-to-peak magnitude of the acceleration (vibration) for the preceding three seconds is compared 930 to 15 mg. If vibration exceeds 15 mg, the camera is determined to be in use. The accelerometer outputs will the be read again 910 and the process repeated.
- the camera is determined to be idle and the camera may enter 950 a "sleep" mode.
- sleep mode the accelerometer outputs are measured periodically 960. If the vibration equals or exceeds 50 mg, the camera has been picked up and the camera enters a "wake-up" state 980. The process then repeats 910.
- the values for vibration magnitude and duration in this algorithm are provided for example only, and not by way of limitation. Other time duration thresholds and vibration magnitude thresholds may be used in other embodiments of the invention.
- processing logic 30 place elements of the camera into a low power state.
- Embodiments of the invention can use a wide variety of accelerometers.
- the accelerometer may be similar to that disclosed by U.S. Patent Number 5,939,633, which is assigned to Analog Devices, Inc. of Norwood, Massachusetts, the disclosure of which is incorporated herein, in its entirety, by reference. Accelerometers implementing non-MEMS technologies also may be used in other embodiments. Accordingly, discussion of MEMS accelerometers is by way of example only.
- a camera system for aligning a camera to the Earth' horizon comprising: a camera including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera with respect to gravity using the accelerometer; and display an artificial horizon indicator on the viewfinder display based on the determined orientation of the camera.
- a camera system for orienting icons displayed in a camera viewfinder comprising: a camera including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera with respect to gravity using the accelerometer; and display a given icon on an image produced by the camera, wherein the given icon's orientation is based at least in part on the determination of the orientation of the camera using the accelerometer.
- a camera system for adjusting image exposure time for a camera to reduce movement- induced image blurring comprising: the camera including an accelerometer mounted on the camera for determining camera movement; and a processor including a memory, the memory containing instructions that cause the processor to: measure a peak-to-peak acceleration magnitude using the accelerometer for a given time duration for the camera; adjust the image exposure time based at least in part on the peak-to-peak acceleration magnitude over the given time duration.
- adjusting the image exposure time includes calculating a minimum shutter speed.
- a camera system for determining a state of utilization for a camera comprising: a camera including an accelerometer mounted on the camera for determining an orientation of the camera with respect to gravity and a peak-to-peak acceleration magnitude over a given duration; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera using the accelerometer; determine a peak-to-peak acceleration magnitude over a given duration using the accelerometer; and identify the state of utilization for the camera based at least in part on the camera orientation determination and the peak-to-peak acceleration magnitude over a given duration.
- a computer program product for use on a processor in a camera system, the camera system including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: determining an orientation of the camera with respect to gravity using the accelerometer; and displaying an artificial horizon indicator on the viewfinder display based on the determined orientation of the camera.
- a computer program product for use on a processor in a camera system, the camera system including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: determining an orientation of the camera with respect to gravity using the accelerometer; and displaying a given icon on an image produced by the camera, wherein the given icon's orientation is based at least in part on the determination of the orientation of the camera using the accelerometer.
- a computer program product for use on a processor in a camera system, the product for adjusting image exposure time for a camera to reduce movement-induced image blurring, the camera system including an accelerometer mounted on the camera for determining camera movement; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: measureing a peak-to-peak acceleration magnitude using the accelerometer for a given time duration for the camera; adjusting the image exposure time based at least in part on the peak-to-peak acceleration magnitude over the given time duration.
- adjusting the image exposure time includes calculating a minimum shutter speed.
- a computer program product for use on a processor in a camera system, the product for determining a state of utilization for the camera system, the camera system including an accelerometer mounted on the camera for determining camera movement and orientation; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for determining an orientation of the camera using the accelerometer; determining a peak-to-peak acceleration magnitude over a given duration using the accelerometer; and identifing the state of utilization for the camera based at least in part on the camera orientation determination and the peak-to-peak acceleration magnitude over a given duration.
- Logic performing the processing functions may be partitioned into different logic blocks (e.g., programs, modules, functions, or subroutines) without changing the overall results or otherwise departing from the true scope of the invention.
- logic elements may be added, modified, omitted, performed in a different order, or implemented using different logic constructs (e.g., logic gates, looping primitives, conditional logic, and other logic constructs) without changing the overall results or otherwise departing from the true scope of the invention.
- the present invention may be embodied in many different forms, including, but in no way limited to, computer program logic for use with a processor (e.g., a microprocessor, microcontroller, digital signal processor, or general purpose computer), programmable logic for use with a programmable logic device (e.g., a Field Programmable Gate Array (FPGA) or other PLD), discrete components, integrated circuitry (e.g., an Application Specific Integrated Circuit (ASIC)), or any other means including any combination thereof.
- a processor e.g., a microprocessor, microcontroller, digital signal processor, or general purpose computer
- programmable logic for use with a programmable logic device
- FPGA Field Programmable Gate Array
- ASIC Application Specific Integrated Circuit
- Source code may include a series of computer program instructions implemented in any of various programming languages (e.g., an object code, an assembly language, or a high-level language such as FORTRAN, C, C++, JAVA, or HTML) for use with various operating systems or operating environments.
- the source code may define and use various data structures and communication messages.
- the source code may be in a computer execustructure form (e.g., via an interpreter), or the source code may be converted (e.g., via a translator, assembler, or compiler) into a computer executable structure form.
- the computer program may be fixed in any form (e.g., source code form, computer execustructure form, or an intermediate form) either permanently or transitorily in a tangible storage medium, such as a semiconductor memory device (e.g., a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM), a magnetic memory device (e.g., a diskette or fixed disk), an optical memory device (e.g., a CD-ROM), a PC card (e.g., PCMCIA card), or other memory device.
- the computer program may be fixed in any form in a signal that is transmittable to a computer using any of various communication technologies, including, but in no way limited to, analog technologies, digital technologies, optical technologies, wireless technologies, networking technologies, and internetworking technologies.
- the computer program may be distributed in any form as a removable storage medium with accompanying printed or electronic documentation (e.g., shrink wrapped software or a magnetic tape), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the communication system (e.g., the Internet or World Wide Web.)
- printed or electronic documentation e.g., shrink wrapped software or a magnetic tape
- a computer system e.g., on system ROM or fixed disk
- a server or electronic bulletin board over the communication system (e.g., the Internet or World Wide Web.)
- Hardware logic including programmable logic for use with a programmable logic device
- implementing all or part of the functionality previously described herein may be designed using traditional manual methods, or may be designed, captured, simulated, or documented electronically using various tools, such as Computer Aided Design (CAD), a hardware description language (e.g., VHDL or AHDL), or a PLD programming language (e.g., PALASM, ABEL, or CUPL.)
- CAD Computer Aided Design
- a hardware description language e.g., VHDL or AHDL
- PLD programming language e.g., PALASM, ABEL, or CUPL.
Abstract
A method and system for determining camera positioning information from an accelerometer mounted on a camera. The accelerometer measures the orientation of the camera with respect to gravity. Orientation measurement allows user interface information to be displayed in a 'right side up' orientation on a viewfinder for any camera orientation. Alternatively, an artificial horizon indicator may be displayed in the viewfinder. The accelerometer may also measure camera movement. Camera movement information together with camera orientation can be used to determine camera usage. Additionally, camera movement information can be used to determine a minimum shutter speed for a sharp picture.
Description
CAMERA WITH ACCELERATION SENSOR
Field of the Invention
The invention generally relates to cameras and, more particularly, the invention relates to detecting motion of a camera.
Background
In many cases, it is desirable to know the orientation of a camera. A digital camera, for example, could use this information to store the image such that it displays "right side up" on a computer display. Ball and cage type mechanical switches can be used to ascertain orientation, but they have reliability problems.
Summary of the Invention
In accordance with embodiments of the invention, a digital camera includes an accelerometer mounted on the camera. The accelerometer measures camera movement and/or orientation. In various embodiments of the invention, this information can be used to:
• display an artificial horizon indicator on a viewfinder to aid in orienting the camera;
• display icons on the viewfinder in a "right side up" orientation according to the camera's orientation;
• use camera movement information to determine a minimum shutter speed, to reduce motion-induced picture blurring; and
• use camera movement and orientation to determine if a camera is in use; such "in-use" information can be used, for example, to power down an idle camera or to power-up a camera that is about to be used.
In one embodiment, the accelerometer provides orientation information for the camera with respect to the earth's gravity. This orientation information allows an artificial horizon indicator to be displayed on an image on a display surface, such as a viewfinder
display attached to the camera. The user views the artificial horizon indicator and may realign the camera based on the relationship between the image and the indicator.
In another embodiment of the invention, the accelerometer provides orientation information for the camera with respect to the earth's gravity. Icons consisting of text and/or graphics are displayed on an image produced by the camera in a "right side up" orientation based on the camera orientation information received from the accelerometer. The image may be displayed on a viewfinder display or on a printed image of a picture.
A further embodiment of the invention adjusts image exposure time for a camera to reduce movement-induced image blurring. An accelerometer mounted to the camera provides acceleration information. The information is stored and peak-to-peak acceleration magnitude is calculated for the most recent time period. When picture taking is initiated, a minimum shutter speed is calculated as a function of the peak-to-peak acceleration magnitude over the most recent time period and the focal length of the camera. The exposure time of the picture may be adjusted accordingly. Another embodiment of the invention determines if a camera is in use using camera orientation and camera movement information calculated from the outputs of the accelerometer. If a camera is determined not to be in use, elements of the camera can be placed in a low-power state and reenergized when the camera usage changes.
I
Brief Description of the Drawings The foregoing features of the invention will be more readily understood by reference to the following detailed description, taken with reference to the accompanying drawings, in which:
Fig. IA shows a simplified perspective view of the front of a camera, according to an embodiment of the present invention; Fig. IB shows a plan view of the rear of the camera of fig. IA;
Fig. 2 A shows schematically typical accelerometer outputs for two orientations of the camera of fig. 1;
Fig. 2B shows possible orientation of the camera body vector relative to earth's gravity vector for orienting text and graphics, according to an embodiment of the invention.
Fig. 3 schematically shows a circuit for controlling a camera according to embodiments of the present invention;
Fig. 4 illustrates right-side-up graphics on a camera viewfϊnder, generated by an embodiment of the invention; Fig. 5 is a flow diagram for an illustrative method of using orientation information to display "right side up" graphics on a picture image, according to an embodiment of the invention;
Fig. 6 illustrates display of an artificial horizon indicator to aid in framing a picture, according to an embodiment of the invention; Fig. 7 is a flow diagram for an illustrative method of using orientation information to create an artificial horizon indicator on a display to aid in framing a picture, according to an embodiment of the invention;
Fig. 8 is a flow diagram for a method of using vibration data to determine minimum shutter speed, according to an embodiment of the invention; and Fig. 9 is a flow diagram for a method of using orientation and vibration data to determine when a camera is in use, according to an embodiment of the invention.
Detailed Description of Specific Embodiments
In various embodiments of the invention, an accelerometer can be used to determine the static orientation of a camera by measuring the direction of the earth gravity's (gravity vector) relative to the camera body. Other embodiments of the invention use an accelerometer to detect the dynamic movement of a camera. Orientation and/or dynamic movement information for a camera enable a variety of functions. Several such functions are discussed below in separate sections.
Fig. IA is a simplified perspective view of the front of an exemplary camera 10, according to an embodiment of the invention. The camera 10 includes a lens 12 with a lens aperture 14. A viewfinder window 16 allows a user to frame a picture. Pressing a shutter switch 18 initiates picture taking. Fig. IB shows a plan view of the rear of the camera. The user looks into the viewfinder window 16 and adjusts the camera's orientation to frame the picture. Alternatively, the user may look at a viewfinder display screen 18 on the back of the camera to frame the picture. In this description and in any appended claims, a "viewfinder,"
"viewfinder window" or a "viewfinder display" shall mean any visual display employed in a camera to aid in framing a picture. Mounted in the camera body may be a circuit board 22 which contains processing logic (e.g., microprocessor, ASICs, etc.) to control camera functions. Also mounted internal to the camera body is one or more accelerometers 20 to allow camera orientation and/or movement to be determined. The accelerometer may be a microelectromechanical system ("MEMS") device or another type of accelerometer capable of measurement of orientation or movement, as needed for each of the functions described below. As will be apparent, the accelerometer may be a dual-axis device, or a plurality of single-axis accelerometers may be used. Fig. 2A shows a coordinate system applied to the camera of figs. 1 A-IB. Earth's gravity is shown as a gravity vector 11 in the coordinate system, aligned along the "Y" axis. A "camera body vector" 28 is shown which is perpendicular to the long dimension of the camera. In exemplary embodiments, the orientation of the camera body vector 28 relative to the gravity vector 11 is determined from the outputs of the accelerometer. Fig. 3 is a schematic diagram of a circuit for controlling the camera 10 of figs. IA and IB, according to an embodiment of the invention. The outputs of accelerometer 20 are voltage levels, Ax 21 and Ay 22, whose values correspond the magnitude of the acceleration along "X" and "Y" axes, respectively. These accelerometer outputs are input to analog-to- digital converters 32 ("A/D"), which quantize the signals. The A/D output 34 is input to processing logic 30. The processing logic 30 may take a variety of forms, as are known in the art, including a microprocessor with memory and a stored program together with appropriate interface circuitry. Alternatively, the processing logic may take the form of dedicated logic elements ("ASIC") or the processing logic may be a mix of a microprocessor with dedicated logic elements. The output of a shutter switch 20 is input to the processing logic to allow a user to initiate picture taking. The processing logic provides outputs signals to control the shutter 34, to control the lens aperture 35, and to generate displays on the viewfinder 36 and on a viewfinder display screen 37, 18. The processing logic may also provide a variety of power conditioning outputs 38 to functional elements of the camera to put individual elements into a low power state. The display on the viewfinder and on the display window may be formed by combining text and graphics generated by the processing logic with the output of an image sensor, as is known in the art. In other embodiments of the
invention, the circuit elements for controlling the camera may take on other forms that provide similar functionality. Other embodiments of the invention may not have every element shown in fig. 3. For example, if the camera does not include a viewfmder display screen 18 on the back of the camera, the processing logic need not provide an output 37 to it.
User Interface Orientation
In a first embodiment of the invention, accelerometer(s) 20 help determine the orientation of the camera with respect to earth's gravity. Based upon this determination, text and graphics information that is normally overlaid on an image in the viewfinder, or on another display, can be automatically rotated to be "right side up" to the user, as the camera is oriented in various directions. An example is shown in Fig. 4. Camera 10 in the leftmost instance 40 is oriented in the portrait mode and the caption 44 in the viewfinder is oriented so that the text is upright for the longer dimension of the picture. When the camera is rotated 90 degrees, to the landscape mode, as shown in the middle instance 41, the caption in the viewfinder 46 is rotated to be upright for the shorter dimension of the picture. When the camera is rotated an additional 90 degrees, the caption 48 is again shown upright for the longer dimension of the picture 42. Note that the captions 44, 48 for the leftmost instance 40 and the rightmost instance 42 have opposite orientations with respect to the camera body, but the same orientation with respect to the image. This occurs because the camera body is rotated 180 degrees between the leftmost and rightmost instances. In specific embodiments of the invention, captions such as the date and time can be added to the image captured by the camera and the caption can be oriented so that it is "right side up." That is, the caption on the image may be oriented so that it is opposite to the direction of the gravity vector for the camera's orientation, (i.e., pointing in an approximately vertical direction). Note that the camera's orientation (long dimension) will not, in general, align with the gravity vector (as in the leftmost instance in fig. 3) or perpendicular to it (as in the middle instance in fig. 3). For such intermediate situations, in embodiments of the invention, the caption will be oriented so that it is most nearly right side up. Fig. 5 shows a flow diagram 500 for user interface orientation according to an embodiment of the invention. Outputs Ax 21, Ay 22 of the accelerometers 20 are sampled
510 to determine the orientation of the camera body vector 28 with respect to the earth's gravity vector 11. An accelerometer(s) capable of measuring static (non- varying) accelerations along two axes is used. The angle θ between the camera body vector 28 and the gravity vector 11 is given by: θ = Arctan ((Ay- Ayo)/( Ax- Ax0)). (1)
(The output of the accelerometer along each axis has previously been calibrated for reference orientations of the camera body vector with respect to the gravity vector, yielding values of Ax0 and Ay0. Ax0 is the value along the x-axis when the camera body vector is aligned, as shown in the upper drawing in fig. 2A; Ay0 is the value for the y-axis for alignment of camera body vector 28 perpendicular to the gravity vector, as shown in the lower drawing in fig. 2).
The orientation of the camera body vector 28 with respect to the gravity vector 11 is resolved 520 into one of four quadrants (24, 25, 26, 27) shown in fig. 2B. Text and graphics are then oriented 530, 540 as follows on the display:
Text and graphics captions are rendered 530, 540 in the viewfinder display (e.g., 44, 46, 48) with the orientation so that it most nearly matches the direction that is upright (i.e., opposite to the direction of the gravity vector). The process is repeated 550 so that as the camera body is reoriented, the orientation of the text and graphic captions in the viewfinder display track the orientation of the camera with respect to the gravity vector. In specific embodiments of the invention, this process is repeated at a set time interval.
Artificial Horizon Display
A further embodiment of the invention produces an artificial horizon display in the camera viewfinder based upon the gravity vector 11. The artificial horizon enables the picture to be framed so that one edge is parallel to the surface of the Earth. As shown in fig. 6, for example, an "artificial horizon" indicator 64 can be displayed in the viewfinder display 60 as a dashed line to aid the user in framing the photograph. The user can then rotate the camera to align the artificial horizon indicator 64 with the subject. Of course, the "artificial horizon" indicator can be reoriented in the viewfinder based on the gross orientation of the camera (portrait or landscape), as determined from the accelerometer outputs. This determination would be similar to that shown above for the "user interface orientation" embodiment of the invention.
Fig. 7 shows a flow diagram 700 for display of an artificial horizon on a camera viewfinder display according an embodiment of the invention. Outputs Ax 21, Ay 22 of the accelerometers 20 are sampled 710 to determine the orientation of the camera body with respect to the earth's gravity vector 11. The same accelerometer arrangement and calculations 720 may be used to determine camera body vector 28 orientation relative to the earth's gravity vector 11, as described above for the "right-side up" caption display embodiment of the invention. An artificial horizon vector 64 is rendered 730 on the camera viewfinder display as a dashed line based on the determined camera orientation. A reference vector 62 aligned with the viewfinder edge, may also be displayed to aid in framing the picture. Note that the misalignment of the two vectors is exaggerated in fig. 6 to illustrate the concept. The process is repeated 740 so that as the camera body moves, the orientation of the artificial horizon vector in the viewfinder display tracks the orientation of the camera with respect to the gravity vector. In specific embodiments of the invention, the repetition rate of the process may be determined by a time interval. In other embodiments of the invention, the display of the artificial horizon may take other forms besides a vector. All such displays are intended to be within the scope of the present invention and will be referred to below, including in the appended claims as an "artificial horizon indicator."
Shutter Speed Control
Sharp photographs generally require that the camera not move during exposure. The ability to hold a camera steady, however, varies a great deal from person to person. In some cases, such as when on a moving vehicle, even an experienced photographer may not be able to hold a camera very steady. In illustrative embodiments of the invention, camera vibration is used as one input (along with lighting conditions) to determine image exposure values. An accelerometer mounted to a camera measures the vibration (i.e., acceleration variation) experienced by the camera for a few hundred milliseconds before exposure to determine an appropriate minimum shutter speed to ensure a sharp picture. The peak-to-peak acceleration is used along with the focal length of the lens to determine the minimum shutter speed allowable. In a specific embodiment of the invention: minimum shutter speed = (0.5 / peak-to-peak acceleration)2 / (focal length) (2)
For example, with a 20 mm focal length and 0.5 m/s2 of vibration, the minimum shutter speed would be 1/20 second. In some embodiments of the invention, a table of minimum shutter speeds is calculated according to equation (2) and a table look-up can then be performed to determine minimum shutter speed.
As shown in fig. 3, according to an embodiment of the invention, the outputs of an accelerometer are connected to the input of an analog-to-digital ("A/D") converter 32. The output of the A/D converter is connected to processing logic 30. In this embodiment of the invention, the accelerometer needs to measure dynamic acceleration, but need not measure orientation. As shown in the flow diagram of fig. 8 800, the processing logic 30 periodically receives 810 the outputs of the A/D converter 32 and stores the A/D converter outputs and time of observation 820. When picture taking is initiated, 830, the peak-to-peak acceleration magnitude is calculated 840 for the preceding time interval based on the stored accelerometer values. Values older than the most recent time interval may be discarded. The minimum shutter speed, 850, 860 is then determined from equation 2.
In some embodiments, the peak-to-peak acceleration magnitude is calculated for more than one axis. The larger of the values of peak-to-peak acceleration magnitude for the respective axes is then used for the minimum shutter speed calculations. In preferred
embodiments of the invention, the time interval over which the peak-to-peak acceleration magnitude is determined may range from about 100 milliseconds to about 500 milliseconds.
Camera use detector
Other embodiments of the invention use accelerometers to determine if a camera is in use. For example, a camera oriented such that the lens is pointing up and experiencing very little vibration is likely set on a table and is not about to take a picture. To that end, such embodiments use an accelerometer to measure the orientation of the camera and to measure vibration. These measurements are used to determine whether the camera is in use. The determination of camera use, in turn, can be used to perform tasks to improve camera function, such as reducing power consumption.
In an embodiment of the invention, the orientation of the camera and peak-to-peak acceleration magnitude over a given duration are determined, as described in connection with the preceding embodiments of the invention. These values are then used to determine camera use. An exemplary algorithm for determining camera use is shown in fig. 9. First accelerometer outputs are read 910. In this embodiment, accelerometers to determine static acceleration (orientation) and dynamic acceleration Ax, Ay, Az along three orthogonal axes are provided. In other embodiments less than three axes may be sensed. The absolute magnitude along an axis aligned with the camera lens, Az, is measured 920 to determine if the magnitude is approximately equal to one g. If it is not, then the camera is not face up or face down, and the peak-to-peak magnitude of the acceleration (vibration) for the preceding ten seconds is compared to 15 mg. If vibration exceeds 15 mg, the camera is determined to be in use. The accelerometer outputs are then read again 910 and the process repeated. If the absolute magnitude along an axis aligned with the camera lens, Az, is approximately equal to one g 920, then the camera is face up or face down. The peak-to-peak magnitude of the acceleration (vibration) for the preceding three seconds is compared 930 to 15 mg. If vibration exceeds 15 mg, the camera is determined to be in use. The accelerometer outputs will the be read again 910 and the process repeated. If the vibration is less than 15 mg, then the camera is determined to be idle and the camera may enter 950 a "sleep" mode. In sleep mode, the accelerometer outputs are measured periodically 960. If the vibration equals or
exceeds 50 mg, the camera has been picked up and the camera enters a "wake-up" state 980. The process then repeats 910. The values for vibration magnitude and duration in this algorithm are provided for example only, and not by way of limitation. Other time duration thresholds and vibration magnitude thresholds may be used in other embodiments of the invention. In embodiments of the invention, when the camera enters the sleep mode 950, as described above, processing logic 30 place elements of the camera into a low power state. For instance, viewfinder displays may be de-energized and motors that cause optical lens zoom may be powered down. When the camera enters the wake-up state 980, these actions may be reversed to ready the camera for use. Embodiments of the invention can use a wide variety of accelerometers. For example, if implemented as a MEMS device, the accelerometer may be similar to that disclosed by U.S. Patent Number 5,939,633, which is assigned to Analog Devices, Inc. of Norwood, Massachusetts, the disclosure of which is incorporated herein, in its entirety, by reference. Accelerometers implementing non-MEMS technologies also may be used in other embodiments. Accordingly, discussion of MEMS accelerometers is by way of example only.
Systems according to embodiments of the invention may be described by the following clauses:
1. A camera system for aligning a camera to the Earth' horizon, the system comprising: a camera including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera with respect to gravity using the accelerometer; and display an artificial horizon indicator on the viewfinder display based on the determined orientation of the camera.
2. A camera system for orienting icons displayed in a camera viewfinder comprising: a camera including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; and a processor including a memory, the memory containing instructions that cause the processor to:
determine an orientation of the camera with respect to gravity using the accelerometer; and display a given icon on an image produced by the camera, wherein the given icon's orientation is based at least in part on the determination of the orientation of the camera using the accelerometer.
3. A camera system for adjusting image exposure time for a camera to reduce movement- induced image blurring, the system comprising: the camera including an accelerometer mounted on the camera for determining camera movement; and a processor including a memory, the memory containing instructions that cause the processor to: measure a peak-to-peak acceleration magnitude using the accelerometer for a given time duration for the camera; adjust the image exposure time based at least in part on the peak-to-peak acceleration magnitude over the given time duration.
4. A camera system according to clause 3, wherein adjusting the image exposure time includes calculating a minimum shutter speed.
5. A camera system for determining a state of utilization for a camera comprising: a camera including an accelerometer mounted on the camera for determining an orientation of the camera with respect to gravity and a peak-to-peak acceleration magnitude over a given duration; and a processor including a memory, the memory containing instructions that cause the processor to: determine an orientation of the camera using the accelerometer; determine a peak-to-peak acceleration magnitude over a given duration using the accelerometer; and identify the state of utilization for the camera based at least in part on the camera orientation determination and the peak-to-peak acceleration magnitude over a given duration.
Computer program products according to embodiments of the invention may be described by the following clauses:
I l
1. A computer program product for use on a processor in a camera system, the camera system including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: determining an orientation of the camera with respect to gravity using the accelerometer; and displaying an artificial horizon indicator on the viewfinder display based on the determined orientation of the camera.
2. A computer program product for use on a processor in a camera system, the camera system including an accelerometer mounted on the camera for determining camera orientation with respect to gravity and a viewfinder display; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: determining an orientation of the camera with respect to gravity using the accelerometer; and displaying a given icon on an image produced by the camera, wherein the given icon's orientation is based at least in part on the determination of the orientation of the camera using the accelerometer.
3. A computer program product for use on a processor in a camera system, the product for adjusting image exposure time for a camera to reduce movement-induced image blurring, the camera system including an accelerometer mounted on the camera for determining camera movement; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for: measureing a peak-to-peak acceleration magnitude using the accelerometer for a given time duration for the camera; adjusting the image exposure time based at least in part on the peak-to-peak
acceleration magnitude over the given time duration.
4. A computer program product according to clause 3, wherein adjusting the image exposure time includes calculating a minimum shutter speed.
5. A computer program product for use on a processor in a camera system, the product for determining a state of utilization for the camera system, the camera system including an accelerometer mounted on the camera for determining camera movement and orientation; the computer program product comprising a computer usable medium having computer readable program code thereon, the computer readable program code including program code for determining an orientation of the camera using the accelerometer; determining a peak-to-peak acceleration magnitude over a given duration using the accelerometer; and identifing the state of utilization for the camera based at least in part on the camera orientation determination and the peak-to-peak acceleration magnitude over a given duration.
Logic performing the processing functions may be partitioned into different logic blocks (e.g., programs, modules, functions, or subroutines) without changing the overall results or otherwise departing from the true scope of the invention. Oftentimes, logic elements may be added, modified, omitted, performed in a different order, or implemented using different logic constructs (e.g., logic gates, looping primitives, conditional logic, and other logic constructs) without changing the overall results or otherwise departing from the true scope of the invention.
The present invention may be embodied in many different forms, including, but in no way limited to, computer program logic for use with a processor (e.g., a microprocessor, microcontroller, digital signal processor, or general purpose computer), programmable logic for use with a programmable logic device (e.g., a Field Programmable Gate Array (FPGA) or other PLD), discrete components, integrated circuitry (e.g., an Application Specific Integrated Circuit (ASIC)), or any other means including any combination thereof.
Computer program logic implementing all or part of the functionality previously described herein may be embodied in various forms, including, but in no way limited to, a source code form, a computer exec structure form, and various intermediate forms (e.g., forms generated by an assembler, compiler, linker, or locator.) Source code may include a
series of computer program instructions implemented in any of various programming languages (e.g., an object code, an assembly language, or a high-level language such as FORTRAN, C, C++, JAVA, or HTML) for use with various operating systems or operating environments. The source code may define and use various data structures and communication messages. The source code may be in a computer execustructure form (e.g., via an interpreter), or the source code may be converted (e.g., via a translator, assembler, or compiler) into a computer executable structure form.
The computer program may be fixed in any form (e.g., source code form, computer execustructure form, or an intermediate form) either permanently or transitorily in a tangible storage medium, such as a semiconductor memory device (e.g., a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM), a magnetic memory device (e.g., a diskette or fixed disk), an optical memory device (e.g., a CD-ROM), a PC card (e.g., PCMCIA card), or other memory device. The computer program may be fixed in any form in a signal that is transmittable to a computer using any of various communication technologies, including, but in no way limited to, analog technologies, digital technologies, optical technologies, wireless technologies, networking technologies, and internetworking technologies. The computer program may be distributed in any form as a removable storage medium with accompanying printed or electronic documentation (e.g., shrink wrapped software or a magnetic tape), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the communication system (e.g., the Internet or World Wide Web.)
Hardware logic (including programmable logic for use with a programmable logic device) implementing all or part of the functionality previously described herein may be designed using traditional manual methods, or may be designed, captured, simulated, or documented electronically using various tools, such as Computer Aided Design (CAD), a hardware description language (e.g., VHDL or AHDL), or a PLD programming language (e.g., PALASM, ABEL, or CUPL.)
Although the above discussion discloses various exemplary embodiments of the invention, it should be apparent that those skilled in the art can make various modifications that will achieve some of the advantages of the invention without departing from the true scope of the invention . Other variations and modifications of the embodiments described
above are intended to be within the scope of the present invention as defined in the appended claims
Claims
1. A method for aligning a camera to the Earth's horizon, the method comprising: a. providing the camera having a viewfinder display and an accelerometer for determining camera orientation with respect to gravity ; b. determining an orientation of the camera with respect to gravity using the accelerometer; and c. displaying an artificial horizon indicator on the viewfinder display based on the determined orientation of the camera.
2. A method according to claim 1 further comprising: d. aligning the camera with respect to the earth's surface using the artificial horizon indicator on the viewfinder display.
3. A method according to claim 1 further comprising: d. displaying an reference indicator for the camera on the viewfinder display to aid in aligning the camera with respect to the earth's surface.
4. A method for orienting icons displayed in a camera image comprising: a. providing a camera, the camera including an accelerometer for determining an orientation of the camera with respect to gravity and a viewfinder display; b. determining an orientation of the camera with respect to gravity using the accelerometer; and c. displaying a given icon on an image produced by the camera, wherein the given icon's orientation is based at least in part on the determination of the orientation of the camera using the accelerometer.
5. A method according to claim 4, where the image produced by the camera is displayed on the viewfinder display.
6. A method according to claim 4, wherein displaying the given icon on an image produced by the camera includes printing the icon on a printed image.
7. A method for adjusting image exposure time for a camera to reduce movement-induced image blurring, a. providing the camera, the camera including an accelerometer; b. measuring a peak-to-peak acceleration magnitude using the accelerometer for a given time duration; and c. adjusting the image exposure time based at least in part on the peak-to-peak acceleration magnitude over the given time duration.
8. A method according to claim 8, wherein adjusting the image exposure time includes calculating a minimum shutter speed.
9. A method according to claim 9, wherein the minimum shutter speed is calculated as a function of the square of the inverse of the peak-to-peak acceleration magnitude divided by the camera focal length.
10. A method according to claim 4 wherein adjusting the image exposure time includes looking up a minimum shutter speed versus the peak-to-peak acceleration magnitude over the given time duration in a look-up table.
11. A method for determining a state of utilization for a camera comprising: a. providing the camera, the camera including an accelerometer for determining an orientation of the camera with respect to gravity and a peak-to-peak acceleration magnitude over a given duration; b. determining an orientation of the camera using the accelerometer; c. determining a peak-to-peak acceleration magnitude over a given duration using the accelerometer; d. identifying the state of utilization for the camera based at least in part on the camera orientation determination and the peak-to-peak acceleration magnitude over a given duration.
12. A method according to claim 6 further including: e. placing the camera in a lower power state based on the state of utilization.
02550/A90WO 460751.1
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US64878005P | 2005-02-01 | 2005-02-01 | |
US60/648,780 | 2005-02-01 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2006083563A2 true WO2006083563A2 (en) | 2006-08-10 |
WO2006083563A3 WO2006083563A3 (en) | 2006-12-21 |
Family
ID=36238458
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2006/001816 WO2006083563A2 (en) | 2005-02-01 | 2006-01-19 | Camera with acceleration sensor |
Country Status (3)
Country | Link |
---|---|
US (2) | US20060204232A1 (en) |
TW (1) | TWI387327B (en) |
WO (1) | WO2006083563A2 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102183233A (en) * | 2010-01-19 | 2011-09-14 | 罗伯特·博世有限公司 | Recognition method for automatic orientation |
CN102183232A (en) * | 2010-01-15 | 2011-09-14 | 罗伯特·博世有限公司 | Orientation sensor |
CN103206946A (en) * | 2013-03-25 | 2013-07-17 | 成都西可科技有限公司 | System for correcting positional deflection angles of intelligent terminal |
US8493453B2 (en) | 2009-06-05 | 2013-07-23 | Apple Inc. | Image capturing devices using orientation detectors to implement automatic exposure mechanisms |
US9800778B2 (en) | 2015-07-21 | 2017-10-24 | Qualcomm Incorporated | Camera orientation notification system |
Families Citing this family (51)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7933001B2 (en) * | 2005-07-11 | 2011-04-26 | Kabushiki Kaisha Topcon | Geographic data collecting system |
KR100708178B1 (en) | 2005-09-01 | 2007-04-16 | 삼성전자주식회사 | Method for image processing, apparatus and information storage medium storing image information therefor |
JP2007180931A (en) | 2005-12-28 | 2007-07-12 | Samsung Techwin Co Ltd | Image display device and imaging device |
US7593627B2 (en) * | 2006-08-18 | 2009-09-22 | Sony Ericsson Mobile Communications Ab | Angle correction for camera |
US7907836B2 (en) | 2007-09-12 | 2011-03-15 | Ricoh Company, Ltd. | Imaging apparatus |
GB0717858D0 (en) * | 2007-09-13 | 2007-10-24 | Ibp Group Ltd | Security system |
US8089549B2 (en) | 2007-09-19 | 2012-01-03 | Ricoh Company, Ltd. | Imaging apparatus capable of detecting and displaying information with respect to an incline thereof |
JP2009237530A (en) * | 2007-11-14 | 2009-10-15 | Ricoh Co Ltd | Lens drive device, image pickup device and lens drive method |
JP5094359B2 (en) * | 2007-12-14 | 2012-12-12 | キヤノン株式会社 | Imaging device |
US7857218B2 (en) * | 2007-12-21 | 2010-12-28 | Cognex Corporation | Handheld code reader having a motion sensor |
US10127422B1 (en) | 2007-12-21 | 2018-11-13 | Cognex Corporation | Handheld code reader having a motion sensor |
JP5065060B2 (en) * | 2008-01-16 | 2012-10-31 | キヤノン株式会社 | Imaging apparatus and control method thereof |
US20090206548A1 (en) * | 2008-02-15 | 2009-08-20 | Scott Allan Hawkins | Protective game piece cover and faceplates |
JP5150307B2 (en) * | 2008-03-03 | 2013-02-20 | 株式会社トプコン | Geographic data collection device |
JP5150310B2 (en) * | 2008-03-04 | 2013-02-20 | 株式会社トプコン | Geographic data collection device |
TWI558199B (en) | 2008-08-08 | 2016-11-11 | 尼康股份有限公司 | Carry information machine and information acquisition system |
US8228381B2 (en) * | 2008-09-03 | 2012-07-24 | Walter Accurso | Video and data capturing system and method |
US8138708B2 (en) | 2008-11-26 | 2012-03-20 | Allegro Microsystems, Inc. | Closed-loop motor driver compensation |
US8159363B2 (en) * | 2009-02-16 | 2012-04-17 | Research In Motion Limited | Using gravity to direct a rotatable camera in a handheld electronic device |
JP5495602B2 (en) * | 2009-04-02 | 2014-05-21 | オリンパスイメージング株式会社 | Imaging apparatus and imaging method |
US9014685B2 (en) * | 2009-06-12 | 2015-04-21 | Microsoft Technology Licensing, Llc | Mobile device which automatically determines operating mode |
US8732728B2 (en) * | 2009-07-20 | 2014-05-20 | Samsung Electronics Co., Ltd. | System and method to allow multiple plug-in applications real-time access to a camera application in a mobile device |
JP5127792B2 (en) | 2009-08-18 | 2013-01-23 | キヤノン株式会社 | Information processing apparatus, control method therefor, program, and recording medium |
JP5491101B2 (en) * | 2009-08-26 | 2014-05-14 | キヤノン株式会社 | Imaging device |
KR101617289B1 (en) * | 2009-09-30 | 2016-05-02 | 엘지전자 주식회사 | Mobile terminal and operation control method thereof |
KR20110061063A (en) * | 2009-12-01 | 2011-06-09 | 삼성전자주식회사 | Apparatus and method for photographing of a portable terminal |
US20110298887A1 (en) * | 2010-06-02 | 2011-12-08 | Maglaque Chad L | Apparatus Using an Accelerometer to Capture Photographic Images |
JP5570316B2 (en) * | 2010-06-17 | 2014-08-13 | キヤノン株式会社 | Imaging apparatus, control method thereof, and program |
KR101643617B1 (en) * | 2010-07-28 | 2016-08-10 | 삼성전자주식회사 | Digital photographing apparatus and method for controlling thereof |
JP5698480B2 (en) | 2010-09-02 | 2015-04-08 | 株式会社トプコン | Measuring method and measuring device |
US8588550B2 (en) * | 2010-10-04 | 2013-11-19 | Sony Corporation | Virtual level for a digital camera |
JP5250598B2 (en) * | 2010-10-05 | 2013-07-31 | 株式会社ソニー・コンピュータエンタテインメント | Image display device and image display method |
KR101752698B1 (en) * | 2011-01-06 | 2017-07-04 | 삼성전자주식회사 | Photographing device and methods thereof |
US8224176B1 (en) | 2011-01-10 | 2012-07-17 | Eastman Kodak Company | Combined ambient and flash exposure for improved image quality |
US8428308B2 (en) * | 2011-02-04 | 2013-04-23 | Apple Inc. | Estimating subject motion for capture setting determination |
US8379934B2 (en) | 2011-02-04 | 2013-02-19 | Eastman Kodak Company | Estimating subject motion between image frames |
JP2012171088A (en) * | 2011-02-24 | 2012-09-10 | Olympus Corp | Master operation input device, and master-slave manipulator |
US8736697B2 (en) | 2011-03-25 | 2014-05-27 | Apple Inc. | Digital camera having burst image capture mode |
US8736704B2 (en) | 2011-03-25 | 2014-05-27 | Apple Inc. | Digital camera for capturing an image sequence |
US8736716B2 (en) | 2011-04-06 | 2014-05-27 | Apple Inc. | Digital camera having variable duration burst mode |
EP2699963A1 (en) * | 2011-04-18 | 2014-02-26 | EyeSee360, Inc. | Apparatus and method for panoramic video imaging with mobile computing devices |
US8560004B1 (en) | 2012-08-31 | 2013-10-15 | Google Inc. | Sensor-based activation of an input device |
US9648283B2 (en) | 2013-05-16 | 2017-05-09 | Verint Americas Inc. | Distributed sensing and video capture system and apparatus |
JP6150652B2 (en) * | 2013-07-29 | 2017-06-21 | キヤノン株式会社 | IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, PROGRAM, AND RECORDING MEDIUM |
US9942384B2 (en) | 2013-09-10 | 2018-04-10 | Google Technology Holdings LLC | Method and apparatus for device mode detection |
US9159294B2 (en) | 2014-01-31 | 2015-10-13 | Google Inc. | Buttonless display activation |
EP4250738A3 (en) | 2014-04-22 | 2023-10-11 | Snap-Aid Patents Ltd. | Method for controlling a camera based on processing an image captured by other camera |
US9560260B2 (en) * | 2014-10-02 | 2017-01-31 | Sensors Unlimited, Inc. | System for determining a lens position |
CN108471725B (en) * | 2015-08-24 | 2021-09-14 | 伊利诺斯工具制品有限公司 | Multifunctional livestock measuring station |
TWI689708B (en) | 2018-12-24 | 2020-04-01 | 財團法人工業技術研究院 | Vibration sensor with monitoring function and vibration signal monitoring method thereof |
JP7450395B2 (en) * | 2020-02-03 | 2024-03-15 | キヤノン株式会社 | Display control device and its control method, program, storage medium |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19531289A1 (en) * | 1995-08-25 | 1997-02-27 | Telefunken Microelectron | Optical image recorder |
US20020030856A1 (en) * | 2000-09-14 | 2002-03-14 | Atsushi Kumagai | Image processing apparatus, image processing method, storage medium, and image information printing system |
JP2002271654A (en) * | 2001-03-12 | 2002-09-20 | Fuji Photo Film Co Ltd | Electronic camera |
Family Cites Families (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5870217A (en) * | 1981-10-23 | 1983-04-26 | Fuji Photo Film Co Ltd | Camera-shake detecting device |
US4787051A (en) * | 1986-05-16 | 1988-11-22 | Tektronix, Inc. | Inertial mouse system |
US4862172A (en) * | 1987-09-14 | 1989-08-29 | Texas Scottish Rite Hospital For Crippled Children | Computer control apparatus including a gravity referenced inclinometer |
US5363120A (en) * | 1987-10-14 | 1994-11-08 | Wang Laboratories, Inc. | Computer input device using orientation sensor |
US5826115A (en) * | 1987-11-16 | 1998-10-20 | Canon Kabushiki Kaisha | Camera with an image stabilizing function |
US4801793A (en) * | 1988-01-13 | 1989-01-31 | Eastman Kodak Company | Orientation indicating device |
US4996545A (en) * | 1989-04-03 | 1991-02-26 | Asahi Kogaku Kogyo Kabushiki Kaisha | Apparatus for correcting blurred image of camera using angular acceleration sensor and angular acceleration sensor |
USRE35583E (en) * | 1989-11-29 | 1997-08-12 | Minolta Camera Kabushiki Kaisha | Camera capable of correcting blurring |
US5440326A (en) * | 1990-03-21 | 1995-08-08 | Gyration, Inc. | Gyroscopic pointer |
EP0456414A3 (en) * | 1990-05-11 | 1992-05-20 | Matsushita Electric Industrial Co., Ltd | Slant correction for a video camera apparatus |
US5335032A (en) * | 1991-04-26 | 1994-08-02 | Canon Kabushiki Kaisha | Image stabilizing apparatus |
JPH0792533A (en) * | 1993-09-27 | 1995-04-07 | Nikon Corp | Still camera with vibration proof photographing function |
US5448322A (en) * | 1993-11-05 | 1995-09-05 | Vision Iii Imaging, Inc. | Autostereoscopic imaging apparatus and method using a parallax scanning lens aperture |
US6091448A (en) * | 1993-12-27 | 2000-07-18 | Canon Kabushiki Kaisha | Apparatus for preventing an image blur prevention device from changing states during an image recording operation |
JP3112383B2 (en) * | 1994-06-27 | 2000-11-27 | 矢崎総業株式会社 | Lock structure |
WO1996024822A1 (en) * | 1995-02-07 | 1996-08-15 | Anatoly Akimovich Kokush | Triaxial gyroscopic stabiliser for a movie or television camera |
US5604534A (en) * | 1995-05-24 | 1997-02-18 | Omni Solutions International, Ltd. | Direct digital airborne panoramic camera system and method |
US5794078A (en) * | 1995-09-11 | 1998-08-11 | Nikon Corporation | Image movement correction of camera |
US5878283A (en) * | 1996-09-05 | 1999-03-02 | Eastman Kodak Company | Single-use camera with motion sensor |
JP3480206B2 (en) * | 1996-11-26 | 2003-12-15 | ミノルタ株式会社 | Position detecting device and camera |
US5881321A (en) * | 1997-05-09 | 1999-03-09 | Cammotion, Inc.. | Camera motion sensing system |
FI981469A (en) * | 1998-06-25 | 1999-12-26 | Nokia Mobile Phones Ltd | Integrated motion detector in a mobile telecommunications device |
US6011926A (en) * | 1998-07-09 | 2000-01-04 | Cockell; Patrick G. | Horizon control |
GB2359895B (en) * | 2000-03-03 | 2003-09-10 | Hewlett Packard Co | Camera projected viewfinder |
US6709387B1 (en) * | 2000-05-15 | 2004-03-23 | Given Imaging Ltd. | System and method for controlling in vivo camera capture and display rate |
US6747690B2 (en) * | 2000-07-11 | 2004-06-08 | Phase One A/S | Digital camera with integrated accelerometers |
US7554578B2 (en) * | 2000-07-11 | 2009-06-30 | Phase One A/S | Digital camera with integrated accelerometers |
JP2002156676A (en) * | 2000-11-20 | 2002-05-31 | Olympus Optical Co Ltd | Photographing device with shake detecting function |
JP2002209136A (en) * | 2001-01-05 | 2002-07-26 | Canon Inc | Photographing device |
JP2002374572A (en) * | 2001-06-15 | 2002-12-26 | Yamaha Corp | Mobile phone |
GB0116113D0 (en) | 2001-06-30 | 2001-08-22 | Hewlett Packard Co | Tilt correction of electronic images |
US20030038779A1 (en) * | 2001-08-22 | 2003-02-27 | Baron John M. | Acceleration-responsive navigation among mode variables |
JP2003098566A (en) * | 2001-09-20 | 2003-04-03 | Canon Inc | Signal controller for oscillation detection means |
US20030076408A1 (en) * | 2001-10-18 | 2003-04-24 | Nokia Corporation | Method and handheld device for obtaining an image of an object by combining a plurality of images |
US6912386B1 (en) * | 2001-11-13 | 2005-06-28 | Nokia Corporation | Method for controlling operation of a mobile device by detecting usage situations |
KR100461787B1 (en) * | 2002-04-10 | 2004-12-14 | 학교법인 포항공과대학교 | Accelerometers using mems technology and method for manufacturing the same |
GB0208654D0 (en) | 2002-04-16 | 2002-05-29 | Koninkl Philips Electronics Nv | Image processing for video or photographic equipment |
JP2003309797A (en) * | 2002-04-17 | 2003-10-31 | Sharp Corp | Hard disk video camera provided with low power consumption mode |
US6810207B2 (en) * | 2002-05-13 | 2004-10-26 | Olympus Corporation | Camera |
EP1394555B1 (en) * | 2002-08-30 | 2012-04-25 | STMicroelectronics S.r.l. | Threshold acceleration sensor |
US7212230B2 (en) * | 2003-01-08 | 2007-05-01 | Hewlett-Packard Development Company, L.P. | Digital camera having a motion tracking subsystem responsive to input control for tracking motion of the digital camera |
US8508643B2 (en) * | 2003-01-17 | 2013-08-13 | Hewlett-Packard Development Company, L.P. | Method and system for processing an image |
JP3976061B2 (en) * | 2003-01-21 | 2007-09-12 | 松下電器産業株式会社 | Mobile device with camera |
US20040145613A1 (en) * | 2003-01-29 | 2004-07-29 | Stavely Donald J. | User Interface using acceleration for input |
US7265790B2 (en) * | 2003-07-07 | 2007-09-04 | Hewlett-Packard Development Company, L.P. | System and method for setting an image capture device to an operational mode |
US6751410B1 (en) * | 2003-07-10 | 2004-06-15 | Hewlett-Packard Development Company, L.P. | Inertial camera stabilization apparatus and method |
KR100595617B1 (en) * | 2003-11-29 | 2006-06-30 | 엘지전자 주식회사 | Horizontal and vertical of angle display method for mobile station |
US20050146620A1 (en) * | 2004-01-02 | 2005-07-07 | Monroe Darrin D. | Electronic device with image capturing and method therefor |
US7142004B2 (en) * | 2004-01-15 | 2006-11-28 | Honeywell International Inc. | Radiation hardening of logic circuitry using a cross enabled, interlocked logic system and method |
-
2006
- 2006-01-19 WO PCT/US2006/001816 patent/WO2006083563A2/en active Application Filing
- 2006-01-19 US US11/335,156 patent/US20060204232A1/en not_active Abandoned
- 2006-01-26 TW TW095102968A patent/TWI387327B/en active
-
2009
- 2009-02-20 US US12/389,446 patent/US7720376B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19531289A1 (en) * | 1995-08-25 | 1997-02-27 | Telefunken Microelectron | Optical image recorder |
US20020030856A1 (en) * | 2000-09-14 | 2002-03-14 | Atsushi Kumagai | Image processing apparatus, image processing method, storage medium, and image information printing system |
JP2002271654A (en) * | 2001-03-12 | 2002-09-20 | Fuji Photo Film Co Ltd | Electronic camera |
Non-Patent Citations (1)
Title |
---|
PATENT ABSTRACTS OF JAPAN vol. 2003, no. 01, 14 January 2003 (2003-01-14) -& JP 2002 271654 A (FUJI PHOTO FILM CO LTD), 20 September 2002 (2002-09-20) * |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8493453B2 (en) | 2009-06-05 | 2013-07-23 | Apple Inc. | Image capturing devices using orientation detectors to implement automatic exposure mechanisms |
US9007485B2 (en) | 2009-06-05 | 2015-04-14 | Apple Inc. | Image capturing devices using orientation detectors to implement automatic exposure mechanisms |
CN102183232A (en) * | 2010-01-15 | 2011-09-14 | 罗伯特·博世有限公司 | Orientation sensor |
CN102183233A (en) * | 2010-01-19 | 2011-09-14 | 罗伯特·博世有限公司 | Recognition method for automatic orientation |
CN103206946A (en) * | 2013-03-25 | 2013-07-17 | 成都西可科技有限公司 | System for correcting positional deflection angles of intelligent terminal |
US9800778B2 (en) | 2015-07-21 | 2017-10-24 | Qualcomm Incorporated | Camera orientation notification system |
Also Published As
Publication number | Publication date |
---|---|
US7720376B2 (en) | 2010-05-18 |
US20060204232A1 (en) | 2006-09-14 |
US20090154910A1 (en) | 2009-06-18 |
TW200644620A (en) | 2006-12-16 |
WO2006083563A3 (en) | 2006-12-21 |
TWI387327B (en) | 2013-02-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7720376B2 (en) | Camera with acceleration sensor | |
CN107018357B (en) | Method and apparatus for event sampling for dynamic vision sensor with respect to image formation | |
JP3513950B2 (en) | Image stabilization camera | |
KR101107537B1 (en) | Sensor-based orientation system | |
US7564482B2 (en) | Image capturing device, correction device, mobile phone, and correcting method | |
US8854482B2 (en) | Digital camera with integrated accelerometers | |
JP6098874B2 (en) | Imaging apparatus and image processing apparatus | |
US20060185432A1 (en) | Five degree of freedom intertial measurement device | |
EP2157783B1 (en) | Eyeball movement controller using principle of vestibulo-ocular reflex | |
EP1932336B1 (en) | Image stabilizing device of the mems type, in particular for image acquisition using a digital-image sensor | |
US10216002B2 (en) | Anti-shake correction system for curved optical sensor | |
WO2012153281A1 (en) | Image capturing apparatus with management and correction of inclinations | |
JP2006099109A (en) | System and method for detecting image capture device movement with two dual axis linear accelerometers | |
BRPI1013048B1 (en) | IMAGE STABILIZATION AND IMAGE CAPTURE APPARATUS | |
US20230119687A1 (en) | Multi-sensor handle controller hybrid tracking method and device | |
Bae et al. | Accurate motion deblurring using camera motion tracking and scene depth | |
JP2010160379A (en) | Camera calibration method and camera calibration device | |
JP3729214B2 (en) | Image stabilization camera | |
CN108322698A (en) | The system and method merged based on multiple-camera and Inertial Measurement Unit | |
JPH0980523A (en) | Image blurring correction camera | |
Hansson et al. | PTZ Camera Tampering Correction Using IMUs | |
KR19990073928A (en) | Head movement detection device and detection method | |
JP2008029428A (en) | Motion detector |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 06718829 Country of ref document: EP Kind code of ref document: A2 |