US20010010555A1 - Panoramic camera - Google Patents
Panoramic camera Download PDFInfo
- Publication number
- US20010010555A1 US20010010555A1 US08/872,525 US87252597A US2001010555A1 US 20010010555 A1 US20010010555 A1 US 20010010555A1 US 87252597 A US87252597 A US 87252597A US 2001010555 A1 US2001010555 A1 US 2001010555A1
- Authority
- US
- United States
- Prior art keywords
- panorama
- representation
- remote location
- capturing
- annular
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 72
- 230000007246 mechanism Effects 0.000 claims description 33
- 201000009310 astigmatism Diseases 0.000 claims description 17
- 230000001131 transforming effect Effects 0.000 claims description 16
- 238000005070 sampling Methods 0.000 claims description 13
- 238000012937 correction Methods 0.000 claims description 10
- 230000001681 protective effect Effects 0.000 claims description 9
- 230000033001 locomotion Effects 0.000 claims description 8
- 230000001419 dependent effect Effects 0.000 claims 6
- 238000004590 computer program Methods 0.000 claims 2
- 238000007373 indentation Methods 0.000 claims 1
- 230000009466 transformation Effects 0.000 abstract description 5
- 238000007796 conventional method Methods 0.000 abstract 1
- 230000003287 optical effect Effects 0.000 description 18
- 230000008901 benefit Effects 0.000 description 9
- 239000000463 material Substances 0.000 description 7
- 238000003491 array Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000003860 storage Methods 0.000 description 6
- 238000006243 chemical reaction Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 239000007787 solid Substances 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 239000012780 transparent material Substances 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 206010010071 Coma Diseases 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000001444 catalytic combustion detection Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000002939 deleterious effect Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005498 polishing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000010408 sweeping Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- G06T3/12—
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B13/00—Optical objectives specially designed for the purposes specified below
- G02B13/06—Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19617—Surveillance camera constructional details
- G08B13/19626—Surveillance camera constructional details optical details, e.g. lenses, mirrors or multiple lenses
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19617—Surveillance camera constructional details
- G08B13/19626—Surveillance camera constructional details optical details, e.g. lenses, mirrors or multiple lenses
- G08B13/19628—Surveillance camera constructional details optical details, e.g. lenses, mirrors or multiple lenses of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19678—User interface
- G08B13/19682—Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
Definitions
- the present invention relates to the field of film and video photography.
- the present invention discloses a camera device that captures a 360 degree panoramic image and display systems for displaying the panoramic image captured by the camera device.
- a full 360 degree panoramic image would allow the viewer to choose what she would like to look at. Furthermore, a full 360 degree panoramic image allows multiple viewers to simultaneously view the world from the same point, with each being able to independently choose their viewing direction and field of view.
- Apple Computer recommends and provides software tools to implement a labor-intensive process for capturing these panoramic datasets.
- QRR QuickTime® VR
- a standard 35 mm camera is mounted vertically on a leveled tripod and equipped with an extreme wide angle lens (e.g. 15-18 mm focal length).
- a sequence of twelve or more overlapping still photographs is taken at roughly 30 degree intervals as the camera is turned on the tripod around a vertical axis.
- These photographs are developed, digitized and then fed into a semi-automated software program called a “stitcher” that merges the overlapping still photographs into one long panoramic strip.
- the present invention discloses a camera device that instantaneously captures a 360 degree panoramic image. Furthermore, the present invention discloses various different systems for displaying the panoramic images.
- FIG. 1 illustrates the panoramic surroundings that are captured by the panoramic camera system of the present invention.
- FIG. 2 a illustrates a schematic diagram of the panoramic camera system of the present invention.
- FIG. 2 b illustrates a schematic diagram of the panoramic camera system of the present invention with a parabolic mirror.
- FIG. 2 c illustrates an annular image captured by the panoramic camera system of the FIG. 2 b wherein the incident angle is linearly proportional to the radial distance of the annular image.
- FIG. 3 a illustrates an example of an annular image captured by the panoramic camera system of the present invention.
- FIG. 3 b illustrates a rectangular panoramic image after the captured annular image is transformed from polar coordinates to rectangular coordinates.
- FIG. 4 a illustrates photographic film used to capture the annular panoramic image.
- FIG. 4 b illustrates a Charged Coupled Device array used to capture the annular panoramic image.
- FIG. 5 illustrates an alternate embodiment of the camera system of the present invention wherein a beam splitter is used to allow the annular image to be captured on two image planes.
- FIG. 6 a illustrates a first embodiment of two image planes used to capture different portions of a single annular panoramic image.
- FIG. 6 b illustrates a second embodiment of two image planes used to capture different portions of a single annular panoramic image.
- FIG. 7 illustrates an embodiment of the panoramic camera wherein some of the optical elements are housed within the parabolic mirror.
- FIG. 8 a illustrates a first embodiment of the panoramic camera that uses a solid transparent block to surround the parabolic mirror.
- FIG. 8 b illustrates a second embodiment that uses a solid transparent block to surround the parabolic mirror which houses other optical elements.
- FIG. 9 a illustrates an embodiment that panoramic camera that supports the convex mirror with a central post that is out of the annular field of view.
- FIG. 9 b illustrates an embodiment that panoramic camera that divides the convex mirror in quarters and supports the mirror using posts between the four quarters.
- FIG. 10 graphically illustrates how the annular image is sample to product a rectangular panoramic image.
- FIG. 11 a graphically illustrates how an image is stored in Apple® Computer's QuickTime® VR format.
- FIG. 11 b graphically illustrates how viewports are created from Apple® Computer's QuickTime® VR format.
- FIG. 11 c illustrates a flow chart that lists how the panoramic camera system can be used to create images in Apple® Computer's QuickTime® VR format.
- FIG. 12 a illustrates a graphical user interface for a client program used to view panoramic still images created by the panoramic camera system.
- FIG. 13 a illustrates a graphical user interface for a client program used to view panoramic video created by the panoramic camera system.
- FIG. 13 b illustrates a networked computer arrangement used to view panoramic video created by the panoramic camera system.
- FIG. 14 a illustrates a side view of one embodiment of the panoramic camera system that includes microphones.
- FIG. 14 b illustrates a side view of one embodiment of the panoramic camera system that includes microphones.
- a method and apparatus for a camera device that instantaneously captures 360 degree panoramic images is disclosed.
- specific nomenclature is set forth to provide a thorough understanding of the present invention.
- these specific details are not required in order to practice the present invention.
- the present invention has been described with reference to Charge Coupled Devices.
- the panoramic camera system can easily be implemented with other types of electronic image capture systems.
- FIG. 1 graphically illustrates the cylindrical panoramic view of which the panoramic camera system captures an image.
- the present invention uses a carefully designed and engineered collection of mirrors and lenses.
- the basic design of the panoramic camera of the present invention is illustrated in FIG. 2 a . Each element of the panoramic camera will be described individually.
- the panoramic camera of the present invention collects light using a convex mirror 210 that is in the approximate shape of parabolic cone.
- the tip of the convex mirror 210 is pointed downward as illustrated in FIG. 2 a .
- the parabolic mirror 210 presents an annular image of the surrounding panorama as illustrated in FIG. 3 a .
- the annular image is distorted and suffers from optical defects due to the shape of the convex mirror 210 .
- the distortion in the image is partly due to the fact that the convex mirror 210 of the imaging system effectively converts the surrounding panorama to a polar coordinate system.
- the mapping of the elevation angle of incoming light to radial distance in the annular image can be controlled.
- the convex mirror 210 is a parabolic mirror that creates an annular image wherein the radial distance from the center of the annual image is linearly proportional to the angle of incident light.
- a panoramic camera system with a parabolic mirror is illustrated in FIG. 2 b . Note that in the image plane of FIG. 2 b , the distance from the center is linearly proportional to the angle of incident light. This concept is more clearly illustrated in FIG. 3 c , wherein the concentric circles represent different angles of incident light.
- the convex mirror of the present invention introduces other image defects that require careful correction.
- One particular problem is astigmatism. Specifically, the light reflected downward from the convex mirror 210 of the present invention will not meet at a single focal point. To correct for this problem, an astigmatism correction lens 220 is added to correctly focus the light from the convex mirror 210 .
- the astigmatism correction lens 220 comprises a group of 2 or more lenses whose group focal length is long but with individual elements of strong and opposite power.
- the astigmatism lens group may be made of the same optical material without introducing significant lateral color. Since the beam size associated with any object point in space to be imaged is quite small compared to the field of the beam, the strong elements tend to introduce deleterious amounts of spherical aberration or coma into the final image.
- the next component is a standard camera objective lens 230 .
- the standard camera objective lens 230 forms an image using the astigmatism-corrected, reflected light from the convex mirror 210 .
- a standard off-the-shelf camera lenses that are optimized for cost and performance in the conventional photography market.
- the current embodiment relies upon a pre-defined focal length.
- the focal length of the standard objective lens is selected based on two factors.
- the first factor is the maximum angular field of view present by the convex mirror and astigmatism correction lens group. This factor is determined by the largest angle away from the horizon of an object to be captured.
- the second factor is the maximum diameter of the circular image to be recorded. In an embodiment that uses 35 mm film, this value would not exceed 24 mm. In an embodiment that uses Charged Coupled Device arrays, the objective lens must keep the circular image within the bounds of the CCD array.
- the appropriate focal length is 22 mm. Since there are many objective lenses available with focal lengths in the 18 mm to 24 mm range, this focal length provides many off-the-shelf lens choices.
- the present invention “false focuses” the image beyond the normal focal plane. This allows the next optical element (field flattening lens) to fit between the objective lens 230 and the image plane.
- Another optical problem created by the parabolic mirror is a curved image field that is created by the curve of the parabolic mirror.
- the curved image field problem is solved by add yet another lens 240 .
- This final lens is a “field flattening” lens, that flattens the field of optimal focus to a flat two dimensional image plane.
- the field flattening lens 240 must be kept as close to the image plane as practical to eliminate the need for a focal plane shutter.
- the material SFL 6 is used to create the field flattening lens 240 . Due to its high index of refraction, SFL 6 allows the field flattening lens 240 to be approximately 2 millimeters thick. If the field flattening lens 240 was created using more traditional materials, the field flattening lens 240 would be approximately 4.5 millimeters thick.
- the final major component of the panoramic camera design is the image capture mechanism 250 .
- the image capture mechanism 250 is placed at the image plane just beneath the field flattening lens 240 . This mechanism captures the optimized two dimensional annular image of the surrounding panorama.
- An example of a captured panorama stored as a two dimensional annular representation is shown in FIG. 3 a.
- the image capture mechanism can be a frame of photographic film as illustrated in FIG. 4 a .
- the series of images may be several distinct still images taken from different locations.
- the series of images may be a set of successive images recorded used to create a panoramic motion picture.
- the image that is recorded onto photographic film is then later converted into a digital image for digital image processing as will be described in later sections of this document.
- a high resolution digital image capture system is used to capture the annular image created by the optical elements.
- a Charged Coupled Device (CCD) array 450 is placed in the image plane to capture the image as illustrated in FIG. 4 b .
- Control circuitry 460 coupled to the CCD array 450 captures the image directly into a digital format.
- the use of a digital image capture system allows an immediate read-out of the digitized raw annular image.
- the digitized raw annular image can be stored into a storage device 470 such as flash memory or a hard disk drive.
- the CCD array 450 may be color (RGB) or black & white, depending on the intended application.
- alternate embodiments of the present invention use a set of lower resolution CCD arrays.
- consumer grade CCD devices that are targeted at the consumer electronics market are used.
- Consumer electronics grade CCD arrays have the distinct advantages of lower cost, more highly-integrated support circuitry availability, high speed read-out, robustness to extreme lighting and other environmental conditions.
- One method of creating an acceptable image capture mechanism using consumer grade CCD arrays is to use multiple low resolution CCD chips to cover the image plane using a mosaic pattern.
- the basic panoramic camera configuration described in the previous sections is illustrated except the last stage has an added beam-splitter 545 that directs a second image to a second field flattening lens 541 and a second image plane 551 .
- the beam-splitter 545 may comprise a half-silvered mirror or a prism arrangement as is known in the art.
- the two image planes (image plane 551 and image plane 553 ) each capture a portion of the whole annular image.
- the camera optically composites the images from the two different image planes into a single image.
- FIGS. 6 a and 6 b each illustrate one possible embodiment of the dual image plane image capture system.
- FIG. 6 a illustrates a mosaic pattern create with four consumer grade CCD devices. As illustrated in FIG. 6 a , the two image planes capture the whole annular image while each image plane leaves room for the chip lead frames and support circuitry.
- FIG. 6 b illustrates an alternate embodiment that six consumer grade CCD devices.
- An additional advantage of this scheme is that the CCD array chips can potentially share some supporting circuitry since the signals each independent chip is requiring are often identical.
- a disadvantage of the mosaic technique is the image capture variation that will exists between the different CCD chips.
- the image variation can be compensated for by having overlapping CCD array coverage.
- the overlapping area is used to cross calibrate the image variation between adjacent CCD arrays.
- FIG. 7 illustrates an alternative embodiment of the panoramic camera system.
- the camera subassembly is housed within the parabolic mirror.
- the convex mirror 710 is inverted and a hole is cut into the tip.
- a second mirror 715 is placed above the convex mirror 710 , directing the light from the surrounding panorama into the hole in the top of the convex mirror 710 .
- the remainder of the optical path, including the astigmatism correction lens 720 , the objective lens 730 , the field flattening lens 740 , and the image capture mechanism 750 are all housed inside the inverted convex mirror 710 . It is apparent from the diagram of FIG. 7 that the “folded optics” configuration protects the optical path and mechanical parts of the panoramic camera system.
- the convex mirror is formed as the internal space of a curved block of transparent material such as glass or plastic.
- the mirror surface 810 is formed by the inner surface of hole that is milled or cast in the top of the transparent material 805 .
- the shape of the outer surface approximates a sphere centered on the virtual focal point of the convex mirror 810 .
- the outer surface of the transparent material is a polished surface that forms the outside skin of the camera.
- the bottom tip of the transparent block is optically mated to the other optical parts of the camera system.
- the bottom tip may be polished flat or molded into a shape that contributes to the astigmatism lens group.
- the solid transparent block approach has a number of significant advantages.
- the mirrored inner surface of the transparent block material can be well protected. This technique overcomes the disadvantages of front surface mirrors. Specifically, when front surface mirrors are exposed to the outside world they are susceptible to damage and degradation. In the above described embodiment, the mirrored surface is fully protected since it is encased between a protective backing material and the transparent block material.
- Another advantage of the solid block approach is that the skin of the camera is incorporate into the optical system. Thus only one surface would need to be multicoated to prevent internal reflections.
- FIG. 8 b illustrates an inverted solid transparent block used to implement a panoramic camera system.
- the camera components are contained within the mirror cavity.
- the outside surface at the top of the block is no longer an exit path bus is instead a mirrored surface that directs the image light down into an optical path inside the parabolic block.
- Different methods can be used to construct a transparent block panoramic camera system.
- One method would be to create the transparent block, then polish the transparent block, and finally add a mirrored surface where appropriate.
- An alternate method of constructing a transparent block panoramic camera system would start with the convex mirror. Then, the convex mirror would be encapsulated within the transparent block. This method would be simpler to construct since a concave surface would not require polishing. Furthermore, the convex mirror would be protected by the transparent block.
- FIG. 9 a discloses an alternate embodiment wherein a central post 903 is used to support the parabolic mirror 910 .
- the remainder of the optical system is below the parabolic mirror 910 and the central post 903 .
- the center support scheme takes advantage of the fact that the center of the annular image is discarded since it contains only an image of the camera itself. Therefore, the center portion of the annular image can be used for support of the parabolic mirror 910 .
- Another scheme for supporting the parabolic mirror above the optical elements below is to use several side supports. This can be accomplished by splitting the parabolic mirror into “pie-pieces” by cutting the parabolic mirror after fabrication. For example, the parabolic mirror can be quartered as illustrated in FIG. 9 b .
- the four sections of parabolic mirror 1021 , 1022 , 1023 , and 1024 can be spread apart slightly, allowing for the introduction of supporting elements 1031 , 1032 , 1033 , and 1034 that will not obstruct the fields of view.
- the panoramic camera system of the present invention records a two dimensional annular representation of the surrounding panorama.
- the annular representation is not of much interest to most viewers. Therefore, to display the panoramic images captured by the panoramic camera of the present invention, several different display systems are disclosed.
- FIG. 3 b An example of this type of panoramic image presentation is illustrated in FIG. 3 b .
- Such rectangular panoramic images are commonly displayed in nature magazines.
- the prior art method of creating such rectangular panoramic images was to take several convention photographs at different angles and then stitch those photographs together somehow.
- panoramic camera system of the present invention With the panoramic camera system of the present invention, such rectangular panoramic images can easily be created. First the panoramic camera system of the present invention is used to capture an annular image of the surrounding panorama. Then the annular image is digitized and loaded into a computer system. (The image will already be in digital form if a CCD version of the panoramic camera system was used to capture the image.)
- a custom conversion program is then executed on the computer system.
- the custom conversion program scans around the annular image starting at an arbitrarily chosen sampling line 310 . Points along the sampling line 310 are sampled and then their position changed using polar coordinate to rectangular coordinate conversion.
- FIG. 10 illustrates how two different points on the annular image are sampled and then placed into rectangular coordinates. As illustrated in FIG. 10, the orientation of the sampling pattern changes as the coordinate transform program rotates around the annular image. The resulting rectangular image is illustrated in FIG. 3 b.
- sampling shape is dynamically changing depending on the viewing angle (both in the horizontal and vertical).
- sampling shape orientation is different depending on the horizontal viewing angle.
- the corresponding rectangular image portion will have better image clarity.
- the outer perimeter of the annular image may be the top or the bottom of the rectangular image depending on the optical path. (Compare FIG. 2 a with FIG. 7). In FIG. 10, the lower portion of the rectangular image will have a better image clarity since the it is from the outer perimeter of the annular image.
- One embodiment of the present invention takes advantage of this fact by using the outer perimeter of the annular image for the ground since the ground in a panoramic scene is generally more detailed than the sky.
- the rectangular image can be presented to viewers in a number of different formats.
- the rectangular image may be distributed electronically as a JPEG image and viewed with JPEG image viewers.
- the rectangular image can be printed out with a color printer. It should be noted that since the rectangular image is in digital form, it can quickly be added to a publication being created with a Desktop Publishing Layout Program such QuarkXpress or Adobe's PageMaker.
- Apple Computer introduced a standard known as QuickTime® VR for storing and displaying virtual reality images. Apple Computer's QuickTime® VR standard governs the data storage format and the playback software needed to view the QuickTime® VR datasets.
- the camera system of the present invention can be used to quickly create QuickTime® VR datasets.
- the QuickTime® VR format stores the image as cylindrical image as illustrated in FIG. 11 a. Specifically, the viewpoint is at the center of the cylinder and the inner surface of the cylinder represents the stored QuickTime® VR image. Note that trapezoid shaped patches must be sampled to generate an image if the user is looking up or down as illustrated in FIG. 11 b.
- FIG. 11 c illustrates a flow diagram that lists the steps required to produce a QuickTime® VR dataset using the panoramic camera system of the present invention.
- a panoramic image is recorded with the panoramic camera.
- the recorded image is digitized and loaded into a computer system. If the panoramic camera recorded the image on a piece of film, then a print of the film can be scanned into the computer system using a flatbed scanner. Alternatively, a film image can be commercially transformed into the well known PhotoCD® format produced by Kodak®. If the panoramic camera recorded the image with a CCD array and stored the image digitally, then the digital image is just copied from the camera's storage system into the computer system 's storage system.
- a transformation program is then executed on the computer system at step 1130 in order to transform the digitized annular image into a QuickTime® VR dataset.
- the annular image produced by the camera system of the present invention stores the panoramic image information in a polar coordinate system.
- Apple®'s QuickTime® VR uses a cylindrical coordinate system as illustrated in FIG. 11 a .
- the transformation program converts the annular image from its polar coordinate system into the QuickTime® VR cylindrical coordinate system.
- a file is created using the QuickTime® VR file format at step 1135 .
- the transformed image can be view using Apple's QTVR player program as stated in step 1140 .
- the present invention can store the annular image in digital form, a very useful method of distributing panoramic images is through a computer network.
- the hypertext transport protocol (http) of the World Wide Web (WWW) on the Internet can be used to distribute still annular images.
- the still annular images would be stored on a World Wide Web server.
- any user coupled to the Internet would used a World Wide Web browser program.
- One method of transporting the images would be to define a new panoramic image annular data format.
- the images could then be downloaded as stored in the panoramic image annular data format.
- a helper application would then display the images once downloaded.
- FIG. 12 a illustrates a graphical user interface for one possible client panoramic image presentations system.
- a set of different panoramic images to display is available. To display one of those images, the user selects the image with a cursor control device.
- viewport On the upper left of the graphical user interface of FIG. 12 a is viewport for displaying a portion of a panoramic image. Pan arrows on either side of the viewport allow the user to pan left and right.
- FIGS. 13 a and 13 b illustrate one possible video presentation system.
- a CCD version of the panoramic camera system 1205 of the present invention is illustrated coupled to a computer system 1200 .
- the CCD version of the panoramic camera system 1205 is coupled through a panoramic camera interface 1210 .
- the panoramic camera interface 1210 receives a digital stream of annular images.
- one embodiment of the panoramic camera interface 1210 is the FireWire system that is described in the IEEE 1394 standard.
- the Annular “Video” comprises a series of a consecutive annular images taken with a CCD version of the panoramic camera system 1205 .
- the annular frames must be converted from the annular image format into normal video images.
- only a portion of the annular image is converted into normal video.
- the aspect ratio of video does not allow for good viewing of wide but short rectangular panoramic images.
- the transformation can be done in real-time without requiring exceedingly fast computer equipment.
- the transformation of annular video to normal video is done by annular to video conversion units 1240 and 1243 .
- existing video streaming software 1260 and 1263 can be used.
- the video can be provided to computer users coupled to a network.
- FIG. 13 b illustrates one possible embodiment of a graphical user interface (GUI) for accessing the annular video.
- GUI graphical user interface
- a video viewport 1340 is used to display the video.
- a smaller still panoramic image 1310 is used to illustrate a static version of the full panoramic video.
- a locator window 1315 is used to identify the view angle that the video window 1340 is displaying within the full panoramic view that is available.
- the user can select a pan right arrow 1347 or a pan left arrow 1343 with a cursor 1320 .
- the user can simply move the position of the locator window 1315 within the still panoramic image 1310 .
- the entire vertical image aspect of the image is compressed into the video viewport 1340 , however in other embodiments the,
- user input processing routines 1250 and 1253 processing the user's commands.
- the new viewpoint is communicated to the respective annular to video conversion units 1240 or 1243 such that it will begin converting images from the new user viewpoint.
- the user input processing routines are place within the client program on the client computer system.
- a plug-in program can process the user commands and simply pass the location of the video viewport to the server.
- a parameter window 1350 is also available to the viewer.
- the parameter window 1350 allows the user to adjust some of the viewing parameters such as Image Brightness 1352 , Image Tint 1353 and Image Contrast 1355 .
- the changes will be processed by the user input processing routines 1250 and 1253 provided to the annular to video conversion units 1240 or 1243 or the video streaming software 1260 or 1263 such that video quality is changed.
- the present invention can be combined with a three dimensional sound system.
- FIGS. 14 a and 14 b an embodiment of the camera system is illustrated with four directional microphones 1441 , 1442 , 1443 , and 1444 .
- the four directional microphones 1441 , 1442 , 1443 , and 1444 capture sound emanating from four cardinal directions.
- the sound from the various directional microphones is mixed depending on the viewing angle that a user has selected. For example, if a viewer that is seeing a real-time image from camera 1400 of FIG. 14 a is viewing straight out of the page, then the left speaker will receive information from microphone 1443 and the right speaker will receive information from microphone 1441 .
- the sound can be provided to users on a computer network using audio streaming software such as RealAudio by Progressive Networks, Inc. As the viewer adjusts the viewing angle, the sound from the directional microphones will be adjusted accordingly.
- the user By adding sound to the system, the user is provided with a cues as to which direction they should be viewing. For example, if the user hears a sound from “behind”, then the user can change the view angle to look backward.
Abstract
Description
- This application claims the benefit of the U.S. provisional patent application with Ser. No. 60/020,292 that was filed on Jun. 24, 1996.
- The present invention relates to the field of film and video photography. In particular the present invention discloses a camera device that captures a 360 degree panoramic image and display systems for displaying the panoramic image captured by the camera device.
- Most cameras only provide a small viewing angle. Thus, a typical conventional camera only captures an image in the direction that the camera is aimed. Limited view cameras force viewers to look only at what the camera operator chooses to focus on. Some cameras use a specialized wide angle lens to capture a wider panoramic image, but such panoramic cameras still have a limited field of view.
- It would be desirable to have a camera system that would capture the light from all directions such that a full 360 degree panoramic image can be created. A full 360 degree panoramic image would allow the viewer to choose what she would like to look at. Furthermore, a full 360 degree panoramic image allows multiple viewers to simultaneously view the world from the same point, with each being able to independently choose their viewing direction and field of view.
- At the present time, there are some known methods of creating 360 degree panoramic images. However, most current methods are subject to limitations due to their physical movements and mechanical complexity. For example, some of the current methods operate by combining a series of individual photographs taken in different directions into a single panoramic image. Some panoramic cameras spin a lens and film to capture a panoramic view in a single sweeping motion.
- There is a market for panoramic photos to be used in multimedia applications, typically provided on CD-ROMs. In the last few years, some software manufacturers have introduced standards for digital storage and computer playback of panoramic datasets. One example is QuickTime® VR, introduced by Apple® Computer, Inc. Apple® Computer's QuickTime® VR standard governs the file storage format and the playback software needed to view their datasets.
- Currently, Apple Computer recommends and provides software tools to implement a labor-intensive process for capturing these panoramic datasets. In the Apple QuickTime® VR (QTVR) process a standard 35 mm camera is mounted vertically on a leveled tripod and equipped with an extreme wide angle lens (e.g. 15-18 mm focal length). A sequence of twelve or more overlapping still photographs is taken at roughly 30 degree intervals as the camera is turned on the tripod around a vertical axis. These photographs are developed, digitized and then fed into a semi-automated software program called a “stitcher” that merges the overlapping still photographs into one long panoramic strip.
- The labor intensive process suffers from a number of shortcomings. First, the process is time-consuming since many steps requiring human intervention and guidance. Furthermore, the recommended process is prone to temporal artifacts since it captures each individual photo at a different time. This means that the “stitched” pan image is not instantaneous but rather is made up of individual photos taken at different times. The time change during the series of photographs makes it nearly impossible to create panoramic images in changing scenes containing shorelines, urban crowds and traffic, windblown trees, etc. Finally, it is difficult to see how the image capture method recommended by Apple QuickTime® VR (QTVR) can be extended from a single still panoramic image into a continuous frame, or motion picture panoramic image capture.
- The present invention discloses a camera device that instantaneously captures a 360 degree panoramic image. Furthermore, the present invention discloses various different systems for displaying the panoramic images.
- In the camera device, virtually all of the light that converges on a point in space is captured. Specifically, in the camera of the present invention, light striking this point in space is captured if it comes from any direction, 360 degrees around the point and from angles 50 degrees or more above and below the horizon as illustrated in FIG. 1.
- Other objects, features and advantages of present invention will be apparent from the company drawings and from the following detailed description that follows below.
- The objects, features and advantages of the present invention will be apparent to one skilled in the art, in view of the following detailed description in which:
- FIG. 1 illustrates the panoramic surroundings that are captured by the panoramic camera system of the present invention.
- FIG. 2a illustrates a schematic diagram of the panoramic camera system of the present invention.
- FIG. 2b illustrates a schematic diagram of the panoramic camera system of the present invention with a parabolic mirror.
- FIG. 2c illustrates an annular image captured by the panoramic camera system of the FIG. 2b wherein the incident angle is linearly proportional to the radial distance of the annular image.
- FIG. 3a illustrates an example of an annular image captured by the panoramic camera system of the present invention.
- FIG. 3b illustrates a rectangular panoramic image after the captured annular image is transformed from polar coordinates to rectangular coordinates.
- FIG. 4a illustrates photographic film used to capture the annular panoramic image.
- FIG. 4b illustrates a Charged Coupled Device array used to capture the annular panoramic image.
- FIG. 5 illustrates an alternate embodiment of the camera system of the present invention wherein a beam splitter is used to allow the annular image to be captured on two image planes.
- FIG. 6a illustrates a first embodiment of two image planes used to capture different portions of a single annular panoramic image.
- FIG. 6b illustrates a second embodiment of two image planes used to capture different portions of a single annular panoramic image.
- FIG. 7 illustrates an embodiment of the panoramic camera wherein some of the optical elements are housed within the parabolic mirror.
- FIG. 8a illustrates a first embodiment of the panoramic camera that uses a solid transparent block to surround the parabolic mirror.
- FIG. 8b illustrates a second embodiment that uses a solid transparent block to surround the parabolic mirror which houses other optical elements.
- FIG. 9a illustrates an embodiment that panoramic camera that supports the convex mirror with a central post that is out of the annular field of view.
- FIG. 9b illustrates an embodiment that panoramic camera that divides the convex mirror in quarters and supports the mirror using posts between the four quarters.
- FIG. 10 graphically illustrates how the annular image is sample to product a rectangular panoramic image.
- FIG. 11a graphically illustrates how an image is stored in Apple® Computer's QuickTime® VR format.
- FIG. 11b graphically illustrates how viewports are created from Apple® Computer's QuickTime® VR format.
- FIG. 11c illustrates a flow chart that lists how the panoramic camera system can be used to create images in Apple® Computer's QuickTime® VR format.
- FIG. 12a illustrates a graphical user interface for a client program used to view panoramic still images created by the panoramic camera system.
- FIG. 13a illustrates a graphical user interface for a client program used to view panoramic video created by the panoramic camera system.
- FIG. 13b illustrates a networked computer arrangement used to view panoramic video created by the panoramic camera system.
- FIG. 14a illustrates a side view of one embodiment of the panoramic camera system that includes microphones.
- FIG. 14b illustrates a side view of one embodiment of the panoramic camera system that includes microphones.
- A method and apparatus for a camera device that instantaneously captures 360 degree panoramic images is disclosed. In the following description, for purposes of explanation, specific nomenclature is set forth to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that these specific details are not required in order to practice the present invention. For example, the present invention has been described with reference to Charge Coupled Devices. However, the panoramic camera system can easily be implemented with other types of electronic image capture systems.
- The panoramic camera design of the present invention captures light from all directions within 50 to 60 degrees above and below the horizon simultaneously. FIG. 1 graphically illustrates the cylindrical panoramic view of which the panoramic camera system captures an image. To capture all the light of the panorama and generate a two dimensional representation that may easily be recorded, the present invention uses a carefully designed and engineered collection of mirrors and lenses. The basic design of the panoramic camera of the present invention is illustrated in FIG. 2a. Each element of the panoramic camera will be described individually.
- The Mirror
- Referring to FIG. 2a, the panoramic camera of the present invention collects light using a
convex mirror 210 that is in the approximate shape of parabolic cone. In one embodiment of the present invention, the tip of theconvex mirror 210 is pointed downward as illustrated in FIG. 2a. When theconvex mirror 210 is viewed from below, theparabolic mirror 210 presents an annular image of the surrounding panorama as illustrated in FIG. 3a. However, the annular image is distorted and suffers from optical defects due to the shape of theconvex mirror 210. - The distortion in the image is partly due to the fact that the
convex mirror 210 of the imaging system effectively converts the surrounding panorama to a polar coordinate system. By adjusting the shape of theconvex mirror 210, the mapping of the elevation angle of incoming light to radial distance in the annular image, can be controlled. - In a preferred embodiment, the
convex mirror 210 is a parabolic mirror that creates an annular image wherein the radial distance from the center of the annual image is linearly proportional to the angle of incident light. A panoramic camera system with a parabolic mirror is illustrated in FIG. 2b. Note that in the image plane of FIG. 2b, the distance from the center is linearly proportional to the angle of incident light. This concept is more clearly illustrated in FIG. 3c, wherein the concentric circles represent different angles of incident light. - The Astigmatism Correction Lens
- The convex mirror of the present invention introduces other image defects that require careful correction. One particular problem is astigmatism. Specifically, the light reflected downward from the
convex mirror 210 of the present invention will not meet at a single focal point. To correct for this problem, anastigmatism correction lens 220 is added to correctly focus the light from theconvex mirror 210. - The
astigmatism correction lens 220 comprises a group of 2 or more lenses whose group focal length is long but with individual elements of strong and opposite power. Thus, the astigmatism lens group may be made of the same optical material without introducing significant lateral color. Since the beam size associated with any object point in space to be imaged is quite small compared to the field of the beam, the strong elements tend to introduce deleterious amounts of spherical aberration or coma into the final image. - The Objective Lens
- The next component is a standard
camera objective lens 230. The standardcamera objective lens 230 forms an image using the astigmatism-corrected, reflected light from theconvex mirror 210. In the present embodiment, a standard off-the-shelf camera lenses, that are optimized for cost and performance in the conventional photography market. The current embodiment relies upon a pre-defined focal length. - The focal length of the standard objective lens is selected based on two factors. The first factor is the maximum angular field of view present by the convex mirror and astigmatism correction lens group. This factor is determined by the largest angle away from the horizon of an object to be captured. The second factor is the maximum diameter of the circular image to be recorded. In an embodiment that uses 35 mm film, this value would not exceed 24 mm. In an embodiment that uses Charged Coupled Device arrays, the objective lens must keep the circular image within the bounds of the CCD array.
- For one preferred embodiment, the appropriate focal length is 22 mm. Since there are many objective lenses available with focal lengths in the 18 mm to 24 mm range, this focal length provides many off-the-shelf lens choices.
- To allow a standard off-the-shelf camera lens to be used, the present invention “false focuses” the image beyond the normal focal plane. This allows the next optical element (field flattening lens) to fit between the
objective lens 230 and the image plane. - The Field Flattening Lens
- Another optical problem created by the parabolic mirror is a curved image field that is created by the curve of the parabolic mirror. The curved image field problem is solved by add yet another
lens 240. This final lens is a “field flattening” lens, that flattens the field of optimal focus to a flat two dimensional image plane. Thefield flattening lens 240 must be kept as close to the image plane as practical to eliminate the need for a focal plane shutter. - In one embodiment, the material SFL6 is used to create the
field flattening lens 240. Due to its high index of refraction, SFL6 allows thefield flattening lens 240 to be approximately 2 millimeters thick. If thefield flattening lens 240 was created using more traditional materials, thefield flattening lens 240 would be approximately 4.5 millimeters thick. - The Image Capture System
- The final major component of the panoramic camera design is the
image capture mechanism 250. Theimage capture mechanism 250 is placed at the image plane just beneath thefield flattening lens 240. This mechanism captures the optimized two dimensional annular image of the surrounding panorama. An example of a captured panorama stored as a two dimensional annular representation is shown in FIG. 3a. - In one embodiment of the present invention, the image capture mechanism can be a frame of photographic film as illustrated in FIG. 4a. Using convention photography techniques, several successive frames can be used to record series of images. The series of images may be several distinct still images taken from different locations. Alternatively, the series of images may be a set of successive images recorded used to create a panoramic motion picture. The image that is recorded onto photographic film is then later converted into a digital image for digital image processing as will be described in later sections of this document.
- In the preferred embodiment of the present invention, a high resolution digital image capture system is used to capture the annular image created by the optical elements. In one embodiment of the present invention a Charged Coupled Device (CCD)
array 450 is placed in the image plane to capture the image as illustrated in FIG. 4b.Control circuitry 460 coupled to theCCD array 450 captures the image directly into a digital format. The use of a digital image capture system allows an immediate read-out of the digitized raw annular image. The digitized raw annular image can be stored into astorage device 470 such as flash memory or a hard disk drive. TheCCD array 450 may be color (RGB) or black & white, depending on the intended application. - To generate an annular image of sufficient quality to be used in the Apple QuickTime® VR market, it has been determined that the image plane must be sampled with an array having at least 2K by 2K elements. To meet this requirement, one embodiment of the present invention uses a CCD array produced by Loral-Fairchild, Inc. However, the high resolution CCD array sold by Loral-Fairchild, Inc. adds a significant cost to the panoramic camera of the present invention. Furthermore, large CCD arrays such as the Loral-Fairchild array have difficulty handling the extreme differences in light intensity that are produced optical system of the present invention. Specifically, one area of the image may have direct sunlight and other areas may receive comparatively little light.
- To reduce the production cost of the panoramic camera, alternate embodiments of the present invention use a set of lower resolution CCD arrays. Specifically, consumer grade CCD devices that are targeted at the consumer electronics market are used. Consumer electronics grade CCD arrays have the distinct advantages of lower cost, more highly-integrated support circuitry availability, high speed read-out, robustness to extreme lighting and other environmental conditions.
- No individual consumer grade CCD array meets the high resolution requirements needed by the present invention (at least 2K by 2K elements). Therefore, a method of obtaining a greater image resolution is required if consumer grade CCDs are used.
- One method of creating an acceptable image capture mechanism using consumer grade CCD arrays is to use multiple low resolution CCD chips to cover the image plane using a mosaic pattern. Referring to FIG. 5, the basic panoramic camera configuration described in the previous sections is illustrated except the last stage has an added beam-
splitter 545 that directs a second image to a secondfield flattening lens 541 and asecond image plane 551. The beam-splitter 545 may comprise a half-silvered mirror or a prism arrangement as is known in the art. The two image planes (image plane 551 and image plane 553) each capture a portion of the whole annular image. To construct a complete image, the camera optically composites the images from the two different image planes into a single image. - FIGS. 6a and 6 b each illustrate one possible embodiment of the dual image plane image capture system. FIG. 6a illustrates a mosaic pattern create with four consumer grade CCD devices. As illustrated in FIG. 6a, the two image planes capture the whole annular image while each image plane leaves room for the chip lead frames and support circuitry. FIG. 6b illustrates an alternate embodiment that six consumer grade CCD devices. An additional advantage of this scheme is that the CCD array chips can potentially share some supporting circuitry since the signals each independent chip is requiring are often identical.
- A disadvantage of the mosaic technique is the image capture variation that will exists between the different CCD chips. The image variation can be compensated for by having overlapping CCD array coverage. The overlapping area is used to cross calibrate the image variation between adjacent CCD arrays.
- Folded Optics Configuration
- FIG. 7 illustrates an alternative embodiment of the panoramic camera system. In the embodiment of FIG. 7, the camera subassembly is housed within the parabolic mirror. Referring to FIG. 7, the
convex mirror 710 is inverted and a hole is cut into the tip. Asecond mirror 715 is placed above theconvex mirror 710, directing the light from the surrounding panorama into the hole in the top of theconvex mirror 710. The remainder of the optical path, including theastigmatism correction lens 720, theobjective lens 730, thefield flattening lens 740, and theimage capture mechanism 750, are all housed inside the invertedconvex mirror 710. It is apparent from the diagram of FIG. 7 that the “folded optics” configuration protects the optical path and mechanical parts of the panoramic camera system. - Transparent Block Configuration
- Another alternative embodiment is shown in FIG. 8a. In this alternative, the convex mirror is formed as the internal space of a curved block of transparent material such as glass or plastic. The mirror surface 810 is formed by the inner surface of hole that is milled or cast in the top of the transparent material 805. The shape of the outer surface approximates a sphere centered on the virtual focal point of the convex mirror 810. The outer surface of the transparent material is a polished surface that forms the outside skin of the camera. The bottom tip of the transparent block is optically mated to the other optical parts of the camera system. The bottom tip may be polished flat or molded into a shape that contributes to the astigmatism lens group.
- The solid transparent block approach has a number of significant advantages. First, the mirrored inner surface of the transparent block material can be well protected. This technique overcomes the disadvantages of front surface mirrors. Specifically, when front surface mirrors are exposed to the outside world they are susceptible to damage and degradation. In the above described embodiment, the mirrored surface is fully protected since it is encased between a protective backing material and the transparent block material. Another advantage of the solid block approach is that the skin of the camera is incorporate into the optical system. Thus only one surface would need to be multicoated to prevent internal reflections.
- The transparent block technique can also be implement using the folded optics scheme described in the previous section. Specifically, FIG. 8b illustrates an inverted solid transparent block used to implement a panoramic camera system. In this case, the camera components are contained within the mirror cavity. Note that the outside surface at the top of the block is no longer an exit path bus is instead a mirrored surface that directs the image light down into an optical path inside the parabolic block.
- Different methods can be used to construct a transparent block panoramic camera system. One method would be to create the transparent block, then polish the transparent block, and finally add a mirrored surface where appropriate. An alternate method of constructing a transparent block panoramic camera system would start with the convex mirror. Then, the convex mirror would be encapsulated within the transparent block. This method would be simpler to construct since a concave surface would not require polishing. Furthermore, the convex mirror would be protected by the transparent block.
- Center Support Configuration
- Another alternative embodiment addresses the problem of how to align and support the optical elements of the panoramic camera illustrated in FIG. 2a. It is possible to use the protective, transparent block technique as described in the previous section to provide structure, stability and alignment. However, the transparent block technique requires multicoating of the surfaces or else undesired internal reflections will be visible. FIG. 9a discloses an alternate embodiment wherein a
central post 903 is used to support theparabolic mirror 910. The remainder of the optical system is below theparabolic mirror 910 and thecentral post 903. The center support scheme takes advantage of the fact that the center of the annular image is discarded since it contains only an image of the camera itself. Therefore, the center portion of the annular image can be used for support of theparabolic mirror 910. - External Support Configuration
- Another scheme for supporting the parabolic mirror above the optical elements below is to use several side supports. This can be accomplished by splitting the parabolic mirror into “pie-pieces” by cutting the parabolic mirror after fabrication. For example, the parabolic mirror can be quartered as illustrated in FIG. 9b. The four sections of
parabolic mirror elements - If the parabolic mirror is split into four sections, then annular image will appear as four quadrants at the image plane. To correct for this, the gaps can be removed during the polar-to-rectangular coordinate conversion, thereby restoring the continuity of the panoramic image. The gaps between the mirror sections should be kept as small as possible, however, since the optical system is degraded by the loss of rotational symmetry.
- As illustrated in FIG. 3a, the panoramic camera system of the present invention records a two dimensional annular representation of the surrounding panorama. However, the annular representation is not of much interest to most viewers. Therefore, to display the panoramic images captured by the panoramic camera of the present invention, several different display systems are disclosed.
- Still Image Presentation as a Rectangular Panoramic Image
- The most common method of displaying a panoramic image is to display the image as a rectangle where the horizontal direction represents the view angle. An example of this type of panoramic image presentation is illustrated in FIG. 3b. Such rectangular panoramic images are commonly displayed in nature magazines. As stated in the background, the prior art method of creating such rectangular panoramic images was to take several convention photographs at different angles and then stitch those photographs together somehow.
- With the panoramic camera system of the present invention, such rectangular panoramic images can easily be created. First the panoramic camera system of the present invention is used to capture an annular image of the surrounding panorama. Then the annular image is digitized and loaded into a computer system. (The image will already be in digital form if a CCD version of the panoramic camera system was used to capture the image.)
- A custom conversion program is then executed on the computer system. The custom conversion program scans around the annular image starting at an arbitrarily chosen
sampling line 310. Points along thesampling line 310 are sampled and then their position changed using polar coordinate to rectangular coordinate conversion. FIG. 10 illustrates how two different points on the annular image are sampled and then placed into rectangular coordinates. As illustrated in FIG. 10, the orientation of the sampling pattern changes as the coordinate transform program rotates around the annular image. The resulting rectangular image is illustrated in FIG. 3b. - While sampling the annular image, it is important to sample the image differently depending on where the annular image is being sampled. The following three rules must be observed:
- 1. The sampling shape is dynamically changing depending on the viewing angle (both in the horizontal and vertical).
- 2. The sampling shape size proportional to the radius (vertical viewing angle); and
- 3. The sampling shape orientation is different depending on the horizontal viewing angle.
- Since there is a greater resolution around the outer perimeter of the annular image, the corresponding rectangular image portion will have better image clarity. The outer perimeter of the annular image may be the top or the bottom of the rectangular image depending on the optical path. (Compare FIG. 2a with FIG. 7). In FIG. 10, the lower portion of the rectangular image will have a better image clarity since the it is from the outer perimeter of the annular image. One embodiment of the present invention takes advantage of this fact by using the outer perimeter of the annular image for the ground since the ground in a panoramic scene is generally more detailed than the sky.
- Once the panoramic image has been converted from an annular image to a rectangular image on a computer system, then the rectangular image can be presented to viewers in a number of different formats. For example, the rectangular image may be distributed electronically as a JPEG image and viewed with JPEG image viewers. Alternatively, the rectangular image can be printed out with a color printer. It should be noted that since the rectangular image is in digital form, it can quickly be added to a publication being created with a Desktop Publishing Layout Program such QuarkXpress or Adobe's PageMaker.
- Image Presentation as a Virtual Reality Image
- Apple Computer introduced a standard known as QuickTime® VR for storing and displaying virtual reality images. Apple Computer's QuickTime® VR standard governs the data storage format and the playback software needed to view the QuickTime® VR datasets. The camera system of the present invention can be used to quickly create QuickTime® VR datasets.
- The QuickTime® VR format stores the image as cylindrical image as illustrated in FIG. 11a. Specifically, the viewpoint is at the center of the cylinder and the inner surface of the cylinder represents the stored QuickTime® VR image. Note that trapezoid shaped patches must be sampled to generate an image if the user is looking up or down as illustrated in FIG. 11b.
- FIG. 11c illustrates a flow diagram that lists the steps required to produce a QuickTime® VR dataset using the panoramic camera system of the present invention. First, at
step 1110, a panoramic image is recorded with the panoramic camera. Then, atstep 1120, the recorded image is digitized and loaded into a computer system. If the panoramic camera recorded the image on a piece of film, then a print of the film can be scanned into the computer system using a flatbed scanner. Alternatively, a film image can be commercially transformed into the well known PhotoCD® format produced by Kodak®. If the panoramic camera recorded the image with a CCD array and stored the image digitally, then the digital image is just copied from the camera's storage system into the computer system 's storage system. - After the digital version of the annular image is available on the computer system, a transformation program is then executed on the computer system at
step 1130 in order to transform the digitized annular image into a QuickTime® VR dataset. The annular image produced by the camera system of the present invention stores the panoramic image information in a polar coordinate system. Conversely, Apple®'s QuickTime® VR uses a cylindrical coordinate system as illustrated in FIG. 11a. Thus, the transformation program converts the annular image from its polar coordinate system into the QuickTime® VR cylindrical coordinate system. After transforming the image into the QuickTime® VR cylindrical coordinate system, then a file is created using the QuickTime® VR file format atstep 1135. - Once the coordinate transform is complete, the transformed image can be view using Apple's QTVR player program as stated in
step 1140. - Still Image Presentation on a Computer Network
- Since the present invention can store the annular image in digital form, a very useful method of distributing panoramic images is through a computer network. In particular, the hypertext transport protocol (http) of the World Wide Web (WWW) on the Internet can be used to distribute still annular images. The still annular images would be stored on a World Wide Web server. To access the still annular images, any user coupled to the Internet would used a World Wide Web browser program.
- One method of transporting the images would be to define a new panoramic image annular data format. The images could then be downloaded as stored in the panoramic image annular data format. A helper application would then display the images once downloaded.
- A better method of displaying images using the hypertext transport protocol (http) of the World Wide Web (WWW) would be to implement a “plugin” application that would work with the browser program. FIG. 12a illustrates a graphical user interface for one possible client panoramic image presentations system. On the right side of FIG. 12a, a set of different panoramic images to display is available. To display one of those images, the user selects the image with a cursor control device. On the upper left of the graphical user interface of FIG. 12a is viewport for displaying a portion of a panoramic image. Pan arrows on either side of the viewport allow the user to pan left and right.
- Image Presentation as Video
- One of the most interesting presentation systems for the present invention is a video presentation system. FIGS. 13a and 13 b illustrate one possible video presentation system.
- Referring to FIG. 13a, a CCD version of the
panoramic camera system 1205 of the present invention is illustrated coupled to a computer system 1200. The CCD version of thepanoramic camera system 1205 is coupled through apanoramic camera interface 1210. Thepanoramic camera interface 1210 receives a digital stream of annular images. To interface with computer systems, one embodiment of thepanoramic camera interface 1210 is the FireWire system that is described in the IEEE 1394 standard. - After being received through the
panoramic camera interface 1210, the digitized annular images are stored in an Annular “Video”Storage system 1230. The Annular “Video” comprises a series of a consecutive annular images taken with a CCD version of thepanoramic camera system 1205. - To display the Annular Video as normal video, the annular frames must be converted from the annular image format into normal video images. In one embodiment of the present invention, only a portion of the annular image is converted into normal video. One reason for this is that the aspect ratio of video does not allow for good viewing of wide but short rectangular panoramic images. Furthermore, by only transforming a portion of the annular image into normal video, the transformation can be done in real-time without requiring exceedingly fast computer equipment. The transformation of annular video to normal video is done by annular to
video conversion units - To display the normal video, existing
video streaming software - FIG. 13b illustrates one possible embodiment of a graphical user interface (GUI) for accessing the annular video. In the GUI of FIG. 13b, a
video viewport 1340 is used to display the video. A smaller stillpanoramic image 1310 is used to illustrate a static version of the full panoramic video. Alocator window 1315 is used to identify the view angle that thevideo window 1340 is displaying within the full panoramic view that is available. - To change the view angle, the user can select a pan
right arrow 1347 or a pan leftarrow 1343 with acursor 1320. Alternatively, the user can simply move the position of thelocator window 1315 within the stillpanoramic image 1310. In the embodiment of FIG. 13b, the entire vertical image aspect of the image is compressed into thevideo viewport 1340, however in other embodiments the, - Referring back to FIG. 13a, user input processing routines 1250 and 1253 processing the user's commands. When a the user requests a viewpoint change, the new viewpoint is communicated to the respective annular to
video conversion units - Referring back to FIG. 13b, a
parameter window 1350 is also available to the viewer. Theparameter window 1350 allows the user to adjust some of the viewing parameters such asImage Brightness 1352,Image Tint 1353 andImage Contrast 1355. When a user adjusts these parameters, the changes will be processed by the user input processing routines 1250 and 1253 provided to the annular tovideo conversion units video streaming software - To more completely convey the experience of being at a different location, the present invention can be combined with a three dimensional sound system. Referring to FIGS. 14a and 14 b, an embodiment of the camera system is illustrated with four
directional microphones directional microphones - To add three dimensional sound, the sound from the various directional microphones is mixed depending on the viewing angle that a user has selected. For example, if a viewer that is seeing a real-time image from
camera 1400 of FIG. 14a is viewing straight out of the page, then the left speaker will receive information frommicrophone 1443 and the right speaker will receive information frommicrophone 1441. The sound can be provided to users on a computer network using audio streaming software such as RealAudio by Progressive Networks, Inc. As the viewer adjusts the viewing angle, the sound from the directional microphones will be adjusted accordingly. - By adding sound to the system, the user is provided with a cues as to which direction they should be viewing. For example, if the user hears a sound from “behind”, then the user can change the view angle to look backward.
- The foregoing has described a camera device that captures360 degree panoramic images and presentation systems for displaying such images. It is contemplated that changes and modifications may be made by one of ordinary skill in the art, to the materials and arrangements of elements of the present invention without departing from the scope of the invention.
Claims (62)
Priority Applications (22)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US08/872,525 US6459451B2 (en) | 1996-06-24 | 1997-06-11 | Method and apparatus for a panoramic camera to capture a 360 degree image |
PCT/US1997/009313 WO1997050252A1 (en) | 1996-06-24 | 1997-06-16 | Panoramic camera |
DE69729090T DE69729090D1 (en) | 1996-06-24 | 1997-06-16 | PANORAMA CAMERA |
JP50300898A JP2002515984A (en) | 1996-06-24 | 1997-06-16 | Panoramic camera |
AU33724/97A AU3372497A (en) | 1996-06-24 | 1997-06-16 | Panoramic camera |
EP01120291A EP1178352A1 (en) | 1996-06-24 | 1997-06-16 | Method of and apparatus for presenting panoramic images at a local receiver, and a corresponding computer program |
EP97929734A EP0908053B1 (en) | 1996-06-24 | 1997-06-16 | Panoramic camera |
US09/137,660 US6373642B1 (en) | 1996-06-24 | 1998-08-20 | Panoramic imaging arrangement |
US09/175,157 US6341044B1 (en) | 1996-06-24 | 1998-10-19 | Panoramic imaging arrangement |
US09/439,114 US6493032B1 (en) | 1996-06-24 | 1999-11-12 | Imaging arrangement which allows for capturing an image of a view at different resolutions |
US09/521,652 US6593969B1 (en) | 1996-06-24 | 2000-03-08 | Preparing a panoramic image for presentation |
US09/521,653 US6542184B1 (en) | 1996-06-24 | 2000-03-08 | Methods, apparatus, and program products for presenting panoramic images of a remote location |
US09/558,777 US6515696B1 (en) | 1996-06-24 | 2000-04-25 | Method and apparatus for presenting images from a remote location |
US09/614,506 US6424377B1 (en) | 1996-06-24 | 2000-07-11 | Panoramic camera |
US09/615,924 US6426774B1 (en) | 1996-06-24 | 2000-07-13 | Panoramic camera |
US09/618,141 US6480229B1 (en) | 1996-06-24 | 2000-07-17 | Panoramic camera |
US09/638,289 US6583815B1 (en) | 1996-06-24 | 2000-08-14 | Method and apparatus for presenting images from a remote location |
US09/894,760 US6885509B2 (en) | 1996-06-24 | 2001-06-27 | Imaging arrangement which allows for capturing an image of a view at different resolutions |
US09/999,282 US6388820B1 (en) | 1996-06-24 | 2001-11-26 | Panoramic imaging arrangement |
US10/419,283 US7486324B2 (en) | 1996-06-24 | 2003-04-17 | Presenting panoramic images with geometric transformation |
US10/418,444 US7242425B2 (en) | 1996-06-24 | 2003-04-17 | Panoramic camera |
US13/015,142 USRE44087E1 (en) | 1996-06-24 | 2011-01-27 | Presenting panoramic images with geometric transformation |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US2029296P | 1996-06-24 | 1996-06-24 | |
US08/872,525 US6459451B2 (en) | 1996-06-24 | 1997-06-11 | Method and apparatus for a panoramic camera to capture a 360 degree image |
Related Child Applications (9)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/137,660 Continuation-In-Part US6373642B1 (en) | 1996-06-24 | 1998-08-20 | Panoramic imaging arrangement |
US09/521,653 Continuation US6542184B1 (en) | 1996-06-24 | 2000-03-08 | Methods, apparatus, and program products for presenting panoramic images of a remote location |
US09/521,652 Division US6593969B1 (en) | 1996-06-24 | 2000-03-08 | Preparing a panoramic image for presentation |
US09/521,652 Continuation US6593969B1 (en) | 1996-06-24 | 2000-03-08 | Preparing a panoramic image for presentation |
US09/558,777 Division US6515696B1 (en) | 1996-06-24 | 2000-04-25 | Method and apparatus for presenting images from a remote location |
US09/614,506 Division US6424377B1 (en) | 1996-06-24 | 2000-07-11 | Panoramic camera |
US09/615,924 Division US6426774B1 (en) | 1996-06-24 | 2000-07-13 | Panoramic camera |
US09/618,141 Division US6480229B1 (en) | 1996-06-24 | 2000-07-17 | Panoramic camera |
US09/638,289 Division US6583815B1 (en) | 1996-06-24 | 2000-08-14 | Method and apparatus for presenting images from a remote location |
Publications (2)
Publication Number | Publication Date |
---|---|
US20010010555A1 true US20010010555A1 (en) | 2001-08-02 |
US6459451B2 US6459451B2 (en) | 2002-10-01 |
Family
ID=26693273
Family Applications (11)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US08/872,525 Expired - Lifetime US6459451B2 (en) | 1996-06-24 | 1997-06-11 | Method and apparatus for a panoramic camera to capture a 360 degree image |
US09/521,652 Expired - Lifetime US6593969B1 (en) | 1996-06-24 | 2000-03-08 | Preparing a panoramic image for presentation |
US09/521,653 Expired - Lifetime US6542184B1 (en) | 1996-06-24 | 2000-03-08 | Methods, apparatus, and program products for presenting panoramic images of a remote location |
US09/558,777 Expired - Lifetime US6515696B1 (en) | 1996-06-24 | 2000-04-25 | Method and apparatus for presenting images from a remote location |
US09/614,506 Expired - Lifetime US6424377B1 (en) | 1996-06-24 | 2000-07-11 | Panoramic camera |
US09/615,924 Expired - Lifetime US6426774B1 (en) | 1996-06-24 | 2000-07-13 | Panoramic camera |
US09/618,141 Expired - Lifetime US6480229B1 (en) | 1996-06-24 | 2000-07-17 | Panoramic camera |
US09/638,289 Expired - Lifetime US6583815B1 (en) | 1996-06-24 | 2000-08-14 | Method and apparatus for presenting images from a remote location |
US10/418,444 Expired - Fee Related US7242425B2 (en) | 1996-06-24 | 2003-04-17 | Panoramic camera |
US10/419,283 Ceased US7486324B2 (en) | 1996-06-24 | 2003-04-17 | Presenting panoramic images with geometric transformation |
US13/015,142 Expired - Fee Related USRE44087E1 (en) | 1996-06-24 | 2011-01-27 | Presenting panoramic images with geometric transformation |
Family Applications After (10)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/521,652 Expired - Lifetime US6593969B1 (en) | 1996-06-24 | 2000-03-08 | Preparing a panoramic image for presentation |
US09/521,653 Expired - Lifetime US6542184B1 (en) | 1996-06-24 | 2000-03-08 | Methods, apparatus, and program products for presenting panoramic images of a remote location |
US09/558,777 Expired - Lifetime US6515696B1 (en) | 1996-06-24 | 2000-04-25 | Method and apparatus for presenting images from a remote location |
US09/614,506 Expired - Lifetime US6424377B1 (en) | 1996-06-24 | 2000-07-11 | Panoramic camera |
US09/615,924 Expired - Lifetime US6426774B1 (en) | 1996-06-24 | 2000-07-13 | Panoramic camera |
US09/618,141 Expired - Lifetime US6480229B1 (en) | 1996-06-24 | 2000-07-17 | Panoramic camera |
US09/638,289 Expired - Lifetime US6583815B1 (en) | 1996-06-24 | 2000-08-14 | Method and apparatus for presenting images from a remote location |
US10/418,444 Expired - Fee Related US7242425B2 (en) | 1996-06-24 | 2003-04-17 | Panoramic camera |
US10/419,283 Ceased US7486324B2 (en) | 1996-06-24 | 2003-04-17 | Presenting panoramic images with geometric transformation |
US13/015,142 Expired - Fee Related USRE44087E1 (en) | 1996-06-24 | 2011-01-27 | Presenting panoramic images with geometric transformation |
Country Status (6)
Country | Link |
---|---|
US (11) | US6459451B2 (en) |
EP (1) | EP0908053B1 (en) |
JP (1) | JP2002515984A (en) |
AU (1) | AU3372497A (en) |
DE (1) | DE69729090D1 (en) |
WO (1) | WO1997050252A1 (en) |
Cited By (80)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020021353A1 (en) * | 2000-06-09 | 2002-02-21 | Denies Mark | Streaming panoramic video |
US6388820B1 (en) * | 1996-06-24 | 2002-05-14 | Be Here Corporation | Panoramic imaging arrangement |
US20020118890A1 (en) * | 2001-02-24 | 2002-08-29 | Michael Rondinelli | Method and apparatus for processing photographic images |
US20020147773A1 (en) * | 2001-02-24 | 2002-10-10 | Herman Herman | Method and system for panoramic image generation using client-server architecture |
WO2003027766A2 (en) * | 2001-09-27 | 2003-04-03 | Eyesee360, Inc. | System and method for panoramic imaging |
US20030095338A1 (en) * | 2001-10-29 | 2003-05-22 | Sanjiv Singh | System and method for panoramic imaging |
FR2835925A1 (en) * | 2002-02-11 | 2003-08-15 | Egg Solution Optronics | Correction device for panoramic image acquisition system comprises set of lenses so that rays coming from reflector and/or refractive device diverge towards whole of camera image capture element |
WO2004008185A2 (en) * | 2002-07-15 | 2004-01-22 | O.D.F. Optronics, Ltd. | Optical lens providing omni-directional coverage and illumination |
US6747647B2 (en) * | 2001-05-02 | 2004-06-08 | Enroute, Inc. | System and method for displaying immersive video |
US20040220478A1 (en) * | 2003-02-26 | 2004-11-04 | Wallace Jeffrey M. | Method and devices for imaging and biopsy |
US20050030643A1 (en) * | 2001-01-26 | 2005-02-10 | Ehud Gal | Spherical view imaging apparatus and method |
US6856472B2 (en) | 2001-02-24 | 2005-02-15 | Eyesee360, Inc. | Panoramic mirror and system for producing enhanced panoramic images |
US6870563B1 (en) * | 2000-06-12 | 2005-03-22 | Microsoft Corporation | Self-calibration for a catadioptric camera |
US20050062869A1 (en) * | 1999-04-08 | 2005-03-24 | Zimmermann Steven Dwain | Immersive video presentations |
US20050117227A1 (en) * | 2001-09-18 | 2005-06-02 | Ehud Gal | Panoramic imaging system with optical zoom capability |
US7071964B1 (en) | 2004-08-23 | 2006-07-04 | Otto Gregory Glatt | 360-degree panoramic scene-storage device |
US20060152819A1 (en) * | 2002-11-04 | 2006-07-13 | Ehud Gal | Omni-directional imaging and illumination assembly |
US20070002464A1 (en) * | 2002-05-14 | 2007-01-04 | Ehud Gal | Spherical and nearly spherical view imaging assembly |
US20070036537A1 (en) * | 2005-08-10 | 2007-02-15 | Samsung Electro-Mechanics Co., Ltd. | Thinner mobile camera optical lens system and image forming method using the same |
US20070141944A1 (en) * | 2003-06-20 | 2007-06-21 | Matthew Abeshouse | Tossable flier |
US20070182812A1 (en) * | 2004-05-19 | 2007-08-09 | Ritchey Kurtis J | Panoramic image-based virtual reality/telepresence audio-visual system and method |
US7463280B2 (en) | 2003-06-03 | 2008-12-09 | Steuart Iii Leonard P | Digital 3D/360 degree camera system |
US20090207234A1 (en) * | 2008-02-14 | 2009-08-20 | Wen-Hsiung Chen | Telepresence system for 360 degree video conferencing |
US20090253987A1 (en) * | 2008-04-02 | 2009-10-08 | Medison Co., Ltd. | Formation of an elastic image in an ultrasound system |
US20100020202A1 (en) * | 2006-04-13 | 2010-01-28 | Opt Corporation | Camera apparatus, and image processing apparatus and image processing method |
US20100033553A1 (en) * | 2008-08-08 | 2010-02-11 | Zoran Corporation | In-camera panorama image stitching assistance |
US20100053325A1 (en) * | 2008-09-03 | 2010-03-04 | Dai Nippon Printing Co., Ltd. | Image converter |
US20100134621A1 (en) * | 2007-04-06 | 2010-06-03 | Korea Expressway Corporation | Multi-area monitoring system from single cctv having a camera quadratic curved surface mirror structure and it, and unwrapping method for the same |
US20100149661A1 (en) * | 2004-01-21 | 2010-06-17 | O.D.F. Medical Ltd. | Lens having a circumferential field of view |
US20110116767A1 (en) * | 2005-11-02 | 2011-05-19 | Christophe Souchard | Spatial and temporal alignment of video sequences |
US7978925B1 (en) | 2005-04-16 | 2011-07-12 | Apple Inc. | Smoothing and/or locking operations in video editing |
US20120262580A1 (en) * | 2011-04-14 | 2012-10-18 | Klaus Huebner | Vehicle Surround View System |
CN102843505A (en) * | 2012-09-26 | 2012-12-26 | 张煜 | Cylindrical panoramic photographic device |
WO2013104347A1 (en) * | 2012-01-11 | 2013-07-18 | Kanna, Michael | Method and device for the recording and reproduction of panoramic representations |
TWI402770B (en) * | 2008-11-14 | 2013-07-21 | Hon Hai Prec Ind Co Ltd | Computing system and method for automatically searching inflection points in a border of an object image |
US20130321568A1 (en) * | 2012-06-01 | 2013-12-05 | Hal Laboratory, Inc. | Storage medium storing information processing program, information processing device, information processing system, and information processing method |
US20140009571A1 (en) * | 2006-11-23 | 2014-01-09 | Zheng Jason Geng | Wide Field of View Reflector and Method of Designing and Making Same |
US8669845B1 (en) | 2007-03-30 | 2014-03-11 | Vail Resorts, Inc. | RFID skier monitoring systems and methods |
US8699821B2 (en) | 2010-07-05 | 2014-04-15 | Apple Inc. | Aligning images |
US20140194164A1 (en) * | 2013-01-04 | 2014-07-10 | Lg Electronics Inc. | Mobile terminal and controlling method thereof |
US20140314336A1 (en) * | 2011-12-19 | 2014-10-23 | Dai Nippon Printing Co., Ltd. | Image processing device, image processing method, program for image processing device, recording medium, and image display device |
US9165444B2 (en) * | 2013-07-26 | 2015-10-20 | SkyBell Technologies, Inc. | Light socket cameras |
US20150350621A1 (en) * | 2012-12-27 | 2015-12-03 | Panasonic Intellectual Property Management Co., Ltd. | Sound processing system and sound processing method |
US9229200B2 (en) | 2012-01-09 | 2016-01-05 | Eyesee360, Inc. | Panoramic optical systems |
WO2016048386A1 (en) * | 2014-09-25 | 2016-03-31 | Ram Industrial Design, Inc. | Omnidirectional catadioptric lens structure |
JP2017505565A (en) * | 2013-12-09 | 2017-02-16 | シゼイ シジブイ カンパニー リミテッド | Multi-plane video generation method and system |
CN106447611A (en) * | 2016-09-09 | 2017-02-22 | 国网福建省电力有限公司 | Method for displaying panoramic image of power transmission tower |
WO2017095341A1 (en) | 2015-12-04 | 2017-06-08 | Koc Universitesi | Physical object reconstruction through a projection display system |
WO2017095340A1 (en) | 2015-12-03 | 2017-06-08 | Koc Universitesi | Multi-view occlusion-preventive optical system in the form of a screen combined with an image capturing device |
WO2017099675A1 (en) | 2015-12-07 | 2017-06-15 | Koç Üni̇versi̇tesi̇ | A dual function display and multi-view imaging system |
US20170251175A1 (en) * | 2016-02-26 | 2017-08-31 | Larry Molina | System for law enforcement recording |
US9883101B1 (en) * | 2014-07-23 | 2018-01-30 | Hoyos Integrity Corporation | Providing a real-time via a wireless communication channel associated with a panoramic video capture device |
US9888216B2 (en) | 2015-09-22 | 2018-02-06 | SkyBell Technologies, Inc. | Doorbell communication systems and methods |
US9997036B2 (en) | 2015-02-17 | 2018-06-12 | SkyBell Technologies, Inc. | Power outlet cameras |
US10043332B2 (en) | 2016-05-27 | 2018-08-07 | SkyBell Technologies, Inc. | Doorbell package detection systems and methods |
US10218932B2 (en) | 2013-07-26 | 2019-02-26 | SkyBell Technologies, Inc. | Light socket cameras |
US10362224B2 (en) * | 2015-10-22 | 2019-07-23 | Gopro, Inc. | System and method for identifying comment clusters for panoramic content segments |
US10389999B2 (en) * | 2016-02-17 | 2019-08-20 | Qualcomm Incorporated | Storage of virtual reality video in media files |
US10440165B2 (en) | 2013-07-26 | 2019-10-08 | SkyBell Technologies, Inc. | Doorbell communication and electrical systems |
US10672238B2 (en) | 2015-06-23 | 2020-06-02 | SkyBell Technologies, Inc. | Doorbell communities |
US10687029B2 (en) | 2015-09-22 | 2020-06-16 | SkyBell Technologies, Inc. | Doorbell communication systems and methods |
US10706702B2 (en) | 2015-07-30 | 2020-07-07 | Skybell Technologies Ip, Llc | Doorbell package detection systems and methods |
US10742938B2 (en) | 2015-03-07 | 2020-08-11 | Skybell Technologies Ip, Llc | Garage door communication systems and methods |
US10825133B2 (en) * | 2016-04-05 | 2020-11-03 | Samsung Electronics Co., Ltd. | Method and apparatus for processing image |
US10897573B2 (en) * | 2018-11-21 | 2021-01-19 | Ricoh Company, Ltd. | Image capturing system, terminal and computer readable medium which correct images |
US10909384B2 (en) | 2015-07-14 | 2021-02-02 | Panasonic Intellectual Property Management Co., Ltd. | Monitoring system and monitoring method |
US10909825B2 (en) | 2017-09-18 | 2021-02-02 | Skybell Technologies Ip, Llc | Outdoor security systems and methods |
US11004312B2 (en) | 2015-06-23 | 2021-05-11 | Skybell Technologies Ip, Llc | Doorbell communities |
US11074790B2 (en) | 2019-08-24 | 2021-07-27 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US11102027B2 (en) | 2013-07-26 | 2021-08-24 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US11140253B2 (en) | 2013-07-26 | 2021-10-05 | Skybell Technologies Ip, Llc | Doorbell communication and electrical systems |
US11184589B2 (en) | 2014-06-23 | 2021-11-23 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US11269249B2 (en) | 2017-09-28 | 2022-03-08 | Fujifilm Corporation | Optical system, projection apparatus, and imaging apparatus |
US11343473B2 (en) | 2014-06-23 | 2022-05-24 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US11381686B2 (en) | 2015-04-13 | 2022-07-05 | Skybell Technologies Ip, Llc | Power outlet cameras |
US11386730B2 (en) | 2013-07-26 | 2022-07-12 | Skybell Technologies Ip, Llc | Smart lock systems and methods |
US11575537B2 (en) | 2015-03-27 | 2023-02-07 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US11651668B2 (en) | 2017-10-20 | 2023-05-16 | Skybell Technologies Ip, Llc | Doorbell communities |
US11651665B2 (en) | 2013-07-26 | 2023-05-16 | Skybell Technologies Ip, Llc | Doorbell communities |
US11889009B2 (en) | 2013-07-26 | 2024-01-30 | Skybell Technologies Ip, Llc | Doorbell communication and electrical systems |
Families Citing this family (246)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6118474A (en) * | 1996-05-10 | 2000-09-12 | The Trustees Of Columbia University In The City Of New York | Omnidirectional imaging apparatus |
US6331869B1 (en) * | 1998-08-07 | 2001-12-18 | Be Here Corporation | Method and apparatus for electronically distributing motion panoramic images |
EP0821522B1 (en) * | 1996-07-23 | 2008-04-09 | Canon Kabushiki Kaisha | Camera control apparatus and method |
US7092012B2 (en) * | 1996-11-15 | 2006-08-15 | Canon Kabushiki Kaisha | Image processing apparatus and method, storage medium, and communication system |
JP4332231B2 (en) | 1997-04-21 | 2009-09-16 | ソニー株式会社 | Imaging device controller and imaging system |
US6466254B1 (en) * | 1997-05-08 | 2002-10-15 | Be Here Corporation | Method and apparatus for electronically distributing motion panoramic images |
US6486908B1 (en) * | 1998-05-27 | 2002-11-26 | Industrial Technology Research Institute | Image-based method and system for building spherical panoramas |
JP2000059682A (en) * | 1998-06-02 | 2000-02-25 | Sony Corp | Image pickup controller and method, image presentation device and method, image server system and served medium |
US20010015751A1 (en) * | 1998-06-16 | 2001-08-23 | Genex Technologies, Inc. | Method and apparatus for omnidirectional imaging |
US6977676B1 (en) * | 1998-07-08 | 2005-12-20 | Canon Kabushiki Kaisha | Camera control system |
JP2000099697A (en) * | 1998-09-22 | 2000-04-07 | Canon Inc | Image input system and its control system and storage medium |
JP4653313B2 (en) | 1999-01-04 | 2011-03-16 | リモートリアリティ コーポレーション | Panorama image device |
US6754614B1 (en) * | 1999-02-25 | 2004-06-22 | Interscience, Inc. | Linearized static panoramic optical mirror |
CN1185873C (en) * | 1999-03-12 | 2005-01-19 | 索尼公司 | Image providing device and its providing method, image processing device and processing method, and storage medium |
DE19921734C2 (en) * | 1999-05-11 | 2002-11-21 | Ulrich Claus | Arrangement and method for photoelectric panoramic recording |
US7620909B2 (en) * | 1999-05-12 | 2009-11-17 | Imove Inc. | Interactive image seamer for panoramic images |
US7098914B1 (en) * | 1999-07-30 | 2006-08-29 | Canon Kabushiki Kaisha | Image synthesis method, image synthesis apparatus, and storage medium |
DE19941733A1 (en) * | 1999-09-01 | 2001-03-15 | Geometrie Concern Verwaltungs | Machine vision system |
US6795109B2 (en) * | 1999-09-16 | 2004-09-21 | Yissum Research Development Company Of The Hebrew University Of Jerusalem | Stereo panoramic camera arrangements for recording panoramic images useful in a stereo panoramic image pair |
US6734911B1 (en) * | 1999-09-30 | 2004-05-11 | Koninklijke Philips Electronics N.V. | Tracking camera using a lens that generates both wide-angle and narrow-angle views |
AU2137801A (en) * | 1999-12-16 | 2001-06-25 | Universite De Montreal | Panoramic image display device and method |
US20020075295A1 (en) * | 2000-02-07 | 2002-06-20 | Stentz Anthony Joseph | Telepresence using panoramic imaging and directional sound |
US6978051B2 (en) * | 2000-03-06 | 2005-12-20 | Sony Corporation | System and method for capturing adjacent images by utilizing a panorama mode |
WO2001071424A1 (en) * | 2000-03-22 | 2001-09-27 | Egg Solution Optronics Sa | Magnifying device for panoramic anamorphic imaging system |
FR2806809B1 (en) * | 2000-03-22 | 2002-11-22 | Powell Group | PANORAMIC IMAGE AQUISITION DEVICE |
JP2001333303A (en) | 2000-05-23 | 2001-11-30 | Sharp Corp | Omnidirectional vision system |
US20030211188A1 (en) * | 2000-06-19 | 2003-11-13 | Kachnic Edward F. | Wireless image processing method and device therefor |
JP3841621B2 (en) * | 2000-07-13 | 2006-11-01 | シャープ株式会社 | Omnidirectional visual sensor |
US20040059452A1 (en) * | 2000-08-23 | 2004-03-25 | Edward Kachnic | Sensory inspection system and method thereof |
US7095905B1 (en) * | 2000-09-08 | 2006-08-22 | Adobe Systems Incorporated | Merging images to form a panoramic image |
US20020030734A1 (en) * | 2000-09-09 | 2002-03-14 | Smith Robert S. | Coordinated audio/ visual omnidirectional recording |
JP2002196438A (en) * | 2000-10-20 | 2002-07-12 | Matsushita Electric Ind Co Ltd | Wide angle image pickup apparatus |
JP3690733B2 (en) | 2001-02-09 | 2005-08-31 | シャープ株式会社 | Imaging device |
JP3651844B2 (en) | 2001-02-09 | 2005-05-25 | シャープ株式会社 | Imaging device and manufacturing method thereof |
US8085293B2 (en) * | 2001-03-14 | 2011-12-27 | Koninklijke Philips Electronics N.V. | Self adjusting stereo camera system |
US7349005B2 (en) * | 2001-06-14 | 2008-03-25 | Microsoft Corporation | Automated video production system and method using expert video production rules for online publishing of lectures |
US6937266B2 (en) * | 2001-06-14 | 2005-08-30 | Microsoft Corporation | Automated online broadcasting system and method using an omni-directional camera system for viewing meetings over a computer network |
KR100452754B1 (en) * | 2001-06-28 | 2004-10-12 | 주식회사세운메디칼상사 | Apparatus for inserting guide wire for use in catheter |
US20060201351A1 (en) * | 2001-07-02 | 2006-09-14 | Gi View Ltd. | Self-propelled imaging system |
US7345705B2 (en) * | 2001-07-27 | 2008-03-18 | Raytheon Company | Photonic buoy |
JP2003054316A (en) * | 2001-08-21 | 2003-02-26 | Tokai Rika Co Ltd | Vehicle image pick-up device, vehicle monitoring device, and door mirror |
JP5037765B2 (en) * | 2001-09-07 | 2012-10-03 | 株式会社トプコン | Operator guidance system |
IL146802A0 (en) * | 2001-11-28 | 2003-01-12 | Wave Group Ltd | A self-contained panoramic or spherical imaging device |
DE10158415C2 (en) * | 2001-11-29 | 2003-10-02 | Daimler Chrysler Ag | Method for monitoring the interior of a vehicle, as well as a vehicle with at least one camera in the vehicle interior |
JP4010444B2 (en) | 2002-02-28 | 2007-11-21 | シャープ株式会社 | Omnidirectional monitoring control system, omnidirectional monitoring control method, and omnidirectional monitoring control program |
US7260257B2 (en) | 2002-06-19 | 2007-08-21 | Microsoft Corp. | System and method for whiteboard and audio capture |
US7259784B2 (en) * | 2002-06-21 | 2007-08-21 | Microsoft Corporation | System and method for camera color calibration and image stitching |
US7602412B2 (en) * | 2002-06-21 | 2009-10-13 | Microsoft Corporation | Temperature compensation in multi-camera photographic devices |
US7598975B2 (en) * | 2002-06-21 | 2009-10-06 | Microsoft Corporation | Automatic face extraction for use in recorded meetings timelines |
US20050046703A1 (en) * | 2002-06-21 | 2005-03-03 | Cutler Ross G. | Color calibration in photographic devices |
US7298392B2 (en) * | 2003-06-26 | 2007-11-20 | Microsoft Corp. | Omni-directional camera design for video conferencing |
US7782357B2 (en) * | 2002-06-21 | 2010-08-24 | Microsoft Corporation | Minimizing dead zones in panoramic images |
US7852369B2 (en) * | 2002-06-27 | 2010-12-14 | Microsoft Corp. | Integrated design for omni-directional camera and microphone array |
US7149367B2 (en) * | 2002-06-28 | 2006-12-12 | Microsoft Corp. | User interface for a system and method for head size equalization in 360 degree panoramic images |
US7184609B2 (en) * | 2002-06-28 | 2007-02-27 | Microsoft Corp. | System and method for head size equalization in 360 degree panoramic images |
US7429996B2 (en) * | 2002-07-16 | 2008-09-30 | Intel Corporation | Apparatus and method for sensing depth in every direction |
US7042508B2 (en) * | 2002-07-26 | 2006-05-09 | Appro Technology Inc. | Method for presenting fisheye-camera images |
US20040057622A1 (en) * | 2002-09-25 | 2004-03-25 | Bradski Gary R. | Method, apparatus and system for using 360-degree view cameras to identify facial features |
US20040114786A1 (en) * | 2002-12-06 | 2004-06-17 | Cross Match Technologies, Inc. | System and method for capturing print information using a coordinate conversion method |
US20040254424A1 (en) * | 2003-04-15 | 2004-12-16 | Interscience, Inc. | Integrated panoramic and forward view endoscope |
US7011625B1 (en) * | 2003-06-13 | 2006-03-14 | Albert Shar | Method and system for accurate visualization and measurement of endoscopic images |
US7525928B2 (en) * | 2003-06-16 | 2009-04-28 | Microsoft Corporation | System and process for discovery of network-connected devices at remote sites using audio-based discovery techniques |
US7443807B2 (en) * | 2003-06-16 | 2008-10-28 | Microsoft Corporation | System and process for discovery of network-connected devices |
US7397504B2 (en) * | 2003-06-24 | 2008-07-08 | Microsoft Corp. | Whiteboard view camera |
US7343289B2 (en) * | 2003-06-25 | 2008-03-11 | Microsoft Corp. | System and method for audio/video speaker detection |
US20050117015A1 (en) * | 2003-06-26 | 2005-06-02 | Microsoft Corp. | Foveated panoramic camera system |
US7428000B2 (en) * | 2003-06-26 | 2008-09-23 | Microsoft Corp. | System and method for distributed meetings |
US7495694B2 (en) * | 2004-07-28 | 2009-02-24 | Microsoft Corp. | Omni-directional camera with calibration and up look angle improvements |
US7336299B2 (en) * | 2003-07-03 | 2008-02-26 | Physical Optics Corporation | Panoramic video system with real-time distortion-free imaging |
JP2005027194A (en) * | 2003-07-04 | 2005-01-27 | Sony Corp | Image pickup device, image pickup method, and fiber array image conversion data measuring method |
US7399095B2 (en) * | 2003-07-09 | 2008-07-15 | Eyesee360, Inc. | Apparatus for mounting a panoramic mirror |
US7299417B1 (en) * | 2003-07-30 | 2007-11-20 | Barris Joel M | System or method for interacting with a representation of physical space |
US7833176B2 (en) * | 2003-08-13 | 2010-11-16 | G. I. View Ltd. | Pressure-propelled system for body lumen |
US20050038318A1 (en) * | 2003-08-13 | 2005-02-17 | Benad Goldwasser | Gastrointestinal tool over guidewire |
US20050036059A1 (en) * | 2003-08-13 | 2005-02-17 | Benad Goldwasser | Ingestible imaging system |
US20050062845A1 (en) | 2003-09-12 | 2005-03-24 | Mills Lawrence R. | Video user interface system and method |
US7081951B2 (en) * | 2003-10-09 | 2006-07-25 | Cross Match Technologies, Inc. | Palm print scanner and methods |
US7118228B2 (en) * | 2003-11-04 | 2006-10-10 | Hewlett-Packard Development Company, L.P. | Image display system |
WO2005052525A2 (en) * | 2003-11-20 | 2005-06-09 | Nicol William A | Sensory system and method thereof |
US7038846B2 (en) * | 2003-11-24 | 2006-05-02 | Electronic Scripting Products, Inc. | Solid catadioptric lens with a single viewpoint |
US7268956B2 (en) * | 2003-11-24 | 2007-09-11 | Electronic Scripting Products, Inc. | Solid catadioptric lens with two viewpoints |
NZ544825A (en) * | 2003-12-02 | 2008-07-31 | Oberthur Gaming Tech Inc | Multi-ticket lottery system |
US20050134695A1 (en) * | 2003-12-17 | 2005-06-23 | Deshpande Sachin G. | Systems and methods for providing remote camera control |
AU2003298463A1 (en) * | 2003-12-23 | 2005-08-11 | Telecom Italia S.P.A. | Device for viewing images, such as for videoconference facilities, related system, network and method of use |
US7087011B2 (en) * | 2003-12-30 | 2006-08-08 | Gi View Ltd. | Gastrointestinal system with traction member |
US8419678B2 (en) | 2004-01-09 | 2013-04-16 | G.I. View Ltd. | Pressure-propelled system for body lumen |
US7635345B2 (en) * | 2004-01-09 | 2009-12-22 | G. I. View Ltd. | Pressure-propelled system for body lumen |
US7635346B2 (en) * | 2004-01-09 | 2009-12-22 | G. I. View Ltd. | Pressure-propelled system for body lumen |
US7947013B2 (en) * | 2004-01-09 | 2011-05-24 | G.I. View Ltd. | Pressure-propelled system for body lumen |
CA2555214A1 (en) * | 2004-02-06 | 2005-08-25 | Interscience, Inc. | Integrated panoramic and forward optical device, system and method for omnidirectional signal processing |
US7248751B2 (en) * | 2004-03-11 | 2007-07-24 | United States Of America As Represented By The Secretary Of The Navy | Algorithmic technique for increasing the spatial acuity of a focal plane array electro-optic imaging system |
US7412662B2 (en) * | 2004-04-12 | 2008-08-12 | Microsoft Corporation | Method and system for redirection of transformed windows |
US7355623B2 (en) * | 2004-04-30 | 2008-04-08 | Microsoft Corporation | System and process for adding high frame-rate current speaker data to a low frame-rate video using audio watermarking techniques |
US7355622B2 (en) * | 2004-04-30 | 2008-04-08 | Microsoft Corporation | System and process for adding high frame-rate current speaker data to a low frame-rate video using delta frames |
US7362350B2 (en) * | 2004-04-30 | 2008-04-22 | Microsoft Corporation | System and process for adding high frame-rate current speaker data to a low frame-rate video |
WO2005110186A2 (en) | 2004-05-14 | 2005-11-24 | G.I. View Ltd. | Omnidirectional and forward-looking imaging device |
JP2005327220A (en) * | 2004-05-17 | 2005-11-24 | Sharp Corp | Device, method for creating illustration drawing, control program and readable recording medium |
US7593057B2 (en) * | 2004-07-28 | 2009-09-22 | Microsoft Corp. | Multi-view integrated camera system with housing |
US8730322B2 (en) | 2004-07-30 | 2014-05-20 | Eyesee360, Inc. | Telepresence using panoramic imaging and directional sound and motion |
JP2006047776A (en) * | 2004-08-05 | 2006-02-16 | Sony Corp | Wide-angle image pickup device and optical device |
US8102423B2 (en) | 2004-08-10 | 2012-01-24 | Sri International | Method and system for performing adaptive image acquisition |
DE102004047932A1 (en) * | 2004-10-01 | 2006-04-13 | Diehl Bgt Defence Gmbh & Co. Kg | Wide-angle lens |
JP4807720B2 (en) * | 2004-10-20 | 2011-11-02 | 全景株式会社 | Attachment for omnidirectional photography |
US9141615B1 (en) | 2004-11-12 | 2015-09-22 | Grandeye, Ltd. | Interactive media server |
DE102004062057A1 (en) * | 2004-12-23 | 2006-07-13 | Kws Computersysteme Gmbh | Digital camera, has two standard semiconductor image sensors and beam splitter to enable wide-angle imaging of objects |
US7812882B2 (en) * | 2004-12-30 | 2010-10-12 | Microsoft Corporation | Camera lens shuttering mechanism |
ATE508674T1 (en) * | 2005-01-06 | 2011-05-15 | G I View Ltd | GASTROINTESTINAL INSTRUMENT VIA GUIDE ELEMENT |
EP1850689A4 (en) * | 2005-02-10 | 2013-05-22 | G I View Ltd | Advancement techniques for gastrointestinal tool with guiding element |
US20070002131A1 (en) * | 2005-02-15 | 2007-01-04 | Ritchey Kurtis J | Dynamic interactive region-of-interest panoramic/three-dimensional immersive communication system and method |
US7710452B1 (en) | 2005-03-16 | 2010-05-04 | Eric Lindberg | Remote video monitoring of non-urban outdoor sites |
US8004558B2 (en) | 2005-04-07 | 2011-08-23 | Axis Engineering Technologies, Inc. | Stereoscopic wide field of view imaging system |
US20100272318A1 (en) * | 2005-05-13 | 2010-10-28 | G.I. View Ltd | Endoscopic measurement techniques |
US8430809B2 (en) * | 2005-08-01 | 2013-04-30 | G. I View Ltd. | Capsule for use in small intestine |
WO2007015240A2 (en) * | 2005-08-01 | 2007-02-08 | G.I. View Ltd. | Tools for use in small intestine |
US9241614B2 (en) * | 2005-08-01 | 2016-01-26 | G.I. View Ltd. | Tools for use in esophagus |
US20070103543A1 (en) * | 2005-08-08 | 2007-05-10 | Polar Industries, Inc. | Network panoramic camera system |
KR100663483B1 (en) * | 2005-08-09 | 2007-01-02 | 삼성전자주식회사 | Apparatus and method of unmanned surveillance using an omni-directional camera |
US7630571B2 (en) * | 2005-09-15 | 2009-12-08 | Microsoft Corporation | Automatic detection of panoramic camera position and orientation table parameters |
WO2007060497A2 (en) * | 2005-11-23 | 2007-05-31 | Grandeye, Ltd. | Interactive wide-angle video server |
US8723951B2 (en) | 2005-11-23 | 2014-05-13 | Grandeye, Ltd. | Interactive wide-angle video server |
CN101496387B (en) | 2006-03-06 | 2012-09-05 | 思科技术公司 | System and method for access authentication in a mobile wireless network |
US8572183B2 (en) * | 2006-06-26 | 2013-10-29 | Microsoft Corp. | Panoramic video in a live meeting client |
US20070299710A1 (en) * | 2006-06-26 | 2007-12-27 | Microsoft Corporation | Full collaboration breakout rooms for conferencing |
US7653705B2 (en) * | 2006-06-26 | 2010-01-26 | Microsoft Corp. | Interactive recording and playback for network conferencing |
US20070300165A1 (en) * | 2006-06-26 | 2007-12-27 | Microsoft Corporation, Corporation In The State Of Washington | User interface for sub-conferencing |
IT1378233B1 (en) * | 2006-08-17 | 2010-07-30 | Netnoe S R L | METHOD OF ACQUISITION, PROCESSING AND PRESENTATION OF IMAGES AND MULTIMEDIA NAVIGATION SYSTEM COMBINED WITH THIS METHOD |
EP2107882B9 (en) | 2007-01-17 | 2015-02-18 | G.I. View Ltd. | Diagnostic or treatment tool for colonoscopy |
US7768545B2 (en) * | 2007-03-06 | 2010-08-03 | Otto Gregory Glatt | Panoramic image management system and method |
GB0705910D0 (en) * | 2007-03-27 | 2007-05-09 | Dsam London Llp | Optical arrangement |
FR2916866A1 (en) * | 2007-05-29 | 2008-12-05 | Thomson Licensing Sas | METHOD FOR CREATING AND REPRODUCING A PANORAMIC SOUND IMAGE, AND APPARATUS FOR REPRODUCING SUCH IMAGE |
US8570373B2 (en) * | 2007-06-08 | 2013-10-29 | Cisco Technology, Inc. | Tracking an object utilizing location information associated with a wireless device |
US8077401B2 (en) * | 2007-10-03 | 2011-12-13 | Ricoh Co., Ltd. | Catadioptric imaging system |
CN101221351B (en) * | 2007-11-23 | 2010-08-25 | 浙江大学 | Panoramic scanning and imaging method and system based on colored CCD |
US8203596B1 (en) * | 2007-12-20 | 2012-06-19 | Lockheed Martin Corporation | Panoramic imaging system with dual imagers |
KR101404527B1 (en) * | 2007-12-26 | 2014-06-09 | 다이니폰 인사츠 가부시키가이샤 | Image converter and image converting method |
US8797377B2 (en) | 2008-02-14 | 2014-08-05 | Cisco Technology, Inc. | Method and system for videoconference configuration |
US8319819B2 (en) | 2008-03-26 | 2012-11-27 | Cisco Technology, Inc. | Virtual round-table videoconference |
US8390667B2 (en) | 2008-04-15 | 2013-03-05 | Cisco Technology, Inc. | Pop-up PIP for people not in picture |
AU2009277959B2 (en) * | 2008-07-30 | 2014-01-16 | G.I. View Ltd | System and method for enhanced maneuverability |
WO2010019757A1 (en) | 2008-08-14 | 2010-02-18 | Remotereality Corporation | Three-mirror panoramic camera |
US8682522B2 (en) * | 2008-08-18 | 2014-03-25 | Raytheon Company | Systems and methods for triaging a plurality of targets with a robotic vehicle |
TWI419551B (en) * | 2008-08-22 | 2013-12-11 | Solid-state panoramic image capture apparatus | |
US8694658B2 (en) | 2008-09-19 | 2014-04-08 | Cisco Technology, Inc. | System and method for enabling communication sessions in a network environment |
US8702620B2 (en) | 2008-11-03 | 2014-04-22 | G.I. View Ltd. | Remote pressure sensing system and method thereof |
GB0820416D0 (en) * | 2008-11-07 | 2008-12-17 | Otus Technologies Ltd | Panoramic camera |
FR2939263B1 (en) | 2008-12-01 | 2011-10-14 | Mathieu Trusgnach | METHOD FOR ACQUIRING DATA AND METHOD FOR CONSTRUCTING MULTIMEDIA VIRTUAL VISIT PRODUCT |
US8659637B2 (en) | 2009-03-09 | 2014-02-25 | Cisco Technology, Inc. | System and method for providing three dimensional video conferencing in a network environment |
US8477175B2 (en) | 2009-03-09 | 2013-07-02 | Cisco Technology, Inc. | System and method for providing three dimensional imaging in a network environment |
WO2010125041A1 (en) * | 2009-04-27 | 2010-11-04 | St-Ericsson (France) Sas | Geometric method of transforming a two-dimensional image. |
JP2010263478A (en) * | 2009-05-08 | 2010-11-18 | Olympus Imaging Corp | Camera unit and camera system employing the same |
US8659639B2 (en) | 2009-05-29 | 2014-02-25 | Cisco Technology, Inc. | System and method for extending communications between participants in a conferencing environment |
US9082297B2 (en) | 2009-08-11 | 2015-07-14 | Cisco Technology, Inc. | System and method for verifying parameters in an audiovisual environment |
KR101631912B1 (en) * | 2009-11-03 | 2016-06-20 | 엘지전자 주식회사 | Mobile terminal and control method thereof |
US20110141101A1 (en) * | 2009-12-11 | 2011-06-16 | Two Loons Trading Company, Inc. | Method for producing a head apparatus |
MY169586A (en) * | 2010-01-15 | 2019-04-22 | Mimos Berhad | Vehicle parking and obstacle avoidance system using a single panoramic camera |
US20160042522A1 (en) * | 2010-02-19 | 2016-02-11 | Dual Aperture International Co. Ltd. | Processing Multi-Aperture Image Data |
US9225916B2 (en) | 2010-03-18 | 2015-12-29 | Cisco Technology, Inc. | System and method for enhancing video images in a conferencing environment |
USD628968S1 (en) | 2010-03-21 | 2010-12-14 | Cisco Technology, Inc. | Free-standing video unit |
USD628175S1 (en) | 2010-03-21 | 2010-11-30 | Cisco Technology, Inc. | Mounted video unit |
USD626102S1 (en) | 2010-03-21 | 2010-10-26 | Cisco Tech Inc | Video unit with integrated features |
USD626103S1 (en) | 2010-03-21 | 2010-10-26 | Cisco Technology, Inc. | Video unit with integrated features |
US9313452B2 (en) | 2010-05-17 | 2016-04-12 | Cisco Technology, Inc. | System and method for providing retracting optics in a video conferencing environment |
US8896655B2 (en) | 2010-08-31 | 2014-11-25 | Cisco Technology, Inc. | System and method for providing depth adaptive video conferencing |
US8599934B2 (en) | 2010-09-08 | 2013-12-03 | Cisco Technology, Inc. | System and method for skip coding during video conferencing in a network environment |
US20120210252A1 (en) * | 2010-10-11 | 2012-08-16 | Inna Fedoseyeva | Methods and systems for using management of evaluation processes based on multiple observations of and data relating to persons performing a task to be evaluated |
US8599865B2 (en) | 2010-10-26 | 2013-12-03 | Cisco Technology, Inc. | System and method for provisioning flows in a mobile network environment |
US20120154521A1 (en) * | 2010-10-26 | 2012-06-21 | Townsend Julie A | 360-degree camera head for unmanned surface sea vehicle |
US9876953B2 (en) | 2010-10-29 | 2018-01-23 | Ecole Polytechnique Federale De Lausanne (Epfl) | Omnidirectional sensor array system |
US8699457B2 (en) | 2010-11-03 | 2014-04-15 | Cisco Technology, Inc. | System and method for managing flows in a mobile network environment |
US8730297B2 (en) | 2010-11-15 | 2014-05-20 | Cisco Technology, Inc. | System and method for providing camera functions in a video environment |
US9143725B2 (en) | 2010-11-15 | 2015-09-22 | Cisco Technology, Inc. | System and method for providing enhanced graphics in a video environment |
US9338394B2 (en) | 2010-11-15 | 2016-05-10 | Cisco Technology, Inc. | System and method for providing enhanced audio in a video environment |
US8902244B2 (en) | 2010-11-15 | 2014-12-02 | Cisco Technology, Inc. | System and method for providing enhanced graphics in a video environment |
US8542264B2 (en) | 2010-11-18 | 2013-09-24 | Cisco Technology, Inc. | System and method for managing optics in a video environment |
US8723914B2 (en) | 2010-11-19 | 2014-05-13 | Cisco Technology, Inc. | System and method for providing enhanced video processing in a network environment |
US9111138B2 (en) | 2010-11-30 | 2015-08-18 | Cisco Technology, Inc. | System and method for gesture interface control |
USD682854S1 (en) | 2010-12-16 | 2013-05-21 | Cisco Technology, Inc. | Display screen for graphical user interface |
USD682864S1 (en) | 2010-12-16 | 2013-05-21 | Cisco Technology, Inc. | Display screen with graphical user interface |
USD682293S1 (en) | 2010-12-16 | 2013-05-14 | Cisco Technology, Inc. | Display screen with graphical user interface |
USD678320S1 (en) | 2010-12-16 | 2013-03-19 | Cisco Technology, Inc. | Display screen with graphical user interface |
USD678308S1 (en) | 2010-12-16 | 2013-03-19 | Cisco Technology, Inc. | Display screen with graphical user interface |
USD678894S1 (en) | 2010-12-16 | 2013-03-26 | Cisco Technology, Inc. | Display screen with graphical user interface |
USD682294S1 (en) | 2010-12-16 | 2013-05-14 | Cisco Technology, Inc. | Display screen with graphical user interface |
USD678307S1 (en) | 2010-12-16 | 2013-03-19 | Cisco Technology, Inc. | Display screen with graphical user interface |
US8548269B2 (en) | 2010-12-17 | 2013-10-01 | Microsoft Corporation | Seamless left/right views for 360-degree stereoscopic video |
US20120154548A1 (en) * | 2010-12-17 | 2012-06-21 | Microsoft Corporation | Left/right image generation for 360-degree stereoscopic video |
CN102135707B (en) * | 2011-01-30 | 2012-08-01 | 广州市晶华光学电子有限公司 | Automatic induction and photo-taking camera |
US9058745B2 (en) * | 2011-02-01 | 2015-06-16 | Se-Kure Controls, Inc. | System for facilitating traffic flow within a space |
US8692862B2 (en) | 2011-02-28 | 2014-04-08 | Cisco Technology, Inc. | System and method for selection of video data in a video conference environment |
KR101694689B1 (en) | 2011-03-25 | 2017-01-12 | 삼성전자주식회사 | Method for generating video data and image photographing device thereof |
US8670019B2 (en) | 2011-04-28 | 2014-03-11 | Cisco Technology, Inc. | System and method for providing enhanced eye gaze in a video conferencing environment |
US8786631B1 (en) | 2011-04-30 | 2014-07-22 | Cisco Technology, Inc. | System and method for transferring transparency information in a video environment |
US8934026B2 (en) | 2011-05-12 | 2015-01-13 | Cisco Technology, Inc. | System and method for video coding in a dynamic environment |
JP5652349B2 (en) | 2011-07-25 | 2015-01-14 | 株式会社リコー | Wide-angle lens and omnidirectional imaging device |
GB201117143D0 (en) | 2011-10-05 | 2011-11-16 | Nctech Ltd | Camera |
US8947493B2 (en) | 2011-11-16 | 2015-02-03 | Cisco Technology, Inc. | System and method for alerting a participant in a video conference |
US8682087B2 (en) | 2011-12-19 | 2014-03-25 | Cisco Technology, Inc. | System and method for depth-guided image filtering in a video conference environment |
CA2763649A1 (en) * | 2012-01-06 | 2013-07-06 | 9237-7167 Quebec Inc. | Panoramic camera |
GB2500417B8 (en) | 2012-03-21 | 2017-06-07 | Sony Computer Entertainment Europe Ltd | Camera device, system and method of imaging |
TWI516113B (en) * | 2012-03-26 | 2016-01-01 | 華晶科技股份有限公司 | Image capture device and image synthesis method thereof |
WO2013150775A1 (en) * | 2012-04-02 | 2013-10-10 | パナソニック株式会社 | Image generation device, camera device, image display device, and image generation method |
US9681154B2 (en) | 2012-12-06 | 2017-06-13 | Patent Capital Group | System and method for depth-guided filtering in a video conference environment |
CN104823219B (en) * | 2012-12-06 | 2018-09-28 | 高通股份有限公司 | The annular view of panoramic picture |
CN103942754B (en) * | 2013-01-18 | 2017-07-04 | 深圳市腾讯计算机系统有限公司 | Panoramic picture complementing method and device |
CN110401795A (en) * | 2013-04-30 | 2019-11-01 | 索尼公司 | Image processing apparatus, image processing method and program |
EP2960856B1 (en) * | 2013-04-30 | 2020-03-04 | Sony Corporation | Image processing device, image processing method, and program |
US9843621B2 (en) | 2013-05-17 | 2017-12-12 | Cisco Technology, Inc. | Calendaring activities based on communication processing |
US9581011B2 (en) * | 2013-07-04 | 2017-02-28 | Schlumberger Technology Corporation | Downhole imaging systems and methods |
KR20150026201A (en) * | 2013-09-02 | 2015-03-11 | 엘지전자 주식회사 | A digital device and method of controlling the same |
US11327302B2 (en) | 2013-09-18 | 2022-05-10 | Beth Holst | Secure capture and transfer of image and audio data |
US10008124B1 (en) | 2013-09-18 | 2018-06-26 | Beth Holst | Method and system for providing secure remote testing |
WO2015088228A1 (en) * | 2013-12-09 | 2015-06-18 | Cj Cgv Co., Ltd. | Method and system for generating multi-projection images |
CN106664349B (en) | 2014-03-25 | 2020-03-13 | 6115187加拿大公司暨伊美景象公司 | System for automatically defining user experience or system behavior related to scene image content |
CN111999861A (en) * | 2014-09-15 | 2020-11-27 | 远程保真公司 | Compact panoramic camera: optical system, apparatus, image forming method |
EP3016381A1 (en) | 2014-10-31 | 2016-05-04 | Thomson Licensing | Video conferencing system |
RU2579003C1 (en) * | 2015-03-16 | 2016-03-27 | Вячеслав Михайлович Смелков | Computer system device for panoramic colour image scanning |
US9819865B2 (en) | 2015-10-30 | 2017-11-14 | Essential Products, Inc. | Imaging device and method for generating an undistorted wide view image |
US9813623B2 (en) | 2015-10-30 | 2017-11-07 | Essential Products, Inc. | Wide field of view camera for integration with a mobile device |
US9906721B2 (en) * | 2015-10-30 | 2018-02-27 | Essential Products, Inc. | Apparatus and method to record a 360 degree image |
US9843725B2 (en) * | 2015-12-29 | 2017-12-12 | VideoStitch Inc. | Omnidirectional camera with multiple processors and/or multiple sensors connected to each processor |
US9787896B2 (en) | 2015-12-29 | 2017-10-10 | VideoStitch Inc. | System for processing data from an omnidirectional camera with multiple processors and/or multiple sensors connected to each processor |
WO2017116328A1 (en) | 2015-12-30 | 2017-07-06 | Yasar Universitesi | 360° shooting device |
US20170195579A1 (en) * | 2016-01-05 | 2017-07-06 | 360fly, Inc. | Dynamic adjustment of exposure in panoramic video content |
CN109074632B (en) | 2016-02-16 | 2022-03-01 | 6115187加拿大公司暨伊美景象公司 | Image distortion transformation method and apparatus |
WO2017205642A1 (en) * | 2016-05-25 | 2017-11-30 | Livit Media Inc. | Methods and systems for live sharing 360-degree video streams on a mobile device |
US10154249B2 (en) * | 2016-06-20 | 2018-12-11 | International Institute Of Information Technology, Hyderabad | System and method for capturing horizontal disparity stereo panorama |
CN106231169A (en) * | 2016-09-20 | 2016-12-14 | 长春长理光学精密机械有限公司 | A kind of overall view monitoring photographic head being easily installed |
CN106780310B (en) * | 2016-12-20 | 2020-11-24 | 北京奇艺世纪科技有限公司 | Projection graph construction method and device |
US10999602B2 (en) | 2016-12-23 | 2021-05-04 | Apple Inc. | Sphere projected motion estimation/compensation and mode decision |
GB2573238B (en) | 2017-02-03 | 2022-12-14 | Tv One Ltd | Method of video transmission and display |
US11259046B2 (en) | 2017-02-15 | 2022-02-22 | Apple Inc. | Processing of equirectangular object data to compensate for distortion by spherical projections |
US10924747B2 (en) | 2017-02-27 | 2021-02-16 | Apple Inc. | Video coding techniques for multi-view video |
JP6784199B2 (en) * | 2017-03-09 | 2020-11-11 | フジテック株式会社 | Image processing device |
RU2641287C1 (en) * | 2017-04-21 | 2018-01-17 | Вячеслав Михайлович Смелков | Television camera of colour image for panoramic computer scanning |
IT201700050472A1 (en) * | 2017-05-10 | 2018-11-10 | Rs Life360 S R L | METHOD FOR THE CREATION OF 360 ° PANORAMIC IMAGES TO BE DISPLAYED CONTINUOUSLY FROM TWO-DIMENSIONAL SUPPORT ON A CYLINDRICAL OR CONICAL REFLECTIVE SURFACE THAT SIMULATES THE REAL VISION. |
US10527925B2 (en) | 2017-05-16 | 2020-01-07 | Nico Toutenhoofd | Fully-spherical imaging system, camera support for same, and associated methods |
US11093752B2 (en) | 2017-06-02 | 2021-08-17 | Apple Inc. | Object tracking in multi-view video |
US20190005709A1 (en) * | 2017-06-30 | 2019-01-03 | Apple Inc. | Techniques for Correction of Visual Artifacts in Multi-View Images |
US10754242B2 (en) | 2017-06-30 | 2020-08-25 | Apple Inc. | Adaptive resolution and projection format in multi-direction video |
US10400929B2 (en) | 2017-09-27 | 2019-09-03 | Quick Fitting, Inc. | Fitting device, arrangement and method |
US11409336B2 (en) | 2017-10-04 | 2022-08-09 | Hewlett-Packard Development Company, L.P. | Camera lenses at computer devices |
US10593014B2 (en) * | 2018-03-26 | 2020-03-17 | Ricoh Company, Ltd. | Image processing apparatus, image processing system, image capturing system, image processing method |
US10951859B2 (en) | 2018-05-30 | 2021-03-16 | Microsoft Technology Licensing, Llc | Videoconferencing device and method |
EP3748393A1 (en) | 2019-06-04 | 2020-12-09 | Jabil Optics Germany GmbH | Surround-view imaging system |
US10969047B1 (en) | 2020-01-29 | 2021-04-06 | Quick Fitting Holding Company, Llc | Electrical conduit fitting and assembly |
US11035510B1 (en) | 2020-01-31 | 2021-06-15 | Quick Fitting Holding Company, Llc | Electrical conduit fitting and assembly |
Family Cites Families (174)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE261677C (en) * | 1911-10-30 | |||
US2304434A (en) * | 1928-09-03 | 1942-12-08 | Ibm | Projecting device |
US2146662A (en) | 1936-09-05 | 1939-02-07 | Lieuwe E W Van Albada | Sighting instrument |
US2244235A (en) | 1938-09-03 | 1941-06-03 | Ibm | Cycloramic optical system |
US2628529A (en) | 1948-09-25 | 1953-02-17 | Lawrence E Braymer | Reflecting telescope with auxiliary optical system |
US2654286A (en) | 1950-07-14 | 1953-10-06 | Jorge M Cesar | Optical viewing device for night driving |
FR1234341A (en) | 1958-07-02 | 1960-10-17 | Additional lens for taking and projecting photographic views of moving and still subjects | |
US3205777A (en) | 1961-11-08 | 1965-09-14 | Brenner Arthur | Telescopic mounting for convex mirrors |
US3229576A (en) | 1962-11-21 | 1966-01-18 | Donald W Rees | Hyperbolic ellipsoidal real time display panoramic viewing installation for vehicles |
US3203328A (en) | 1963-02-21 | 1965-08-31 | Marquardt Corp | Full circumferential viewing system |
US3692934A (en) * | 1971-02-11 | 1972-09-19 | Us Navy | Roll and pitch simulator utilizing 360{20 {0 display |
US3723805A (en) | 1971-05-12 | 1973-03-27 | Us Navy | Distortion correction system |
US3785715A (en) | 1972-05-17 | 1974-01-15 | Singer Co | Panoramic infinity image display |
US3832046A (en) | 1972-11-13 | 1974-08-27 | Singer Co | Panoramic projector and camera |
US3846809A (en) | 1973-10-18 | 1974-11-05 | G Troje | Reflectors and mounts for panoramic optical systems |
JPS5648851B2 (en) * | 1973-12-27 | 1981-11-18 | ||
US3872238A (en) | 1974-03-11 | 1975-03-18 | Us Navy | 360 Degree panoramic television system |
CH589309A5 (en) | 1974-03-11 | 1977-06-30 | Infra Vision Ag | |
US3998532A (en) | 1974-04-08 | 1976-12-21 | The United States Of America As Represented By The Secretary Of The Navy | Wide angle single channel projection apparatus |
US4012126A (en) | 1974-04-08 | 1977-03-15 | The United States Of America As Represented By The Secretary Of The Navy | Optical system for 360° annular image transfer |
NL7406227A (en) | 1974-05-09 | 1975-11-11 | Stichting Internationaal Insti | DEVICE IN A VESSEL FOR RECORDING DATA OF AN OBJECT LOCATED OUTSIDE. |
US3970841A (en) * | 1974-11-25 | 1976-07-20 | Green James E | Method and apparatus for dual resolution analysis of a scene |
US3934259A (en) | 1974-12-09 | 1976-01-20 | The United States Of America As Represented By The Secretary Of The Navy | All-sky camera apparatus for time-resolved lightning photography |
JPS6019484B2 (en) * | 1975-11-07 | 1985-05-16 | キヤノン株式会社 | Copying lens |
US4058831A (en) | 1976-09-08 | 1977-11-15 | Lectrolarm Custom Systems, Inc. | Panoramic camera scanning system |
US4078860A (en) | 1976-10-27 | 1978-03-14 | Globus Ronald P | Cycloramic image projection system |
GB1553525A (en) | 1976-10-30 | 1979-09-26 | Luknar A | Security system |
US4157218A (en) | 1977-04-14 | 1979-06-05 | The Perkin-Elmer Corporation | Wide angle scan camera |
US4241985A (en) | 1978-11-27 | 1980-12-30 | Globus Richard D | Panoramic camera |
USD263716S (en) | 1979-02-06 | 1982-04-06 | Globuscope, Inc. | Panoramic camera |
US4326775A (en) | 1979-02-07 | 1982-04-27 | King Don G | Method for operating a panoramic optical system |
GB2315944B (en) | 1979-05-16 | 1998-06-24 | British Aerospace | Improvements relating to surveillance apparatus |
DE3177204D1 (en) | 1980-04-11 | 1990-08-30 | Ampex | SYSTEM FOR SPATIALLY TRANSFORMING IMAGES. |
US4395093A (en) | 1981-05-21 | 1983-07-26 | The United States Of America As Represented By The Secretary Of The Navy | Lens system for panoramic imagery |
FR2508183A1 (en) * | 1981-06-23 | 1982-12-24 | Thomson Csf | OPTICAL PANORAMIC MONITORING DEVICE |
US4429957A (en) | 1981-07-30 | 1984-02-07 | King-Bell Optics, Inc. | Panoramic zoom lens assembly |
US4463380A (en) | 1981-09-25 | 1984-07-31 | Vought Corporation | Image processing system |
US4835532A (en) | 1982-07-30 | 1989-05-30 | Honeywell Inc. | Nonaliasing real-time spatial transform image processing system |
US4484801A (en) | 1982-09-20 | 1984-11-27 | The United States Of America As Represented By The Secretary Of The Navy | Panoramic lens |
JPS59115677A (en) | 1982-12-22 | 1984-07-04 | Hitachi Ltd | Picture processor |
US4602857A (en) | 1982-12-23 | 1986-07-29 | James H. Carmel | Panoramic motion picture camera and method |
US4761641A (en) | 1983-01-21 | 1988-08-02 | Vidcom Rentservice B.V. | Information display system |
HU192125B (en) | 1983-02-08 | 1987-05-28 | Budapesti Mueszaki Egyetem | Block of forming image for centre theory projection adn reproduction of spaces |
US4518898A (en) | 1983-02-22 | 1985-05-21 | Image Graphics, Incorporated | Method and apparatus for correcting image distortions |
US4656506A (en) | 1983-02-25 | 1987-04-07 | Ritchey Kurtis J | Spherical projection system |
IT1195600B (en) | 1983-10-26 | 1988-10-19 | Ivo Rosset | DEVICE FOR MAKING PANORAMIC PHOTOGRAPHS WITH NORMAL USE CAMERA |
JPS60186967A (en) | 1984-03-05 | 1985-09-24 | Fanuc Ltd | Image display method |
US4578682A (en) | 1984-03-20 | 1986-03-25 | Raydx Satellite Systems, Ltd. | Antenna dish |
US4736436A (en) | 1984-04-13 | 1988-04-05 | Fujitsu Limited | Information extraction by mapping |
US4561733A (en) | 1984-04-17 | 1985-12-31 | Recon/Optical, Inc. | Panoramic unity vision system |
DE3422752A1 (en) | 1984-06-19 | 1985-12-19 | Krauss-Maffei AG, 8000 München | ELEVATIBLE OBSERVATION AND TARGET SYSTEM FOR COMBAT VEHICLES |
US4670648A (en) | 1985-03-06 | 1987-06-02 | University Of Cincinnati | Omnidirectional vision system for controllng mobile machines |
JPH0681275B2 (en) | 1985-04-03 | 1994-10-12 | ソニー株式会社 | Image converter |
GB2177278A (en) | 1985-07-05 | 1987-01-14 | Hunger Ibak H Gmbh & Co Kg | Variable sight line television camera |
GB2177871B (en) | 1985-07-09 | 1989-02-08 | Sony Corp | Methods of and circuits for video signal processing |
GB2185360B (en) | 1986-01-11 | 1989-10-25 | Pilkington Perkin Elmer Ltd | Display system |
GB2188205B (en) | 1986-03-20 | 1990-01-04 | Rank Xerox Ltd | Imaging apparatus |
US5038225A (en) | 1986-04-04 | 1991-08-06 | Canon Kabushiki Kaisha | Image reading apparatus with black-level and/or white level correction |
JP2515101B2 (en) | 1986-06-27 | 1996-07-10 | ヤマハ株式会社 | Video and audio space recording / playback method |
GB2194656B (en) | 1986-09-03 | 1991-10-09 | Ibm | Method and system for solid modelling |
US4807158A (en) | 1986-09-30 | 1989-02-21 | Daleco/Ivex Partners, Ltd. | Method and apparatus for sampling images to simulate movement within a multidimensional space |
US4728839A (en) | 1987-02-24 | 1988-03-01 | Remote Technology Corporation | Motorized pan/tilt head for remote control |
US4797942A (en) | 1987-03-02 | 1989-01-10 | General Electric | Pyramid processor for building large-area, high-resolution image by parts |
DE3712453A1 (en) | 1987-04-11 | 1988-10-20 | Wolf Gmbh Richard | WIDE-ANGLE LENS FOR ENDOSCOPES |
USD312263S (en) | 1987-08-03 | 1990-11-20 | Charles Jeffrey R | Wide angle reflector attachment for a camera or similar article |
JPS6446875A (en) | 1987-08-17 | 1989-02-21 | Toshiba Corp | Object discriminating device |
JPS6437174U (en) | 1987-08-28 | 1989-03-06 | ||
FR2620544B1 (en) | 1987-09-16 | 1994-02-11 | Commissariat A Energie Atomique | INTERPOLATION PROCESS |
JPH01101061A (en) | 1987-10-14 | 1989-04-19 | Canon Inc | Picture reader |
US4945367A (en) | 1988-03-02 | 1990-07-31 | Blackshear David M | Surveillance camera system |
US4918473A (en) | 1988-03-02 | 1990-04-17 | Diamond Electronics, Inc. | Surveillance camera system |
EP0342419B1 (en) | 1988-05-19 | 1992-10-28 | Siemens Aktiengesellschaft | Method for the observation of a scene and apparatus therefor |
JP3138264B2 (en) | 1988-06-21 | 2001-02-26 | ソニー株式会社 | Image processing method and apparatus |
US5083389A (en) | 1988-07-15 | 1992-01-28 | Arthur Alperin | Panoramic display device and method of making the same |
US4864335A (en) | 1988-09-12 | 1989-09-05 | Corrales Richard C | Panoramic camera |
JPH0286266A (en) | 1988-09-21 | 1990-03-27 | Fuji Xerox Co Ltd | Picture reader |
US5157491A (en) | 1988-10-17 | 1992-10-20 | Kassatly L Samuel A | Method and apparatus for video broadcasting and teleconferencing |
US4899293A (en) | 1988-10-24 | 1990-02-06 | Honeywell Inc. | Method of storage and retrieval of digital map data based upon a tessellated geoid system |
JPH02127877A (en) | 1988-11-08 | 1990-05-16 | Casio Comput Co Ltd | Electronic still camera provided with fisheye lens |
US5040055A (en) | 1988-12-14 | 1991-08-13 | Horizonscan Inc. | Panoramic interactive system |
GB8829135D0 (en) | 1988-12-14 | 1989-01-25 | Smith Graham T | Panoramic interactive system |
US5153716A (en) | 1988-12-14 | 1992-10-06 | Horizonscan Inc. | Panoramic interactive system |
US4943821A (en) | 1989-01-23 | 1990-07-24 | Janet Louise Gelphman | Topological panorama camera |
US4991020A (en) | 1989-02-17 | 1991-02-05 | Hughes Aircraft Company | Imaging system for providing separate simultaneous real time images from a singel image sensor |
US4943851A (en) | 1989-03-07 | 1990-07-24 | Gold Stake | 360 degree viewing system having a liquid crystal display screen encircling a rotatable projection screen |
US4901140A (en) | 1989-03-07 | 1990-02-13 | Gold Stake | Solid state 360 degree viewing system having a liquid crystal display (LCD) screen that encircles the rotating real image in space and functions as a multi-color filter system |
US5067019A (en) | 1989-03-31 | 1991-11-19 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Programmable remapper for image processing |
NL8900867A (en) | 1989-04-07 | 1990-11-01 | Theo Jogchum Poelstra | A SYSTEM OF "IMAGETRY" FOR THE OBTAINMENT OF DIGITAL, 3D TOPOGRAPHIC INFORMATION. |
DE3927334C1 (en) | 1989-08-18 | 1991-01-10 | Messerschmitt-Boelkow-Blohm Gmbh, 8012 Ottobrunn, De | |
JPH0378373A (en) | 1989-08-22 | 1991-04-03 | Fuji Photo Optical Co Ltd | Television camera operating device |
US5175808A (en) | 1989-09-12 | 1992-12-29 | Pixar | Method and apparatus for non-affine image warping |
US5023725A (en) | 1989-10-23 | 1991-06-11 | Mccutchen David | Method and apparatus for dodecahedral imaging system |
US5115266A (en) | 1989-11-08 | 1992-05-19 | Troje Gerald J | Optical system for recording or projecting a panoramic image |
FR2655503B1 (en) | 1989-12-01 | 1992-02-21 | Thomson Csf | OPTOELECTRONIC SYSTEM FOR AIDING ATTACK AND NAVIGATION MISSIONS. |
JPH0771290B2 (en) | 1989-12-27 | 1995-07-31 | 富士写真光機株式会社 | Signal processing circuit |
US5130794A (en) | 1990-03-29 | 1992-07-14 | Ritchey Kurtis J | Panoramic display system |
NL9000766A (en) | 1990-04-02 | 1991-11-01 | Koninkl Philips Electronics Nv | DEVICE FOR GEOMETRIC CORRECTION OF A DISTRIBUTED IMAGE. |
FR2662831B1 (en) | 1990-05-29 | 1992-08-07 | Cit Alcatel | METHOD FOR MANAGING A DATABASE NETWORK. |
JP3021556B2 (en) | 1990-06-20 | 2000-03-15 | ソニー株式会社 | Video information processing apparatus and method |
US5016109A (en) | 1990-07-02 | 1991-05-14 | Bell South Corporation | Apparatus and method for segmenting a field of view into contiguous, non-overlapping, vertical and horizontal sub-fields |
US5259584A (en) | 1990-07-05 | 1993-11-09 | Wainwright Andrew G | Camera mount for taking panoramic pictures having an electronic protractor |
FR2665600A1 (en) | 1990-08-03 | 1992-02-07 | Thomson Csf | METHOD OF DETECTION FOR PANORAMIC CAMERA, CAMERA FOR ITS IMPLEMENTATION, AND SLEEPING SYSTEM EQUIPPED WITH SUCH A CAMERA |
US5021813A (en) | 1990-08-29 | 1991-06-04 | Corrales Richard C | Manually operated handle for panoramic camera |
US5315331A (en) | 1990-11-09 | 1994-05-24 | Nikon Corporation | Optical apparatus capable of performing a panoramic photographing |
US5097325A (en) | 1990-12-17 | 1992-03-17 | Eol3 Company, Inc. | Circular scanning system for an integrated camera and panoramic catadioptric display |
US5187571A (en) | 1991-02-01 | 1993-02-16 | Bell Communications Research, Inc. | Television system for displaying multiple views of a remote location |
US5200818A (en) | 1991-03-22 | 1993-04-06 | Inbal Neta | Video imaging system with interactive windowing capability |
US5173948A (en) | 1991-03-29 | 1992-12-22 | The Grass Valley Group, Inc. | Video image mapping system |
JP3047927B2 (en) | 1991-04-09 | 2000-06-05 | 三菱電機株式会社 | Video signal clamp circuit |
US5283819A (en) | 1991-04-25 | 1994-02-01 | Compuadd Corporation | Computing and multimedia entertainment system |
US5313306A (en) | 1991-05-13 | 1994-05-17 | Telerobotics International, Inc. | Omniview motionless camera endoscopy system |
US6002430A (en) | 1994-01-31 | 1999-12-14 | Interactive Pictures Corporation | Method and apparatus for simultaneous capture of a spherical image |
US5185667A (en) | 1991-05-13 | 1993-02-09 | Telerobotics International, Inc. | Omniview motionless camera orientation system |
US5903319A (en) | 1991-05-13 | 1999-05-11 | Interactive Pictures Corporation | Method for eliminating temporal and spacial distortion from interlaced video signals |
US5359363A (en) | 1991-05-13 | 1994-10-25 | Telerobotics International, Inc. | Omniview motionless camera surveillance system |
US5764276A (en) | 1991-05-13 | 1998-06-09 | Interactive Pictures Corporation | Method and apparatus for providing perceived video viewing experiences using still images |
US5384588A (en) | 1991-05-13 | 1995-01-24 | Telerobotics International, Inc. | System for omindirectional image viewing at a remote location without the transmission of control signals to select viewing parameters |
US5990941A (en) | 1991-05-13 | 1999-11-23 | Interactive Pictures Corporation | Method and apparatus for the interactive display of any portion of a spherical image |
JP2719056B2 (en) | 1991-08-20 | 1998-02-25 | 富士通株式会社 | 3D object drawing device |
JP3085481B2 (en) | 1991-09-28 | 2000-09-11 | 株式会社ニコン | Catadioptric reduction projection optical system, and exposure apparatus having the optical system |
US5311572A (en) | 1991-10-03 | 1994-05-10 | At&T Bell Laboratories | Cooperative databases call processing system |
US5280540A (en) | 1991-10-09 | 1994-01-18 | Bell Communications Research, Inc. | Video teleconferencing system employing aspect ratio transformation |
US5235656A (en) | 1992-01-24 | 1993-08-10 | Grumman Aerospace Corporation | Variable spatial resolution focal plane |
US5471346A (en) | 1992-03-13 | 1995-11-28 | Lockheed Missiles & Space Co., Inc. | Casegrain telescope with spherical mirror surfaces |
JP3302715B2 (en) | 1992-04-20 | 2002-07-15 | キヤノン株式会社 | Video camera equipment |
AU3930793A (en) | 1992-05-08 | 1993-12-13 | Apple Computer, Inc. | Textured sphere and spherical environment map rendering using texture map double indirection |
WO1994001300A1 (en) | 1992-07-10 | 1994-01-20 | Wanischeck Bergmann Axel | Device for reducing noise in motor vehicles |
DE4226286A1 (en) | 1992-08-08 | 1994-02-10 | Kamerawerke Noble Gmbh | Panorama camera with a lens drum |
US5490239A (en) | 1992-10-01 | 1996-02-06 | University Corporation For Atmospheric Research | Virtual reality imaging system |
US5396583A (en) | 1992-10-13 | 1995-03-07 | Apple Computer, Inc. | Cylindrical to planar image mapping using scanline coherence |
US5530650A (en) | 1992-10-28 | 1996-06-25 | Mcdonnell Douglas Corp. | Computer imaging system and method for remote in-flight aircraft refueling |
EP0623268A1 (en) | 1992-11-24 | 1994-11-09 | Geeris Holding Nederland B.V. | A method and device for producing panoramic images, and a method and device for consulting panoramic images |
US5854713A (en) | 1992-11-30 | 1998-12-29 | Mitsubishi Denki Kabushiki Kaisha | Reflection type angle of view transforming optical apparatus |
US5444476A (en) | 1992-12-11 | 1995-08-22 | The Regents Of The University Of Michigan | System and method for teleinteraction |
US5684937A (en) | 1992-12-14 | 1997-11-04 | Oxaal; Ford | Method and apparatus for performing perspective transformation on visible stimuli |
US5495576A (en) | 1993-01-11 | 1996-02-27 | Ritchey; Kurtis J. | Panoramic image based virtual reality/telepresence audio-visual system and method |
WO1994017493A1 (en) | 1993-01-29 | 1994-08-04 | Q-Dot Photonics, Inc. | Methods and apparatus for image processing |
US5473474A (en) | 1993-07-16 | 1995-12-05 | National Research Council Of Canada | Panoramic lens |
JP3431953B2 (en) * | 1993-07-27 | 2003-07-28 | キヤノン株式会社 | Camera control device and method |
US5432871A (en) | 1993-08-04 | 1995-07-11 | Universal Systems & Technology, Inc. | Systems and methods for interactive image data acquisition and compression |
ATE199603T1 (en) * | 1993-08-25 | 2001-03-15 | Univ Australian | WIDE ANGLE IMAGING SYSTEM |
US5550646A (en) | 1993-09-13 | 1996-08-27 | Lucent Technologies Inc. | Image communication system and method |
CA2129942C (en) | 1993-09-30 | 1998-08-25 | Steven Todd Kaish | Telecommunication network with integrated network-wide automatic call distribution |
US5502592A (en) | 1993-11-22 | 1996-03-26 | Lockheed Missiles & Space Company, Inc. | Wide-aperture infrared lenses with hyper-hemispherical fields of view |
JPH07151965A (en) | 1993-11-26 | 1995-06-16 | Canon Inc | Attachment lens |
US5796426A (en) | 1994-05-27 | 1998-08-18 | Warp, Ltd. | Wide-angle image dewarping method and apparatus |
CA2140681C (en) | 1994-06-17 | 2003-09-23 | Paul C. Chevrette | Wide area coverage infrared search system |
US5508734A (en) | 1994-07-27 | 1996-04-16 | International Business Machines Corporation | Method and apparatus for hemispheric imaging which emphasizes peripheral content |
US5610391A (en) | 1994-08-25 | 1997-03-11 | Owens-Brockway Glass Container Inc. | Optical inspection of container finish dimensional parameters |
US5649032A (en) | 1994-11-14 | 1997-07-15 | David Sarnoff Research Center, Inc. | System for automatically aligning images to form a mosaic image |
US5920337A (en) | 1994-12-27 | 1999-07-06 | Siemens Corporate Research, Inc. | Omnidirectional visual image detector and processor |
US5612533A (en) | 1994-12-27 | 1997-03-18 | Siemens Corporate Research, Inc. | Low-profile horizon-sampling light sensor |
US5714997A (en) | 1995-01-06 | 1998-02-03 | Anderson; David P. | Virtual reality television system |
US5606365A (en) | 1995-03-28 | 1997-02-25 | Eastman Kodak Company | Interactive camera for network processing of captured images |
US5850352A (en) | 1995-03-31 | 1998-12-15 | The Regents Of The University Of California | Immersive video, including video hypermosaicing to generate from multiple video views of a scene a three-dimensional video mosaic from which diverse virtual video scene images are synthesized, including panoramic, scene interactive and stereoscopic images |
US5729471A (en) | 1995-03-31 | 1998-03-17 | The Regents Of The University Of California | Machine dynamic selection of one video camera/image of a scene from multiple video cameras/images of the scene in accordance with a particular perspective on the scene, an object in the scene, or an event in the scene |
CA2146406A1 (en) | 1995-04-05 | 1996-10-06 | Ian Powell | Panoramic fish-eye imaging system |
US5682511A (en) | 1995-05-05 | 1997-10-28 | Microsoft Corporation | Graphical viewer interface for an interactive network system |
US5627675A (en) | 1995-05-13 | 1997-05-06 | Boeing North American Inc. | Optics assembly for observing a panoramic scene |
US5539483A (en) | 1995-06-30 | 1996-07-23 | At&T Corp. | Panoramic projection apparatus |
US5841589A (en) | 1995-09-26 | 1998-11-24 | Boeing North American, Inc. | Panoramic optics assembly having an initial flat reflective element |
US5633810A (en) | 1995-12-14 | 1997-05-27 | Sun Microsystems, Inc. | Method and apparatus for distributing network bandwidth on a media server |
US5601353A (en) | 1995-12-20 | 1997-02-11 | Interval Research Corporation | Panoramic display with stationary display device and rotating support structure |
US5748194A (en) | 1996-05-08 | 1998-05-05 | Live Picture, Inc. | Rendering perspective views of a scene using a scanline-coherent look-up table |
US5760826A (en) * | 1996-05-10 | 1998-06-02 | The Trustees Of Columbia University | Omnidirectional imaging apparatus |
US6331869B1 (en) * | 1998-08-07 | 2001-12-18 | Be Here Corporation | Method and apparatus for electronically distributing motion panoramic images |
US5710661A (en) | 1996-06-27 | 1998-01-20 | Hughes Electronics | Integrated panoramic and high resolution sensor optics |
US5790182A (en) * | 1996-08-05 | 1998-08-04 | Interval Research Corp. | System and method for panoramic imaging using concentric spherical mirrors |
US6043837A (en) | 1997-05-08 | 2000-03-28 | Be Here Corporation | Method and apparatus for electronically distributing images from a panoptic camera system |
JP3086204B2 (en) * | 1997-12-13 | 2000-09-11 | 株式会社アコウル | Omnidirectional imaging device |
US6034716A (en) * | 1997-12-18 | 2000-03-07 | Whiting; Joshua B. | Panoramic digital camera system |
US6226035B1 (en) * | 1998-03-04 | 2001-05-01 | Cyclo Vision Technologies, Inc. | Adjustable imaging system with wide angle capability |
US6304285B1 (en) * | 1998-06-16 | 2001-10-16 | Zheng Jason Geng | Method and apparatus for omnidirectional imaging |
US6198505B1 (en) | 1999-07-19 | 2001-03-06 | Lockheed Martin Corp. | High resolution, high speed digital camera |
-
1997
- 1997-06-11 US US08/872,525 patent/US6459451B2/en not_active Expired - Lifetime
- 1997-06-16 JP JP50300898A patent/JP2002515984A/en not_active Ceased
- 1997-06-16 AU AU33724/97A patent/AU3372497A/en not_active Abandoned
- 1997-06-16 DE DE69729090T patent/DE69729090D1/en not_active Expired - Fee Related
- 1997-06-16 WO PCT/US1997/009313 patent/WO1997050252A1/en active IP Right Grant
- 1997-06-16 EP EP97929734A patent/EP0908053B1/en not_active Expired - Lifetime
-
2000
- 2000-03-08 US US09/521,652 patent/US6593969B1/en not_active Expired - Lifetime
- 2000-03-08 US US09/521,653 patent/US6542184B1/en not_active Expired - Lifetime
- 2000-04-25 US US09/558,777 patent/US6515696B1/en not_active Expired - Lifetime
- 2000-07-11 US US09/614,506 patent/US6424377B1/en not_active Expired - Lifetime
- 2000-07-13 US US09/615,924 patent/US6426774B1/en not_active Expired - Lifetime
- 2000-07-17 US US09/618,141 patent/US6480229B1/en not_active Expired - Lifetime
- 2000-08-14 US US09/638,289 patent/US6583815B1/en not_active Expired - Lifetime
-
2003
- 2003-04-17 US US10/418,444 patent/US7242425B2/en not_active Expired - Fee Related
- 2003-04-17 US US10/419,283 patent/US7486324B2/en not_active Ceased
-
2011
- 2011-01-27 US US13/015,142 patent/USRE44087E1/en not_active Expired - Fee Related
Cited By (138)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6388820B1 (en) * | 1996-06-24 | 2002-05-14 | Be Here Corporation | Panoramic imaging arrangement |
US20050062869A1 (en) * | 1999-04-08 | 2005-03-24 | Zimmermann Steven Dwain | Immersive video presentations |
US20020021353A1 (en) * | 2000-06-09 | 2002-02-21 | Denies Mark | Streaming panoramic video |
US7548253B2 (en) * | 2000-06-12 | 2009-06-16 | Microsoft Corporation | Self-calibration for a catadioptric camera |
US20050099502A1 (en) * | 2000-06-12 | 2005-05-12 | Microsoft Corporation | Self-calibration for a catadioptric camera |
US6870563B1 (en) * | 2000-06-12 | 2005-03-22 | Microsoft Corporation | Self-calibration for a catadioptric camera |
US20050030643A1 (en) * | 2001-01-26 | 2005-02-10 | Ehud Gal | Spherical view imaging apparatus and method |
US20020118890A1 (en) * | 2001-02-24 | 2002-08-29 | Michael Rondinelli | Method and apparatus for processing photographic images |
US20020147773A1 (en) * | 2001-02-24 | 2002-10-10 | Herman Herman | Method and system for panoramic image generation using client-server architecture |
US6856472B2 (en) | 2001-02-24 | 2005-02-15 | Eyesee360, Inc. | Panoramic mirror and system for producing enhanced panoramic images |
US6747647B2 (en) * | 2001-05-02 | 2004-06-08 | Enroute, Inc. | System and method for displaying immersive video |
US20050117227A1 (en) * | 2001-09-18 | 2005-06-02 | Ehud Gal | Panoramic imaging system with optical zoom capability |
WO2003027766A2 (en) * | 2001-09-27 | 2003-04-03 | Eyesee360, Inc. | System and method for panoramic imaging |
US7123777B2 (en) | 2001-09-27 | 2006-10-17 | Eyesee360, Inc. | System and method for panoramic imaging |
US20030068098A1 (en) * | 2001-09-27 | 2003-04-10 | Michael Rondinelli | System and method for panoramic imaging |
WO2003027766A3 (en) * | 2001-09-27 | 2003-10-16 | Eyesee360 Inc | System and method for panoramic imaging |
US7058239B2 (en) | 2001-10-29 | 2006-06-06 | Eyesee360, Inc. | System and method for panoramic imaging |
US20030095338A1 (en) * | 2001-10-29 | 2003-05-22 | Sanjiv Singh | System and method for panoramic imaging |
FR2835925A1 (en) * | 2002-02-11 | 2003-08-15 | Egg Solution Optronics | Correction device for panoramic image acquisition system comprises set of lenses so that rays coming from reflector and/or refractive device diverge towards whole of camera image capture element |
US20070002464A1 (en) * | 2002-05-14 | 2007-01-04 | Ehud Gal | Spherical and nearly spherical view imaging assembly |
US7253969B2 (en) | 2002-05-14 | 2007-08-07 | O.D.F. Medical Ltd. | Spherical and nearly spherical view imaging assembly |
WO2004008185A3 (en) * | 2002-07-15 | 2004-04-15 | Odf Optronics Ltd | Optical lens providing omni-directional coverage and illumination |
WO2004008185A2 (en) * | 2002-07-15 | 2004-01-22 | O.D.F. Optronics, Ltd. | Optical lens providing omni-directional coverage and illumination |
US7362516B2 (en) | 2002-07-15 | 2008-04-22 | O.D.F. Optronics, Ltd. | Optical lens providing omni-directional coverage and illumination |
US20060152819A1 (en) * | 2002-11-04 | 2006-07-13 | Ehud Gal | Omni-directional imaging and illumination assembly |
US7570437B2 (en) | 2002-11-04 | 2009-08-04 | O.D.F. Optronics, Ltd. | Omni-directional imaging and illumination assembly |
US20040220478A1 (en) * | 2003-02-26 | 2004-11-04 | Wallace Jeffrey M. | Method and devices for imaging and biopsy |
US20090312608A1 (en) * | 2003-02-26 | 2009-12-17 | Ikona Medical Corporation | Method and devices of imaging and biopsy |
US7559890B2 (en) * | 2003-02-26 | 2009-07-14 | Ikona Medical Corporation | Endoscopic imaging of an organ system |
US10218903B2 (en) | 2003-06-03 | 2019-02-26 | Leonard P. Steuart, III | Digital 3D/360 degree camera system |
US8659640B2 (en) | 2003-06-03 | 2014-02-25 | Leonard P. Steuart, III | Digital 3D/360 ° camera system |
US8937640B2 (en) | 2003-06-03 | 2015-01-20 | Leonard P. Steuart, III | Digital 3D/360 degree camera system |
US11012622B2 (en) | 2003-06-03 | 2021-05-18 | Leonard P. Steuart, III | Digital 3D/360 degree camera system |
US9706119B2 (en) | 2003-06-03 | 2017-07-11 | Leonard P. Steuart, III | Digital 3D/360 degree camera system |
US10574888B2 (en) | 2003-06-03 | 2020-02-25 | Leonard P. Steuart, III | Digital 3D/360 degree camera system |
US8274550B2 (en) | 2003-06-03 | 2012-09-25 | Steuart Iii Leonard P Skip | Digital 3D/360 degree camera system |
US7463280B2 (en) | 2003-06-03 | 2008-12-09 | Steuart Iii Leonard P | Digital 3D/360 degree camera system |
US9124802B2 (en) | 2003-06-03 | 2015-09-01 | Leonard P. Steuart, III | Digital 3D/360 degree camera system |
US20070141944A1 (en) * | 2003-06-20 | 2007-06-21 | Matthew Abeshouse | Tossable flier |
US20100149661A1 (en) * | 2004-01-21 | 2010-06-17 | O.D.F. Medical Ltd. | Lens having a circumferential field of view |
US20070182812A1 (en) * | 2004-05-19 | 2007-08-09 | Ritchey Kurtis J | Panoramic image-based virtual reality/telepresence audio-visual system and method |
US7071964B1 (en) | 2004-08-23 | 2006-07-04 | Otto Gregory Glatt | 360-degree panoramic scene-storage device |
US8750636B2 (en) | 2005-04-16 | 2014-06-10 | Apple Inc. | Smoothing and/or locking operations in video editing |
US7978925B1 (en) | 2005-04-16 | 2011-07-12 | Apple Inc. | Smoothing and/or locking operations in video editing |
US20070036537A1 (en) * | 2005-08-10 | 2007-02-15 | Samsung Electro-Mechanics Co., Ltd. | Thinner mobile camera optical lens system and image forming method using the same |
US7689116B2 (en) * | 2005-08-10 | 2010-03-30 | Samsung Electro-Mechanics Co., Ltd. | Thinner mobile camera optical lens system and image forming method using the same |
US20110116767A1 (en) * | 2005-11-02 | 2011-05-19 | Christophe Souchard | Spatial and temporal alignment of video sequences |
US9998685B2 (en) | 2005-11-02 | 2018-06-12 | Apple Inc. | Spatial and temporal alignment of video sequences |
US9530220B2 (en) | 2005-11-02 | 2016-12-27 | Apple Inc. | Spatial and temporal alignment of video sequences |
US20100020202A1 (en) * | 2006-04-13 | 2010-01-28 | Opt Corporation | Camera apparatus, and image processing apparatus and image processing method |
US20140009571A1 (en) * | 2006-11-23 | 2014-01-09 | Zheng Jason Geng | Wide Field of View Reflector and Method of Designing and Making Same |
US8669845B1 (en) | 2007-03-30 | 2014-03-11 | Vail Resorts, Inc. | RFID skier monitoring systems and methods |
US20100134621A1 (en) * | 2007-04-06 | 2010-06-03 | Korea Expressway Corporation | Multi-area monitoring system from single cctv having a camera quadratic curved surface mirror structure and it, and unwrapping method for the same |
US20090207234A1 (en) * | 2008-02-14 | 2009-08-20 | Wen-Hsiung Chen | Telepresence system for 360 degree video conferencing |
US8355041B2 (en) * | 2008-02-14 | 2013-01-15 | Cisco Technology, Inc. | Telepresence system for 360 degree video conferencing |
US20090253987A1 (en) * | 2008-04-02 | 2009-10-08 | Medison Co., Ltd. | Formation of an elastic image in an ultrasound system |
US8864668B2 (en) * | 2008-04-02 | 2014-10-21 | Medison Co., Ltd. | Formation of an elastic image in an ultrasound system |
US9307165B2 (en) * | 2008-08-08 | 2016-04-05 | Qualcomm Technologies, Inc. | In-camera panorama image stitching assistance |
US20100033553A1 (en) * | 2008-08-08 | 2010-02-11 | Zoran Corporation | In-camera panorama image stitching assistance |
US8363089B2 (en) * | 2008-09-03 | 2013-01-29 | Dai Nippon Printing Co., Ltd. | Image converter |
US20130177258A1 (en) * | 2008-09-03 | 2013-07-11 | Dai Nippon Printing Co., Ltd. | Image converter |
US8730323B2 (en) * | 2008-09-03 | 2014-05-20 | Dai Nippon Printing Co., Ltd. | Image converter |
US20100053325A1 (en) * | 2008-09-03 | 2010-03-04 | Dai Nippon Printing Co., Ltd. | Image converter |
TWI402770B (en) * | 2008-11-14 | 2013-07-21 | Hon Hai Prec Ind Co Ltd | Computing system and method for automatically searching inflection points in a border of an object image |
US8699821B2 (en) | 2010-07-05 | 2014-04-15 | Apple Inc. | Aligning images |
US8885978B2 (en) | 2010-07-05 | 2014-11-11 | Apple Inc. | Operating a device to capture high dynamic range images |
US10038855B2 (en) | 2010-07-05 | 2018-07-31 | Apple Inc. | Operating a device to capture high dynamic range images |
US8760537B2 (en) | 2010-07-05 | 2014-06-24 | Apple Inc. | Capturing and rendering high dynamic range images |
US10341574B2 (en) | 2010-07-05 | 2019-07-02 | Apple Inc. | Operating a device to capture high dynamic range images |
US9420198B2 (en) | 2010-07-05 | 2016-08-16 | Apple Inc. | Operating a device to capture high dynamic range images |
US20120262580A1 (en) * | 2011-04-14 | 2012-10-18 | Klaus Huebner | Vehicle Surround View System |
US9679359B2 (en) * | 2011-04-14 | 2017-06-13 | Harman Becker Automotive Systems Gmbh | Vehicle surround view system |
US20140314336A1 (en) * | 2011-12-19 | 2014-10-23 | Dai Nippon Printing Co., Ltd. | Image processing device, image processing method, program for image processing device, recording medium, and image display device |
US9269124B2 (en) * | 2011-12-19 | 2016-02-23 | Dai Nippon Printing Co., Ltd. | Image processing device, image processing method, program for image processing device, recording medium, and image display device |
US9229200B2 (en) | 2012-01-09 | 2016-01-05 | Eyesee360, Inc. | Panoramic optical systems |
WO2013104347A1 (en) * | 2012-01-11 | 2013-07-18 | Kanna, Michael | Method and device for the recording and reproduction of panoramic representations |
US9473699B2 (en) * | 2012-06-01 | 2016-10-18 | Nintendo Co., Ltd. | Storage medium storing information processing program, information processing device, information processing system, and information processing method |
US20130321568A1 (en) * | 2012-06-01 | 2013-12-05 | Hal Laboratory, Inc. | Storage medium storing information processing program, information processing device, information processing system, and information processing method |
CN102843505A (en) * | 2012-09-26 | 2012-12-26 | 张煜 | Cylindrical panoramic photographic device |
US20180115759A1 (en) * | 2012-12-27 | 2018-04-26 | Panasonic Intellectual Property Management Co., Ltd. | Sound processing system and sound processing method that emphasize sound from position designated in displayed video image |
US10536681B2 (en) * | 2012-12-27 | 2020-01-14 | Panasonic Intellectual Property Management Co., Ltd. | Sound processing system and sound processing method that emphasize sound from position designated in displayed video image |
US10244219B2 (en) * | 2012-12-27 | 2019-03-26 | Panasonic Intellectual Property Management Co., Ltd. | Sound processing system and sound processing method that emphasize sound from position designated in displayed video image |
US9826211B2 (en) * | 2012-12-27 | 2017-11-21 | Panasonic Intellectual Property Management Co., Ltd. | Sound processing system and processing method that emphasize sound from position designated in displayed video image |
US20150350621A1 (en) * | 2012-12-27 | 2015-12-03 | Panasonic Intellectual Property Management Co., Ltd. | Sound processing system and sound processing method |
US9501214B2 (en) * | 2013-01-04 | 2016-11-22 | Lg Electronics Inc. | Mobile terminal and controlling method thereof |
US20140194164A1 (en) * | 2013-01-04 | 2014-07-10 | Lg Electronics Inc. | Mobile terminal and controlling method thereof |
US11132877B2 (en) | 2013-07-26 | 2021-09-28 | Skybell Technologies Ip, Llc | Doorbell communities |
US11140253B2 (en) | 2013-07-26 | 2021-10-05 | Skybell Technologies Ip, Llc | Doorbell communication and electrical systems |
US11362853B2 (en) | 2013-07-26 | 2022-06-14 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US10440166B2 (en) | 2013-07-26 | 2019-10-08 | SkyBell Technologies, Inc. | Doorbell communication and electrical systems |
US11889009B2 (en) | 2013-07-26 | 2024-01-30 | Skybell Technologies Ip, Llc | Doorbell communication and electrical systems |
US9165444B2 (en) * | 2013-07-26 | 2015-10-20 | SkyBell Technologies, Inc. | Light socket cameras |
US11651665B2 (en) | 2013-07-26 | 2023-05-16 | Skybell Technologies Ip, Llc | Doorbell communities |
US10218932B2 (en) | 2013-07-26 | 2019-02-26 | SkyBell Technologies, Inc. | Light socket cameras |
US11102027B2 (en) | 2013-07-26 | 2021-08-24 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US10440165B2 (en) | 2013-07-26 | 2019-10-08 | SkyBell Technologies, Inc. | Doorbell communication and electrical systems |
US11386730B2 (en) | 2013-07-26 | 2022-07-12 | Skybell Technologies Ip, Llc | Smart lock systems and methods |
JP2017505565A (en) * | 2013-12-09 | 2017-02-16 | シゼイ シジブイ カンパニー リミテッド | Multi-plane video generation method and system |
US11343473B2 (en) | 2014-06-23 | 2022-05-24 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US11184589B2 (en) | 2014-06-23 | 2021-11-23 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US9883101B1 (en) * | 2014-07-23 | 2018-01-30 | Hoyos Integrity Corporation | Providing a real-time via a wireless communication channel associated with a panoramic video capture device |
WO2016048386A1 (en) * | 2014-09-25 | 2016-03-31 | Ram Industrial Design, Inc. | Omnidirectional catadioptric lens structure |
US10222596B2 (en) | 2014-09-25 | 2019-03-05 | Sphere Optics Company, Llc | Omnidirectional catadioptric lens structure |
US9997036B2 (en) | 2015-02-17 | 2018-06-12 | SkyBell Technologies, Inc. | Power outlet cameras |
US11388373B2 (en) | 2015-03-07 | 2022-07-12 | Skybell Technologies Ip, Llc | Garage door communication systems and methods |
US10742938B2 (en) | 2015-03-07 | 2020-08-11 | Skybell Technologies Ip, Llc | Garage door communication systems and methods |
US11228739B2 (en) | 2015-03-07 | 2022-01-18 | Skybell Technologies Ip, Llc | Garage door communication systems and methods |
US11575537B2 (en) | 2015-03-27 | 2023-02-07 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US11381686B2 (en) | 2015-04-13 | 2022-07-05 | Skybell Technologies Ip, Llc | Power outlet cameras |
US10672238B2 (en) | 2015-06-23 | 2020-06-02 | SkyBell Technologies, Inc. | Doorbell communities |
US11004312B2 (en) | 2015-06-23 | 2021-05-11 | Skybell Technologies Ip, Llc | Doorbell communities |
US10909384B2 (en) | 2015-07-14 | 2021-02-02 | Panasonic Intellectual Property Management Co., Ltd. | Monitoring system and monitoring method |
US10706702B2 (en) | 2015-07-30 | 2020-07-07 | Skybell Technologies Ip, Llc | Doorbell package detection systems and methods |
US10687029B2 (en) | 2015-09-22 | 2020-06-16 | SkyBell Technologies, Inc. | Doorbell communication systems and methods |
US10674119B2 (en) | 2015-09-22 | 2020-06-02 | SkyBell Technologies, Inc. | Doorbell communication systems and methods |
US9888216B2 (en) | 2015-09-22 | 2018-02-06 | SkyBell Technologies, Inc. | Doorbell communication systems and methods |
US10362224B2 (en) * | 2015-10-22 | 2019-07-23 | Gopro, Inc. | System and method for identifying comment clusters for panoramic content segments |
US10750088B2 (en) | 2015-10-22 | 2020-08-18 | Gopro, Inc. | System and method for identifying comment clusters for panoramic content segments |
US10602128B2 (en) | 2015-12-03 | 2020-03-24 | Koc Universitesi | Multi-view occlusion-preventive optical system in the form of a screen combined with an image capturing device |
WO2017095340A1 (en) | 2015-12-03 | 2017-06-08 | Koc Universitesi | Multi-view occlusion-preventive optical system in the form of a screen combined with an image capturing device |
WO2017095341A1 (en) | 2015-12-04 | 2017-06-08 | Koc Universitesi | Physical object reconstruction through a projection display system |
US10739670B2 (en) | 2015-12-04 | 2020-08-11 | Augmency Teknoloji Sanayi Anonim Sirketi | Physical object reconstruction through a projection display system |
WO2017099675A1 (en) | 2015-12-07 | 2017-06-15 | Koç Üni̇versi̇tesi̇ | A dual function display and multi-view imaging system |
US10531070B2 (en) | 2015-12-07 | 2020-01-07 | Koc Universitesi | Dual function display and multi-view imaging system |
US11361641B2 (en) | 2016-01-27 | 2022-06-14 | Skybell Technologies Ip, Llc | Doorbell package detection systems and methods |
US10389999B2 (en) * | 2016-02-17 | 2019-08-20 | Qualcomm Incorporated | Storage of virtual reality video in media files |
US10027929B2 (en) * | 2016-02-26 | 2018-07-17 | Larry Molina | System for law enforcement recording |
US20170251175A1 (en) * | 2016-02-26 | 2017-08-31 | Larry Molina | System for law enforcement recording |
US10825133B2 (en) * | 2016-04-05 | 2020-11-03 | Samsung Electronics Co., Ltd. | Method and apparatus for processing image |
US10043332B2 (en) | 2016-05-27 | 2018-08-07 | SkyBell Technologies, Inc. | Doorbell package detection systems and methods |
CN106447611A (en) * | 2016-09-09 | 2017-02-22 | 国网福建省电力有限公司 | Method for displaying panoramic image of power transmission tower |
US11810436B2 (en) | 2017-09-18 | 2023-11-07 | Skybell Technologies Ip, Llc | Outdoor security systems and methods |
US10909825B2 (en) | 2017-09-18 | 2021-02-02 | Skybell Technologies Ip, Llc | Outdoor security systems and methods |
US11269249B2 (en) | 2017-09-28 | 2022-03-08 | Fujifilm Corporation | Optical system, projection apparatus, and imaging apparatus |
US11651668B2 (en) | 2017-10-20 | 2023-05-16 | Skybell Technologies Ip, Llc | Doorbell communities |
US10897573B2 (en) * | 2018-11-21 | 2021-01-19 | Ricoh Company, Ltd. | Image capturing system, terminal and computer readable medium which correct images |
US11074790B2 (en) | 2019-08-24 | 2021-07-27 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
US11854376B2 (en) | 2019-08-24 | 2023-12-26 | Skybell Technologies Ip, Llc | Doorbell communication systems and methods |
Also Published As
Publication number | Publication date |
---|---|
USRE44087E1 (en) | 2013-03-19 |
US6515696B1 (en) | 2003-02-04 |
US7242425B2 (en) | 2007-07-10 |
US20030193606A1 (en) | 2003-10-16 |
EP0908053B1 (en) | 2004-05-12 |
JP2002515984A (en) | 2002-05-28 |
US7486324B2 (en) | 2009-02-03 |
US20030193607A1 (en) | 2003-10-16 |
US6593969B1 (en) | 2003-07-15 |
EP0908053A1 (en) | 1999-04-14 |
US6480229B1 (en) | 2002-11-12 |
DE69729090D1 (en) | 2004-06-17 |
US6542184B1 (en) | 2003-04-01 |
US6426774B1 (en) | 2002-07-30 |
US6583815B1 (en) | 2003-06-24 |
US6424377B1 (en) | 2002-07-23 |
US6459451B2 (en) | 2002-10-01 |
WO1997050252A1 (en) | 1997-12-31 |
AU3372497A (en) | 1998-01-14 |
EP0908053A4 (en) | 2000-03-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6515696B1 (en) | Method and apparatus for presenting images from a remote location | |
EP1178352A1 (en) | Method of and apparatus for presenting panoramic images at a local receiver, and a corresponding computer program | |
US5721585A (en) | Digital video panoramic image capture and display system | |
US7525567B2 (en) | Recording a stereoscopic image of a wide field of view | |
US6545701B2 (en) | Panoramic digital camera system and method | |
US7336299B2 (en) | Panoramic video system with real-time distortion-free imaging | |
US7224382B2 (en) | Immersive imaging system | |
US5686957A (en) | Teleconferencing imaging system with automatic camera steering | |
US7298392B2 (en) | Omni-directional camera design for video conferencing | |
US20100045773A1 (en) | Panoramic adapter system and method with spherical field-of-view coverage | |
US8059185B2 (en) | Photographing apparatus, image display method, computer program and storage medium for acquiring a photographed image in a wide range | |
US20030103744A1 (en) | Image input device | |
JPH11508384A (en) | Method and apparatus for creating a spherical image | |
US20130016181A1 (en) | System and method for capturing and displaying cinema quality panoramic images | |
US20050254817A1 (en) | Autostereoscopic electronic camera | |
JP2020204874A (en) | Image processing system, imaging system, image processing apparatus, imaging apparatus and program | |
JP2003512783A (en) | Camera with peripheral vision | |
KR200378726Y1 (en) | A full direction panorama camera device using a conical mirror | |
KR200378727Y1 (en) | A full direction panorama replaying device using a conical mirror |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: BEHERE CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DRISCOLL, EDWARD JR., PH.D.;MORROW, HOWARD;STEINHAUER, ALAN J.;AND OTHERS;REEL/FRAME:008821/0348;SIGNING DATES FROM 19971024 TO 19971025 |
|
AS | Assignment |
Owner name: VENTURE BANKING GROUP, A DIVSION OF CUPERTINO NATI Free format text: SECURITY AGREEMENT;ASSIGNOR:BE HERE CORPORATION;REEL/FRAME:009339/0369 Effective date: 19980706 |
|
AS | Assignment |
Owner name: VENTURE BANKING GROUP, A DIVISION OF CUPERTINO NAT Free format text: SECURITY INTEREST;ASSIGNOR:BE HERE CORPORATION;REEL/FRAME:011059/0126 Effective date: 20000609 |
|
AS | Assignment |
Owner name: WASSERSTEIN ADELSON VENTURES, L>P>, CALIFORN Free format text: SECURITY INTEREST;ASSIGNOR:BE HERE CORPORATION, A CALIFORNIA CORPORATION;REEL/FRAME:013169/0933 Effective date: 20020701 |
|
AS | Assignment |
Owner name: BEHERE CORPORATION, CALIFORNIA Free format text: REASSIGNMENT AND RELEASE OF SECURITY INTEREST;ASSIGNOR:VENTURE BANKING GROUP;REEL/FRAME:013231/0264 Effective date: 20020821 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAT HOLDER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: LTOS); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
REFU | Refund |
Free format text: REFUND - PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: R1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: BE HERE CORPORATION, CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNORS:BIRCHMERE VENTURES II, L.P.;DIETRICK, CHARLES;DRISCOLL, DAVID;AND OTHERS;REEL/FRAME:020125/0852;SIGNING DATES FROM 20071113 TO 20071116 Owner name: BE HERE CORPORATION, CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:WASSERSTEIN ADELSON VENTURES, L.P.;REEL/FRAME:020125/0676 Effective date: 20071116 |
|
AS | Assignment |
Owner name: B. H. IMAGE CO. LLC, DELAWARE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BE HERE CORPORATION;REEL/FRAME:020325/0452 Effective date: 20071117 |
|
FEPP | Fee payment procedure |
Free format text: PAT HOLDER NO LONGER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: STOL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FPAY | Fee payment |
Year of fee payment: 12 |
|
AS | Assignment |
Owner name: CHARTOLEAUX KG LIMITED LIABILITY COMPANY, DELAWARE Free format text: MERGER;ASSIGNOR:B.H. IMAGE CO. LLC;REEL/FRAME:037096/0897 Effective date: 20150812 |
|
AS | Assignment |
Owner name: STEEPHILL TECHNOLOGIES LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTELLECTUAL VENTURES ASSETS 99 LLC;REEL/FRAME:048565/0616 Effective date: 20181228 |
|
AS | Assignment |
Owner name: CEDAR LANE TECHNOLOGIES INC., BRITISH COLUMBIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:STEEPHILL TECHNOLOGIES LLC;REEL/FRAME:049156/0390 Effective date: 20190503 |