(54) SYSTEM AND METHOD FOR IMAGE PROCESSING OF MULTIPLE IMAGES
(75) Inventor: Naoki Chiba, Osaka (JP)
(73) Assignee: Sanyo Electric Co., Ltd., Osaka (JP)
( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b) by 968 days.
(21) Appl. No.: 10/402,676
(22) Filed: Mar. 28, 2003
(65) Prior Publication Data
US 2003/0184778 Al Oct. 2, 2003
(30) Foreign Application Priority Data
Mar. 28, 2002 (JP) 2002-091279
(51) Int. CI.
H04N1/387 (2006.01)
(52) U.S. CI 358/450; 345/629; 382/284;
382/282; 382/206; 382/212; 382/213
(58) Field of Classification Search 358/450;
345/629; 382/284, 206, 212, 213, 282 See application file for complete search history.
(56) References Cited
U.S. PATENT DOCUMENTS
5,649,032 A 7/1997 Burt et al 382/284
5,706,416 A 1/1998 Mann et al 395/127
6,097,854 A 8/2000 Szeliski et al 382/284
6,249,616 Bl * 6/2001 Hashimoto 382/284
6,549,651 B2* 4/2003 Xiong et al 382/154
6,606,404 Bl * 8/2003 Zhang et al 382/154
6,608,923 Bl * 8/2003 Zhang et al 382/154
6,985,638 Bl * 1/2006 Aoki 382/284
7,095,905 Bl * 8/2006 Peterson 382/284
2002/0018589 Al* 2/2002 Beuker et al 382/132
2003/0058945 Al * 3/2003 Chiba et al 375/240.16
A plurality of images are read in, two line segments which need be inherently parallel with each other in each of the images are designated, and a planar projective transform matrix is obtained from coordinates of end points of the line segments for parallelizing the line segments, thereby executing height normalization. Subsequently, totally four sets of corresponding points are obtained among three sequential images at regions where adjacent two images are overlapped, and matrix elements of planar projective transform matrix is obtained from the obtained corresponding points to calculate an stitch coefficient. Image stitching is executed by using the stitch coefficient. In stitching a plurality of images for stitching, it is possible to accurately stitch the images after the height is normalized among the images.
14 Claims, 9 Drawing Sheets
