Video object segmentation using active contour modelling with global relaxation

(54) VIDEO OBJECT SEGMENTATION USING ACTIVE CONTOUR MODELLING WITH GLOBAL RELAXATION

(75) Inventors: Shijun Sun, Seattle, WA (US);

Yongmin Kim, Seattle, WA (US)

(73) Assignee: University of Washington, Seattle, WA (US)

( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b) by 0 days.

(21) Appl. No.: 09/323,501

(22) Filed: Jun. 10, 1999

(51) Int. CI.7 G06K 9/00; G06K 9/62

(52) U.S. CI 382/103; 382/215

(58) Field of Search 382/103, 199,

382/224, 294, 215; 345/442; 600/443

(56) References Cited

U.S. PATENT DOCUMENTS

5,133,021 A 7/1992 Carpenter et al.

5.142.590 A 8/1992 Carpenter et al 382/14

5,157,738 A 10/1992 Carpenter et al.

5.239.591 A * 8/1993 Ranganath 382/199

5,999,651 A * 12/1999 Chang et al 382/107

6,195,445 Bl * 2/2001 Dubuisson-Jolly et al. . 600/450

6,201,543 Bl * 3/2001 O'Donnell et al 382/128

6,346,124 Bl * 2/2002 Geiser et al 382/128

2001/0024516 Al * 9/2001 Yoshioka et al 382/128

FOREIGN PATENT DOCUMENTS

EP 0806733 11/1997

OTHER PUBLICATIONS

Chalana et al., A multiple active contour model for cardiac boundary detection on echocardiographic sequences, IEEE Transactions on Medical imaging, Jun. 1996.* Williams et al., A fast algorithm for active contours and curvature estimation, CVGIP: Image Understanding, vol. 55, No. 1, Jan., 1992, pp. 14-26.*

Viterbi et al., "Principles of Digital Communication and Coding", McGraw-Hill Book Company, 1979. Viterbi, Andrew J., "Error Bounds for Convolutional Codes and an Asymptotocally Optimum Decoding Algorithm," IEEE Transactions on Information Theory, vol. IT-13, No. 2, Apr. 1967.

(List continued on next page.)

Primary Examiner—Amelia M. Au
Assistant Examiner—Martin Miller
(74) Attorney, Agent, or Firm—Steven P. Koda

(57) ABSTRACT

A system for image object tracking and segmentation, includes (i) a modified adaptive resonance theory-2 (M-ART2) model for detecting changes of scenes, (ii) a two-dimensional correlative autopredicitve search (2D CAPS) method for object tracking, (iii) a derivation of contour energy for use in modelling an object edge, and (iv) an active contour model with global relaxation for defining optimal image object boundaries. The modelled object boundary is derived from an edge potential energy calculation and a set of current edge points. For each edge point, several candidate data points are also selected. Rather than calculate an energy value for each potential contours, a solution is achieved by comparing energy differences along a travel path. The selected contour is built in steps. An optimal path is selected from the potential paths.

20 Claims, 9 Drawing Sheets

OTHER PUBLICATIONS

Cohen, Laurent D., Note On Active Contour Models and Balloons; CVGIP: Image Understanding vol. 53, No. 2, Mar. 1991.

Kass et al., "Snakes: Active Contour Models;" International Journal of Computer Vision, pp 321-331; 1988. Singh et al.; "Comparison of Daubechies, Coiflet, and Symlet for Edge Detection;" SPIE vol. 3074; 0277-786X; 1997. Carpenter et al., "ART 2: Self-Organization of Stable Category Recognition Codes for Analog Input Patterns," Applied optics vol. 26, No. 23, Dec. 1, 1987. Carpenter et al., "A Massively Parallel Architecture for a Self-Organizing Neural Pattern Recognition Machine," Computer Vision, Graphics and Image Processing, vol. 37 pp 54, 55, 115 (1987).

Grossberg, S., "Adaptive Pattern Classification and Universal Recoding: I. Parallel Development and Coding of Neural Feature Detectors," Biological Cybernetics vol. 23, pp 121-134 (1976).

Grossberg, S., "Adaptive Pattern Classification and Universal Recoding: II. Feedback, Expectation, Olfaction, Illusions," Biological Cybernetics vol. 23 pp 187-202 (1976).

Celenk et al., "Color Image Coding Using Block Truncation and Vector Quantization," SPIE vol. 2952, pp. 347-354, 1996.

Orchard et al. "Color Quantization of Images," IEEE Transactions on Signal Processing, vol. 39, No. 12, Dec. 1991.

Gray, Robert M., "Vector Quantization," IEEE ASSP Magazine Apr. 1984.

Goshtasby, et al., "A Two-Stage Correlation Approach to Template Matching," IEEE Trans, on Pattern Analysis and Machine Intelligence, vol. PAMI-6, No. 3, May 1984.

Rosenfeld et al., "Coarse-Fine Templete Matching," IEEE Trans, on Systems, Man, and Cybernetics; Feb. 1977. Hirooka et al., "Hierarchical Distributed Template Matching," SPIE vol. 3029 0277-786X/97. Pratt, William K.; "Correlation Technique of Image Registration," IEEE Trans, on Aerospace and Electronic Systems; vol. AES-10, No. 3; May 1974.

Musmann et al.; "Advances in Picture Coding," Proceedings of the IEEE vol. 73, No. 4; Apr. 1985.

* cited by examiner