WO2000070881A1 - Color image processing method - Google Patents

Color image processing method Download PDF

Info

Publication number
WO2000070881A1
WO2000070881A1 PCT/KR2000/000249 KR0000249W WO0070881A1 WO 2000070881 A1 WO2000070881 A1 WO 2000070881A1 KR 0000249 W KR0000249 W KR 0000249W WO 0070881 A1 WO0070881 A1 WO 0070881A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
color
regions
ratio
region
Prior art date
Application number
PCT/KR2000/000249
Other languages
French (fr)
Inventor
Hyun Doo Shin
Yang Lim Choi
Yining Deng
B. S. Manjunath
Original Assignee
Samsung Electronics Co., Ltd.
The Regents Of The University Of California
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co., Ltd., The Regents Of The University Of California filed Critical Samsung Electronics Co., Ltd.
Priority to AU36808/00A priority Critical patent/AU3680800A/en
Priority to EP00915566A priority patent/EP1195062A4/en
Priority to JP2000619208A priority patent/JP2003500712A/en
Publication of WO2000070881A1 publication Critical patent/WO2000070881A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/64—Systems for the transmission or the storage of the colour picture signal; Details therefor, e.g. coding or decoding means therefor
    • H04N1/644—Systems for the transmission or the storage of the colour picture signal; Details therefor, e.g. coding or decoding means therefor using a reduced set of representative colours, e.g. each representing a particular range in a colour space
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof

Definitions

  • the present invention relates to a color image processing method, and more particularly, to a method for indexing a color image so that searching for a color image can be efficiently performed.
  • the present invention also includes a color image searching method for searching an image corresponding to a query image in a database indexed by the color image processing method.
  • one color is expressed as one vector in a three-dimensional (hereinafter referred to as a 3-D) color space composed of three axes ranging from 0 to 255.
  • a 3-D three-dimensional
  • each pixel in an image is expressed as one of 256x256x256 values. That is, a database must have 256x256x256 storage places so as to store a color feature vector of the image in the database. Also, in a matching process, searching of 256x256x256 values may have to be performed.
  • a large capacity database is required, and it takes much time to search a desired image from the database.
  • It is another object of the present invention is to provide a medium for storing a program performing the color image processing method. It is still another object of the present invention is to provide a color image searching method for searching a desired image in the color image indexed according to the color image processing method. It is yet still another object of the present invention is to provide a medium for storing a program performing the color image searching method
  • a color image processing method comprises the step of (a) indexing a color image by assigning representative colors of an image to a color space divided into a plurality of regions
  • the color image processing method further comprises the step of (pa-1 ) obtaining the representative colors of the image and their ratio
  • the color image processing method further comprises the step of (b) storing a region identifier expressing the representative colors, their ratio, and serial numbers of an image and a region in a database as data
  • the image is one region selected from divided regions
  • the color space is preferably a 3-D color space
  • a medium for storing a program performing a color image processing method for indexing an image The media comprises the steps of (a-1 ) obtaining a feature vector F expressed as an
  • a color image searching method for searching an image in the database based on a color feature of a query image
  • the color image searching method comprises the step of (a) performing a search based on representative colors of a query image and their ratio in the database indexed by assigning the representative colors of a database image to a color space divided into a plurality of regions
  • the color space is preferably a 3-D color space
  • the step (a) comprises the steps of (a-1 ) obtaining representative colors of a given query image and their ratio, (a-2) selecting a region corresponding to the representative color obtained in the step (a-1 ) in a color space divided into a plurality of regions, (a-3) selecting a data group indexed into the region selected from a database, and (a-4) identifying matched data in which the difference in the ratio of the representative color of the query image is less than a predetermined threshold value in the selected data group
  • step (a) further comprises the steps of
  • the color image searching method further comprises the step of performing the steps in the color space with respect to neighboring peripheral regions in the case where there are no regions determined as the searched image
  • the query image is one region of the image divided into a plurality of regions and the searched image is one region of the database image divided into a plurality of regions
  • a color image searching method for searching an image in the database based on a color feature of a query image
  • the color image searching method comprises the steps of (a-1 ) obtaining representative colors of given query regions and their ratio, (a-2) selecting a lattice point corresponding to the representative color obtained in the step (a-1 ) in a 3-D color space divided into a plurality of lattices, (a-3) selecting a data group corresponding to the lattice point selected from the database in which a region identifier expressing representative colors of data images, their ratio, and serial numbers of an image and a region is stored as data, (a-4) identifying matched data in which a difference in the ratio of the representative color of the query regions is less than a predetermined threshold value in the selected data group, (a-5) obtaining the sum of the ratio of same regions from the identified data, and (a-6) determining the regions in which the difference between the sum of the obtained percentages and
  • FIG 1 is a flowchart illustrating a color image processing method according to a preferred embodiment of the present invention
  • FIG 2 illustrates one feature vector extracted from one region of an image
  • FIG 3 illustrates a 3-D color space having a lattice structure
  • FIG 4 illustrates a database having the form of a separate table used for the color image processing method of FIG 1
  • FIG 5 is a flowchart illustrating a color image searching method according to the preferred embodiment of the present invention
  • FIG 1 which illustrates a flowchart of a color image processing method according to a preferred embodiment of the present invention
  • representative colors and their distribution are identified in the regions of an image (step 102)
  • a percentage can be used for the distribution, and the percentage can be understood as a value in which the number of corresponding pixels is divided by the number of the entire pixels by corresponding representative colors and multiplied by 100
  • the identified representative colors and their percentages can be expressed as a feature vector That is, when N is the number of representative colors in the regions and / is an integer between 1 and N, the feature vector F expressed as an /-th representative color c, and as its percentage p, is obtained by the following equation (step 104) Referring to FIG 2, which illustrates one feature vector extracted from one region of an image, the feature vector F of a first region R 1 in an arbitrary image is expressed as a first representative color c 1 and its percentage p 1t a second representative color c 2 and its percentage p 2 , and a third representative color c 3 and its percentage p 3 Likewise, the feature vector of other regions R 2 , R 3 , and R 4 can also be expressed
  • the image is indexed by assigning the representative colors to lattice points of a 3-D color space having a lattice structure, and indexed results are stored in a database having the form of a separate table (step 106)
  • the indexed results include a region identifier expressing the representative colors, their ratio, and serial numbers of an image and a region
  • the 3-D color space composed of coordinate axes L, U, and V has a lattice structure
  • Each lattice has lattice points n 1t n 2 , n 3 , n 4 , n 5 , and n 6 in its center, and colors belonging to the range of this lattice are indexed into these lattice points
  • the first representative color c is included in the lattice having a first lattice point n_
  • the second representative color c 2 is included in the lattice having a (k-1 ) th lattice point n k ⁇
  • the third representative color c 3 is included in the lattice having a third lattice point n 3
  • Each representative color and its percentages are stored in the database having the form newly-defined in a color image processing method according to the present invention
  • the database is classified into the storage places in which data corresponding to the lattice points n 1t n 2 , n 3 , ,n k 1t and n k are stored
  • This database is formed of a separate table, because the data expressing representative colors of each region and their percentages are separated and stored
  • FIG 4 illustrates a database having the form of a separate table used for the color image processing method of FIG 1
  • the representative colors and their percentages are stored with a region identifier expressing each serial number of an image and a region in the places corresponding to lattice points to which the representative colors belong
  • the data expressing the first representative color c ⁇ and its percentage p 1 are stored in the places corresponding to the first lattice point n ⁇ together with the region identifier ⁇ D ⁇
  • the data expressing the second representative color c 2 and its percentage p 2 are stored in the places corresponding to the (k-1) th lattice point n k 1
  • the third representative color c 3 and its percentage p 3 are stored in the places corresponding to the third lattice point n 3
  • region identifiers ID * , ID 2 , and ID 3 only express the same region of same image
  • the first lattice point n * corresponds to data ID ⁇
  • an image is indexed by assigning the representative colors of the image to a color space divided into a plurality of regions Accordingly, the database size for storing an index information of an image is relatively small
  • the color image indexed by the above color image processing method can efficiently search similar images to a query image, an image which a user wishes to search by the color image searching method according to the present invention
  • FIG 5 which illustrates a flowchart of a color image searching method according to the preferred embodiment of the present invention
  • step 502 is same as the step 102 in the color image processing method shown in FIG 2
  • the percentages can be understood as values in which the number of corresponding pixels is divided by the number of the entire pixels by corresponding representative colors and multiplied by 100.
  • a lattice point corresponding to each representative color identified is selected (step 504).
  • a number of the representative colors are included in one region having the form of a lattice, and a 3-D color space in which lattice points for distinguishing the region exist in the center of the region is assumed. That is, the identified representative colors have the regions to which the colors belong in the 3-D color space. Accordingly, the lattice points, center points of the regions, can be selected.
  • a data group corresponding to the selected lattice point from the database is selected (step 506), and matched data in which the difference in the percentages of the representative colors of the query regions is less than a predetermined threshold value in the selected date group are identified (step 508).
  • the predetermined threshold value is 5%
  • data which correspond to the same lattice point as one representative color selected from the query regions and ⁇ 5% of 30% are determined as the matched data.
  • the sum of the percentages of same regions among the matched data is obtained (step 510).
  • the data expressed as same regions by the region identifier among data determined as the matched data are sorted and the sum of the percentages with respect to the sorted data is obtained.
  • the regions in which the difference between the sum of the percentages obtained in the step 510 and the sum of the percentages of the query regions is less than a predetermined threshold value are determined as searched regions (step 512).
  • searched regions it is possible to determine a small number of regions in which there is the least difference aligning according to the difference in the percentages as the searched regions or to determine only one region in which there is a minimum difference in the percentages as the searched region
  • the regions having similar colors to the representative colors belong to another lattice, and then, the regions may be not searched Accordingly, in the case where there are no regions determined as the searched regions, it is more preferable to perform steps 506 through 512 with respect to peripheral lattice points of the lattice point used for performing a search before (step 514)
  • color image processing method and color image searching method can be used for a computer program
  • Codes and code segments constituting the program can be easily inferred by a skilled computer programmer in the art
  • the program is stored in computer readable media, read and executed by a computer, and it can thereby realize the color image processing method
  • the media include magnetic media, optical media, and carrier waves
  • the color image processing method may be applied to object-based image processing, and a fast search and retrieval of multimedia contents can be made
  • the search speed can be fast , and the search can be efficiently made by not classifying images unnecessarily in detail Further, the above color image searching method may be applied to object-based image processing, and a fast and efficient search and retrieval of multimedia contents can be made

Abstract

A color image processing method is provided. The color image processing method includes the step of: (a) indexing a color image by assigning representative colors of an image to a color space divided into a plurality of regions. The color image processing method may be applied to object-based image processing such as MPEG-7, and a fast search and retrieval of multimedia contents can be made.

Description

COLOR IMAGE PROCESSING METHOD
Technical Field
The present invention relates to a color image processing method, and more particularly, to a method for indexing a color image so that searching for a color image can be efficiently performed.
The present invention also includes a color image searching method for searching an image corresponding to a query image in a database indexed by the color image processing method.
Background Art
According to conventional color image processing methods, one color is expressed as one vector in a three-dimensional (hereinafter referred to as a 3-D) color space composed of three axes ranging from 0 to 255. Thus, each pixel in an image is expressed as one of 256x256x256 values. That is, a database must have 256x256x256 storage places so as to store a color feature vector of the image in the database. Also, in a matching process, searching of 256x256x256 values may have to be performed. Thus, according to the conventional color image processing methods, a large capacity database is required, and it takes much time to search a desired image from the database.
Disclosure of the Invention
To solve the above problems, it is an object of the present invention to provide a color image processing method capable of indexing a color image and fast search and retrieval of a desired image by using a small capacity database.
It is another object of the present invention is to provide a medium for storing a program performing the color image processing method. It is still another object of the present invention is to provide a color image searching method for searching a desired image in the color image indexed according to the color image processing method. It is yet still another object of the present invention is to provide a medium for storing a program performing the color image searching method
Accordingly, to achieve the above object, according to one aspect of the present invention, there is provided a color image processing method The color image processing method comprises the step of (a) indexing a color image by assigning representative colors of an image to a color space divided into a plurality of regions
It is preferable that the color image processing method further comprises the step of (pa-1 ) obtaining the representative colors of the image and their ratio
It is also preferable that the ratio is a percentage Preferably, the color image processing method further comprises the step of (b) storing a region identifier expressing the representative colors, their ratio, and serial numbers of an image and a region in a database as data
Preferably, the image is one region selected from divided regions Also, the color space is preferably a 3-D color space In order to achieve the above objects according to another aspect of the present invention, there is provided a color image processing method The color image processing method comprises the steps of (a-1 ) obtaining a feature vector F expressed as an /-th representative color c, and as its ratio p, when N is the number of representative colors in the divided regions of an image, and / is an integer between 1 and N F= {
Figure imgf000004_0001
1 , , Λ/}, (a-2) indexing the image by assigning the representative colors to lattice points of a color space having a lattice structure, and (a-3) storing indexed results in a database having the form of a separate table
In order to achieve another object, there is provided a medium for storing a program performing a color image processing method for indexing an image The media comprises the steps of (a-1 ) obtaining a feature vector F expressed as an
/-th representative color c, and as its percentage p, when N is the number of representative colors in the divided regions of an image, and / is an integer between 1 and N F= {
Figure imgf000005_0001
1 , Λ/}, (a-2) indexing the image by assigning the representative colors to lattice points of a 3-D color space divided into a plurality of regions, and (a-3) storing indexed results in a database having the form of a separate table
In order to achieve still another object, according to one aspect of the present invention, there is provided a color image searching method for searching an image in the database based on a color feature of a query image The color image searching method comprises the step of (a) performing a search based on representative colors of a query image and their ratio in the database indexed by assigning the representative colors of a database image to a color space divided into a plurality of regions
The color space is preferably a 3-D color space
It is preferable that the step (a) comprises the steps of (a-1 ) obtaining representative colors of a given query image and their ratio, (a-2) selecting a region corresponding to the representative color obtained in the step (a-1 ) in a color space divided into a plurality of regions, (a-3) selecting a data group indexed into the region selected from a database, and (a-4) identifying matched data in which the difference in the ratio of the representative color of the query image is less than a predetermined threshold value in the selected data group
It is also preferable that the step (a) further comprises the steps of
(a-5) obtaining the sum of the ratio of same regions from the identified data, and (a-6) determining the region in which the difference between the sum of the obtained ratio and the sum of the ratio to the query image is less than a predetermined threshold value as a searched image
Preferably, the color image searching method further comprises the step of performing the steps in the color space with respect to neighboring peripheral regions in the case where there are no regions determined as the searched image
Preferably, the query image is one region of the image divided into a plurality of regions and the searched image is one region of the database image divided into a plurality of regions
In order to achieve still another object, according to another aspect of the present invention, there is provided a color image searching method for searching an image in the database based on a color feature of a query image The color image searching method comprises the steps of (a-1 ) obtaining representative colors of given query regions and their ratio, (a-2) selecting a lattice point corresponding to the representative color obtained in the step (a-1 ) in a 3-D color space divided into a plurality of lattices, (a-3) selecting a data group corresponding to the lattice point selected from the database in which a region identifier expressing representative colors of data images, their ratio, and serial numbers of an image and a region is stored as data, (a-4) identifying matched data in which a difference in the ratio of the representative color of the query regions is less than a predetermined threshold value in the selected data group, (a-5) obtaining the sum of the ratio of same regions from the identified data, and (a-6) determining the regions in which the difference between the sum of the obtained percentages and the sum of the ratio of the query regions is less than a predetermined threshold value as a searched image In order to achieve yet still another object, there is provided a medium for storing a program performing a color image searching method The medium comprises the steps of (a-1 ) obtaining representative colors of given query regions and their ratio, (a-2) selecting a lattice point corresponding to the representative color obtained in the step (a-1 ) in a 3-D color space divided into a plurality of lattices, (a-3) selecting a data group corresponding to the lattice point selected from the database in which a region identifier expressing representative colors of data images, their ratio, and serial numbers of an image and a region is stored as data, (a-4) identifying matched data in which the difference in the ratio of the representative color of the query regions is less than a predetermined threshold value in the selected data group, (a-5) obtaining the sum of the ratio of same regions from the identified data, and (a-6) determining the regions in which the difference between the sum of the obtained percentages and the sum of the ratio of the query regions is less than a predetermined threshold value as a searched image
Brief Description of the Drawings
The above objects and advantages of the present invention will become more apparent by describing in detail a preferred embodiment thereof with reference to the attached drawings in which
FIG 1 is a flowchart illustrating a color image processing method according to a preferred embodiment of the present invention,
FIG 2 illustrates one feature vector extracted from one region of an image,
FIG 3 illustrates a 3-D color space having a lattice structure, FIG 4 illustrates a database having the form of a separate table used for the color image processing method of FIG 1 , and
FIG 5 is a flowchart illustrating a color image searching method according to the preferred embodiment of the present invention
Best mode for carrying out the Invention Referring to FIG 1 , which illustrates a flowchart of a color image processing method according to a preferred embodiment of the present invention, first, representative colors and their distribution are identified in the regions of an image (step 102) Here, a percentage can be used for the distribution, and the percentage can be understood as a value in which the number of corresponding pixels is divided by the number of the entire pixels by corresponding representative colors and multiplied by 100
The identified representative colors and their percentages can be expressed as a feature vector That is, when N is the number of representative colors in the regions and / is an integer between 1 and N, the feature vector F expressed as an /-th representative color c, and as its percentage p, is obtained by the following equation (step 104)
Figure imgf000007_0001
Referring to FIG 2, which illustrates one feature vector extracted from one region of an image, the feature vector F of a first region R1 in an arbitrary image is expressed as a first representative color c1 and its percentage p1t a second representative color c2 and its percentage p2, and a third representative color c3 and its percentage p3 Likewise, the feature vector of other regions R2, R3, and R4 can also be expressed
Subsequently, the image is indexed by assigning the representative colors to lattice points of a 3-D color space having a lattice structure, and indexed results are stored in a database having the form of a separate table (step 106) The indexed results include a region identifier expressing the representative colors, their ratio, and serial numbers of an image and a region
Referring to FIG 3, which illustrates a 3-D color space having a lattice structure, the 3-D color space composed of coordinate axes L, U, and V has a lattice structure Each lattice has lattice points n1t n2, n3, n4, n5, and n6 in its center, and colors belonging to the range of this lattice are indexed into these lattice points
Now, an assumption is made that the first representative color c, is included in the lattice having a first lattice point n_, and the second representative color c2 is included in the lattice having a (k-1 )th lattice point nk ή, and the third representative color c3 is included in the lattice having a third lattice point n3
Each representative color and its percentages are stored in the database having the form newly-defined in a color image processing method according to the present invention The database is classified into the storage places in which data corresponding to the lattice points n1t n2, n3, ,nk 1t and nk are stored This database is formed of a separate table, because the data expressing representative colors of each region and their percentages are separated and stored
FIG 4 illustrates a database having the form of a separate table used for the color image processing method of FIG 1 Now the representative colors and their percentages are stored with a region identifier expressing each serial number of an image and a region in the places corresponding to lattice points to which the representative colors belong Then, the data expressing the first representative color c< and its percentage p1 are stored in the places corresponding to the first lattice point nή together with the region identifier \D< Also, the data expressing the second representative color c2 and its percentage p2 are stored in the places corresponding to the (k-1)th lattice point nk 1 Furthermore, the third representative color c3 and its percentage p3 are stored in the places corresponding to the third lattice point n3 Here, region identifiers ID*, ID2, and ID3 only express the same region of same image In other words, referring to the database shown in FIG 4 the first lattice point n* corresponds to data ID<, c1r and pt, the third lattice point n3 corresponds to daia ID3, c3, and p3 and the (k-1)th lattice point nk 1 corresponds to data ID2, c2, and p2
According to the above color image processing method, an image is indexed by assigning the representative colors of the image to a color space divided into a plurality of regions Accordingly, the database size for storing an index information of an image is relatively small
The color image indexed by the above color image processing method can efficiently search similar images to a query image, an image which a user wishes to search by the color image searching method according to the present invention Referring to FIG 5, which illustrates a flowchart of a color image searching method according to the preferred embodiment of the present invention, first, query regions, an original image which a user wishes to search in a database are determined
Subsequently, representative colors of the determined query regions and their percentages are identified (step 502) The step 502 is same as the step 102 in the color image processing method shown in FIG 2 Here, the percentages can be understood as values in which the number of corresponding pixels is divided by the number of the entire pixels by corresponding representative colors and multiplied by 100.
After that, a lattice point corresponding to each representative color identified is selected (step 504). As shown in FIG. 3, a number of the representative colors are included in one region having the form of a lattice, and a 3-D color space in which lattice points for distinguishing the region exist in the center of the region is assumed. That is, the identified representative colors have the regions to which the colors belong in the 3-D color space. Accordingly, the lattice points, center points of the regions, can be selected.
Also, in order to eliminate false matches, it is more preferable to consider the representative colors and their distribution, that is, their percentages together. Accordingly, a data group corresponding to the selected lattice point from the database is selected (step 506), and matched data in which the difference in the percentages of the representative colors of the query regions is less than a predetermined threshold value in the selected date group are identified (step 508). For example, assuming that 30% or so of one representative color of the representative colors in the query regions is included in the query regions, and the predetermined threshold value is 5%, data which correspond to the same lattice point as one representative color selected from the query regions and ± 5% of 30%, the percentage of one representative color selected from the query regions, that is, 25% to 35% data are determined as the matched data.
After that, the sum of the percentages of same regions among the matched data is obtained (step 510). In other words, the data expressed as same regions by the region identifier among data determined as the matched data are sorted and the sum of the percentages with respect to the sorted data is obtained.
Subsequently, the regions in which the difference between the sum of the percentages obtained in the step 510 and the sum of the percentages of the query regions is less than a predetermined threshold value are determined as searched regions (step 512). As an alternative to this, it is possible to determine a small number of regions in which there is the least difference aligning according to the difference in the percentages as the searched regions or to determine only one region in which there is a minimum difference in the percentages as the searched region However, according to this method, for example, in the case where the representative colors of the query regions are located at an outer area in the lattice, there is a possibility that the regions having similar colors to the representative colors belong to another lattice, and then, the regions may be not searched Accordingly, in the case where there are no regions determined as the searched regions, it is more preferable to perform steps 506 through 512 with respect to peripheral lattice points of the lattice point used for performing a search before (step 514)
According to the above-described color image processing method and color image searching method can be used for a computer program Codes and code segments constituting the program can be easily inferred by a skilled computer programmer in the art Also, the program is stored in computer readable media, read and executed by a computer, and it can thereby realize the color image processing method The media include magnetic media, optical media, and carrier waves As described above, according to the present invention, the color image processing method may be applied to object-based image processing, and a fast search and retrieval of multimedia contents can be made
Industrial Applicability
According to the above-described color image searching method, due to the small size of a database the search speed can be fast , and the search can be efficiently made by not classifying images unnecessarily in detail Further, the above color image searching method may be applied to object-based image processing, and a fast and efficient search and retrieval of multimedia contents can be made

Claims

What is claimed is
1 A color image processing method for indexing an image comprising the step of (a) indexing a color image by assigning representative colors of an image to a color space divided into a plurality of regions
2 The color image processing method according to claim 1 , further comprising the step of (pa-1) obtaining the representative colors of the image and their ratio
3 The color image processing method according to claim 2, wherein the ratio is a percentage
4 The color image processing method according to at least one of claim 2 or claim 3, further comprising the step of (b) storing a region identifier expressing the representative colors, their ratio, and serial numbers of an image and a region in a database as data
5 The color image processing method according to one of claims 1 through 3, wherein the image is one region selected from divided regions
6 The color image processing method according to claim 4, wherein the image is one region selected from divided regions
7 The color image processing method according to at least one of claims 1 through 3 or claim 6, wherein the color space is a three- dimensional color space
8 The color image processing method according to claim 4, wherein the color space is a three-dimensional color space
9 The color image processing method according to claim 5 wherein the color space is a three-dimensional color space
10 A color image processing method for indexing an image, comprising the steps of
(a-1 ) obtaining a feature vector F expressed as an /-th representative color c, and as its ratio p, when N is the number of representative colors in the divided regions of an image, and / is an integer between 1 and N
Figure imgf000013_0001
(a-2) indexing the image by assigning the representative colors to lattice points of a color space having a lattice structure, and
(a-3) storing indexed results in a database having the form of a separate table
11 The color image processing method according to claim 10, wherein the ratio is a percentage
12 The color image processing method according to at least one of claim 10 or claim 11 , wherein the indexed results include a region identifier expressing the representative colors, their ratio, and serial numbers of an image and a region
13 The color image processing method according to at least one of claim 10 or claim 11 , wherein the image is one region selected from divided regions
14 The color image processing method according to claim 12, wherein the image is one region selected from divided regions
15 The color image processing method according to at least one of claim 10, claim 11 , or claim 14, wherein the color space is a three- dimensional color space
16 The color image processing method according to claim 12, wherein the color space is a three-dimensional color space
17 The color image processing method according to claim 13, wherein the color space is a three-dimensional color space
18 A medium for storing a program performing a color image processing method for indexing an image, comprising the steps of
(a-1 ) obtaining a feature vector F expressed as an /-th representative color c, and as its percentage p, when N is the number of representative colors in the divided regions of an image, and / is an integer between 1 and N
F= { {c„p},ι= , , Λ/},
(a-2) indexing the image by assigning the representative colors to lattice points of a 3-D color space divided into a plurality of regions, and (a-3) storing indexed results in a database having the form of a separate table
19 The medium according to claim 18, wherein the indexed results include a region identifier expressing the representative colors, their ratio, and serial numbers of an image and a region
20 A color image searching method for searching an image in the database based on a color feature of a query image, comprising the step of (a) performing a search based on representative colors of a query image and their ratio in the database indexed by assigning the representative colors of a database image to a color space divided into a plurality of regions
21 The color image searching method according to claim 20, wherein the color space is a three-dimensional color space
22 The color image searching method according to claim 20 wherein the step (a) comprises the steps of
(a-1 ) obtaining representative colors of a given query image and their ratio, (a-2) selecting a region corresponding to the representative color obtained in the step (a-1 ) in a color space divided into a plurality of regions,
(a-3) selecting a data group indexed into the selected region from a database, and
(a-4) identifying matched data in which the difference in the ratio of the representative color f the query image is less than a predetermined threshold value in the selected data group
23 The color image searching method according to claim 22, wherein the step (a) further comprises the steps of (a-5) obtaining the sum of the ratio of same regions from the identified data, and
(a-6) determining the region in which the difference between the sum of the obtained ratio and the sum of the ratio to the query image is less than a predetermined threshold value as a searched image
24 The color image searching method according to claim 21 , wherein the step (a) comprises the steps of
(a-1 ) obtaining representative colors of a given query image and their ratio, (a-2) selecting a region corresponding to the representative color obtained in the step (a-1 ) in a color space divided into a plurality of regions,
(a-3) selecting a data group indexed into the selected region from a database, and
(a-4) identifying matched data in which the difference in the ratio of the representative color of the query image is less than a predetermined threshold value in the selected data group
25 The color image searching method according to claim 24, wherein the step (a) further comprises the steps of
(a-5) obtaining the sum of the ratio of same regions from the identified data, and (a-6) determining the region in which the difference between the sum of the obtained ratio and the sum of the ratio of the query image is less than a predetermined threshold value as a searched image
26 The color image searching method according to at least one of claim 22 or claim 23, further comprising the step of performing the steps in a color space with respect to neighboring peripheral regions in the case where there are no regions determined as the searched image
27 The color image searching method according to one of claims 20 through 25, wherein the ratio is a percentage
28 The color image searching method according to claim 26, wherein the ratio is a percentage
29 The color image searching method according to at least one of claims 20 through 25 or claim 28, wherein the query image is one region of the image divided into a plurality of regions, and the searched image is one region of the database image divided into a plurality of regions
30 The color image searching method according to claim 26, wherein the query image is one region of the image divided into a plurality of regions, and the searched image is one region of the database image divided into a plurality of regions
31 The color image searching method according to claim 27, wherein the query image is one region of the image divided into a plurality of regions, and the searched image is one region of the database image divided into a plurality of regions
32 A color image searching method for searching an image in the database based on a color feature of a query image, comprising the steps of
(a-1 ) obtaining representative colors of given query regions and their ratio,
(a-2) selecting a lattice point corresponding to the representative color obtained in the step (a-1 ) in a three-dimensional color space divided into a plurality of lattices,
(a-3) selecting a data group corresponding to the selected lattice point from the database in which a region identifier expressing representative colors of data images, their ratio, and serial numbers of an image and a region is stored as data, and (a-4) identifying matched data in which the difference in the ratio of the representative color of the query regions is less than a predetermined threshold value in the selected data group
33 The color image searching method according to claim 32, further comprising the steps of
(a-5) obtaining the sum of the ratio of same regions from the identified data, and
(a-6) determining the region in which the difference between the sum of the obtained percentage and the sum of the ratio of the query regions is less than a predetermined threshold value as a searched image
34 The color image searching method according to claim 33, further comprising the step of performing the steps in a color space with respect to neighboring peripheral lattice points in the case where there are no regions determined as the searched image
35 A medium for storing a program performing a color image searching method, comprising the steps of:
(a-1 ) obtaining representative colors of given query regions and their ratio;
(a-2) selecting a lattice point corresponding to the representative 5 color obtained in the step (a-1) in a three-dimensional color space divided into a plurality of lattices;
(a-3) selecting a data group corresponding to the selected lattice point from the database in which a region identifier expressing representative colors of data images, their ratio, and serial numbers of an o image and a region is stored as data; and
(a-4) identifying matched data in which the difference in the ratio of the representative color of the query regions is less than a predetermined threshold value in the selected data group.
5 36. The medium according to claim 34, wherein the color image searching method further comprises the steps of:
(a-5) obtaining the sum of the ratio of same regions from the identified data; and
(a-6) determining the region in which the difference between the sum o of the obtained percentage and the sum of the ratio of the query regions is less than a predetermined threshold value as a searched image.
37. The media according to claim 36, wherein the color image searching method further comprises the step of performing the steps in a 5 color space with respect to neighboring peripheral lattice points in the case where there are no regions determined as the searched image.
PCT/KR2000/000249 1999-05-17 2000-03-22 Color image processing method WO2000070881A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
AU36808/00A AU3680800A (en) 1999-05-17 2000-03-22 Color image processing method
EP00915566A EP1195062A4 (en) 1999-05-17 2000-03-22 Color image processing method
JP2000619208A JP2003500712A (en) 1999-05-17 2000-03-22 Color image processing method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13455099P 1999-05-17 1999-05-17
US60/134,550 1999-05-17

Publications (1)

Publication Number Publication Date
WO2000070881A1 true WO2000070881A1 (en) 2000-11-23

Family

ID=22463864

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2000/000249 WO2000070881A1 (en) 1999-05-17 2000-03-22 Color image processing method

Country Status (8)

Country Link
EP (1) EP1195062A4 (en)
JP (1) JP2003500712A (en)
KR (2) KR20040028945A (en)
CN (1) CN1193623C (en)
AU (1) AU3680800A (en)
MY (1) MY128059A (en)
TW (1) TW548601B (en)
WO (1) WO2000070881A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002288658A (en) * 2001-01-20 2002-10-04 Samsung Electronics Co Ltd Object extracting device and method on the basis of matching of regional feature value of segmented image regions
WO2005024662A2 (en) * 2003-09-08 2005-03-17 Koninklijke Philips Electronics N.V. Method and apparatus for indexing and searching graphic elements
US7006687B2 (en) 2001-01-18 2006-02-28 Lg Electronics Inc. Method for setting dominant color using spatial coherency
US7062083B2 (en) 2001-01-09 2006-06-13 Samsung Electronics Co., Ltd. Image retrieval method based on combination of color and texture features
US9788725B2 (en) 2012-07-11 2017-10-17 Toshiba Medical Systems Corporation Medical image display apparatus and method

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100761417B1 (en) * 2006-03-16 2007-09-27 주식회사 씬멀티미디어 Indexing and searching method for multimedia database using dominant color descriptor modified to vector expression
CN101576932B (en) * 2009-06-16 2012-07-04 阿里巴巴集团控股有限公司 Close-repetitive picture computer searching method and device
US20150055858A1 (en) * 2013-08-21 2015-02-26 GM Global Technology Operations LLC Systems and methods for color recognition in computer vision systems
CN110569854B (en) * 2019-09-12 2022-03-29 上海商汤智能科技有限公司 Image processing method and device, electronic equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5325297A (en) * 1992-06-25 1994-06-28 System Of Multiple-Colored Images For Internationally Listed Estates, Inc. Computer implemented method and system for storing and retrieving textual data and compressed image data
JPH09298747A (en) * 1996-04-30 1997-11-18 D & I Syst Kk Multi-gradation image data compression and decoding method

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6232569A (en) * 1985-08-06 1987-02-12 Mitsubishi Electric Corp Color picture device
JPH05264372A (en) * 1992-03-19 1993-10-12 Riken Corp Pressure detection circuit
JPH0816789A (en) * 1994-07-05 1996-01-19 Kajima Corp Judging method for landscape by means of color
JPH08272345A (en) * 1995-04-03 1996-10-18 Fuji Xerox Co Ltd Image processor
JP3284168B2 (en) * 1995-11-14 2002-05-20 正夫 坂内 Image retrieval device
JP2001525959A (en) * 1997-05-16 2001-12-11 ザ トラスティーズ オブ コロンビア ユニヴァーシティ イン ザ シティ オブ ニューヨーク Image search method and system
JP3747589B2 (en) * 1997-09-17 2006-02-22 コニカミノルタビジネステクノロジーズ株式会社 Image feature amount comparison device and recording medium storing image feature amount comparison program

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5325297A (en) * 1992-06-25 1994-06-28 System Of Multiple-Colored Images For Internationally Listed Estates, Inc. Computer implemented method and system for storing and retrieving textual data and compressed image data
JPH09298747A (en) * 1996-04-30 1997-11-18 D & I Syst Kk Multi-gradation image data compression and decoding method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1195062A4 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7062083B2 (en) 2001-01-09 2006-06-13 Samsung Electronics Co., Ltd. Image retrieval method based on combination of color and texture features
US7006687B2 (en) 2001-01-18 2006-02-28 Lg Electronics Inc. Method for setting dominant color using spatial coherency
US7079683B2 (en) 2001-01-18 2006-07-18 Lg Electronics Inc. Method for setting dominant color using spatial coherency
US7321684B2 (en) 2001-01-18 2008-01-22 Lg Electronics Inc. Method for setting dominant color using spatial coherency
JP2002288658A (en) * 2001-01-20 2002-10-04 Samsung Electronics Co Ltd Object extracting device and method on the basis of matching of regional feature value of segmented image regions
WO2005024662A2 (en) * 2003-09-08 2005-03-17 Koninklijke Philips Electronics N.V. Method and apparatus for indexing and searching graphic elements
WO2005024662A3 (en) * 2003-09-08 2005-05-12 Koninkl Philips Electronics Nv Method and apparatus for indexing and searching graphic elements
US9788725B2 (en) 2012-07-11 2017-10-17 Toshiba Medical Systems Corporation Medical image display apparatus and method

Also Published As

Publication number Publication date
CN1349718A (en) 2002-05-15
KR20040028945A (en) 2004-04-03
TW548601B (en) 2003-08-21
MY128059A (en) 2007-01-31
EP1195062A4 (en) 2006-11-08
AU3680800A (en) 2000-12-05
EP1195062A1 (en) 2002-04-10
JP2003500712A (en) 2003-01-07
CN1193623C (en) 2005-03-16
KR100436500B1 (en) 2004-06-22
KR20020001800A (en) 2002-01-09

Similar Documents

Publication Publication Date Title
US7212667B1 (en) Color image processing method for indexing an image using a lattice structure
CN102156751B (en) Method and device for extracting video fingerprint
CN101038593B (en) Method and apparatus for representing a group of images
US6915011B2 (en) Event clustering of images using foreground/background segmentation
JP2014096175A (en) Method and system for quasi-duplicate image searching
JP2002519748A (en) Image retrieval system
RU2345414C1 (en) Method of creation of system of indexing for search of objects on digital images
CN106777130B (en) Index generation method, data retrieval method and device
WO2000070881A1 (en) Color image processing method
US20120269429A1 (en) Apparatus and method for searching image
CN113779303A (en) Video set indexing method and device, storage medium and electronic equipment
Salmi et al. Content based image retrieval based on cell color coherence vector (Cell-CCV)
JP2004021430A (en) Image searching device, image searching method, and image searching program
CN115757896A (en) Vector retrieval method, device, equipment and readable storage medium
JP2004192555A (en) Information management method, device and program
EP1160690A1 (en) Method of indexing and similarity search in a feature vector space
CN113760907A (en) Data uniqueness identification method in database
KR20170039524A (en) Image search system and method using visual part vocabulary
JP2004234613A (en) Video description system and method and video identification system and method
CN114697322B (en) Data screening method based on cloud service processing
CN108959317B (en) Picture retrieval method based on feature extraction
CN106777131A (en) A kind of querying method of High dimensional space data, device and computer-readable medium
Lee et al. A physical storage design method for access structures of image information systems
Chang et al. An efficient signature file strategy for similarity retrieval from large iconic image databases
CN112819102A (en) Text positioning method, device, equipment and storage medium

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 00807260.4

Country of ref document: CN

AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 1020017012160

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2000915566

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2000 619208

Country of ref document: JP

Kind code of ref document: A

WWP Wipo information: published in national office

Ref document number: 1020017012160

Country of ref document: KR

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 2000915566

Country of ref document: EP

WWG Wipo information: grant in national office

Ref document number: 1020017012160

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 867/DELNP/2006

Country of ref document: IN

WWW Wipo information: withdrawn in national office

Ref document number: 2000915566

Country of ref document: EP