CA2273188A1 - Method and apparatus for encoding/decoding image data - Google Patents
Method and apparatus for encoding/decoding image data Download PDFInfo
- Publication number
- CA2273188A1 CA2273188A1 CA 2273188 CA2273188A CA2273188A1 CA 2273188 A1 CA2273188 A1 CA 2273188A1 CA 2273188 CA2273188 CA 2273188 CA 2273188 A CA2273188 A CA 2273188A CA 2273188 A1 CA2273188 A1 CA 2273188A1
- Authority
- CA
- Canada
- Prior art keywords
- code
- image
- symbol
- input
- factors
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
- G06T9/001—Model-based coding, e.g. wire frame
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
Abstract
The invention relates to a method and an apparatus for encoding images, more particularly to an encoding unit in conjunction with a library of pictorial entities and image qualifiers. The method and apparatus provide encoding an image by using a code factor table in conjunction with a set of element codes. The resulting image code allows the set pictorial elements of an image and their associated image qualifiers to be represented by a compact code uniquely representing a given configuration of pictorial elements.
The use of the resulting image code facilitates the transmission and storage of images requiring only the code to be sent or stored.
The invention further provides a computer readable medium comprising a program element that direct a computer to implement the encoding process.
The use of the resulting image code facilitates the transmission and storage of images requiring only the code to be sent or stored.
The invention further provides a computer readable medium comprising a program element that direct a computer to implement the encoding process.
Description
Title of the invention:
Method and Apparatus for Encoc~ing/Decoding Image Data Field of the Invention This invention relates to a method and apparatus for encoding/decoding image data. It is particularly applicable to the encoding/decoding of images that can be separated into their constituent parts as may be used in composite picture systems used in law enforcement, artistic creations, recreation and education.
Background It is known in the art to create images on the basis of components that are assembled to form a complete image. For example, a common technique for synthesizing single images of faces involves horizontally dividing the image of a face into bands for different features of the face such as hair, eyes, nose, mouth, and chin, respectively. Paper strips containing exemplary features are then be combined to form a composite drawing of a face. Yet another example involves a program element running on a computing platform which allows a user to select individual components and combining them on a pre-selected face. In a typical interaction, the user first selects the shape of the face then eyes, nose, mouth and other components and combines them to form a facial image. Many variations on this theme can be used as described in Kakiyama et al. U.S. Patent 5,600,767, Yoshino et al. U.S. Patent 5,644,690, Sato et al. U. S. Patent 5, 537, 662 and Belfer et al. U. S. Patent 5,649,086. For example, the Sato et al. Patent, entitled Electronic Montage composing apparatus, describes a system for creating a montage image of a face using a plurality of basic parts stored in a library.
Method and Apparatus for Encoc~ing/Decoding Image Data Field of the Invention This invention relates to a method and apparatus for encoding/decoding image data. It is particularly applicable to the encoding/decoding of images that can be separated into their constituent parts as may be used in composite picture systems used in law enforcement, artistic creations, recreation and education.
Background It is known in the art to create images on the basis of components that are assembled to form a complete image. For example, a common technique for synthesizing single images of faces involves horizontally dividing the image of a face into bands for different features of the face such as hair, eyes, nose, mouth, and chin, respectively. Paper strips containing exemplary features are then be combined to form a composite drawing of a face. Yet another example involves a program element running on a computing platform which allows a user to select individual components and combining them on a pre-selected face. In a typical interaction, the user first selects the shape of the face then eyes, nose, mouth and other components and combines them to form a facial image. Many variations on this theme can be used as described in Kakiyama et al. U.S. Patent 5,600,767, Yoshino et al. U.S. Patent 5,644,690, Sato et al. U. S. Patent 5, 537, 662 and Belfer et al. U. S. Patent 5,649,086. For example, the Sato et al. Patent, entitled Electronic Montage composing apparatus, describes a system for creating a montage image of a face using a plurality of basic parts stored in a library.
In constructing an image, pictorial entities are selected from a library of pictorial entities as assembled into images. These images may then be stored on a computer readable medium commonly referred to as a database or repository. Often, the storage of an image requires significant amounts of memory, often necessitating large repositories. For example, <~ composite picture system used in a police department often requires maintaining records of thousands of individuals. The images are typically stored in files in some graphical format such as a "bitmap", "gif" or "jpeg" are other format. Although such encoding schemes provide a compressed representation of the image, the memory required for storing the image remains significant. In addil~ion, compression methods of the type described above generally degrade the quality of the image.
The size and quality of images i~; also particularly significant when the images are transmitted from one site to another via a digital link. For example, a given police station may transmit a composite picture to another police station in order to share information about a given suspect.
Thus, there exists a need in the industry to refine the process of encoding images such as to reduce the memory requirements for storage and the bandwidth required for the transmission of the image.
Summary of the Invention The invention provides a novel method and an apparatus for encoding images.
As embodied and broadly described herein the invention provides a computer readable storage medium comprising a program element suitable for use on a computer having a memory, the program element being operative to create a first input for receiving a set of element codes, each element code being representative of part of an image, an element code including at least one symbol. The symbol is representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, said values being indicative of variations of the ceri:ain characteristic. The program element is also operative to create a second input for receiving a plurality of code factors associated to respective symbols of said set of element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire. The program element is also operative to process the set of element codes to derive an image code, the image code being a compressed digital representation of the image.
The image code is derived at least in part on the basis of the plurality of code factors. The program is also operative to output the image code.
For the purpose of the specification, the expression "basic elements" is used to describe a part of a specific image. In the preferred embodiment, a basic element is comprised of a pictorial entity conditioned by a set of image qualifiers. Examples of pictorial entities in a facial image are noses, eyes, mouths and eyebrows. In the preferred embodiment, pictorial entities are grouped into classes. For example, in composite picture system, all nose pictorial entities are grouped into the "NOSE" class and all the eye pictorial entities are grouped in the "EYE" class. Each class of pictorial entities is associated to a set of image qualifiers that are used to condition the pictorial entities in the associated class. The image qualifiers may include position qualifiers, zoom qualifiers, color qualifier and the likes.
For the purpose of this specification, the basic elements used in the special case of a facial image are referred to as "basic morphological elements".
For the purpose of this specification, the word "symbol" is used to designate a representation of an object, image, qualifier or the likes. In a specific example, a symbol may be an index mapped to a memory location stoz-ing data elements such as a pictorial entity or image qualifier.
According to a broad aspect:, the invention provides, a computer readable storage medium comprising a program element suitable for use on a computer having a memory. The program element is operative to create a first input to receive a set of element codes. The element codes characterized a portion of an image and included at least one symbol. A given symbol is a representation of a certain characteristic of the portion of the element code. A given symbol can acquire a set of possible values indicative of variations of the certain characteristic with which it is associated. The program element is also operative to create a second input to receive code factors associated to respective symbols of the set of element codes. A given code factor is assigned a value that exceeds the highest value that the symbol with which it is associated can acquire. The program element is operative to process the set of element codes to derive an image code. The image code is a compressed digital representation of the image, and is derived at least :in part on the basis of the plurality of code factors. The image code can then be released as the output.
In a preferred embodiment, the image code is a number in a given base. Preferably, a large b<~se is used in order to obtain a reduced number of characters in the image code.
In a preferred embodiment of the invention, the encoding method and apparatus is integrated into a picture system. The picture system creates images on the basis of images of basic individual parts, herein referred to as basic elements. In the preferred embodiment, the picture system includes a library of pictorial entities and qualifiers, an image builder unit, an 5 encoding unit, a decoding unit and a factor table.
Each basic element in an image is assigned a unique identifier, herein referred to as element code. The element code contains information data elements, herein referred to as symbols.
In a specific embodiment, the element code for each basic element includes a symbol that characterize=s the pictorial element. In a preferred embodiment, the element code includes a plurality if symbols. In a specific example two (2) symbols are used namely an pictorial entity symbol and a position qualifier symbol. The element code may contain additional symbols without detracting from the spirit of the invention. For example symbols representative of other image qualifiers may be used. such as color, zoom and other image effects may be used. An image is constructed by a set of basic elements. The basic elements present in a given facial image are said be "active" in the given image. The set of active elements is stored in a data structure suitable for that purpose.
In a specific example this data structure is an image data table.
The image data table stores for e,~ch class a record, each record containing a set of fields, each field describing the active pictorial entity and qualifiers.
The number variations in each of the symbols for each of the classes is stored in a table, herein referred to as a code factor table. The code factor table provides information about the number of possible variations in an image. For each class, the code factor table stores a record, each record containing a set of fields, each field describing a ma~:imum factor. The maximum factor in the code factor table is the largest identifier used for the given factor. Each symbol in the image data table is mapped to a factor in the code factor table.
According to another broad aspect, the invention provides an apparatus for encoding an image, the image comprising a set of basic elements, each basic element. of the set of basic elements being associated to an element code. An encoding unit receiving as input the code factors and the element codes. The encoding unit processes the set of element codes to derive an image code, the image code being a compressed digii:al representation of the image derived at least in part on the basis of said plurality of code factors. The encoding unit then outputs the image code.
According to another broad aspect, the invention provides a method for encoding an image, the _Lmage comprising a set of basic elements, each basic element of the set of basic elements being associated to an element code. A processing step receives as input the code factors and the element codes to derive an image code.
The image code is a compressed dig~_tal representation of the image derived at least in part on the b<~sis of said plurality of code factors. The image code is the released.
In a preferred embodiment, the image code can be used to reproduce the image described by the image code. Image data may be obtained by combining the code factors and the image code with a decoding device. The image data is obtained by applying the inverse operations in the reverse order than those applied in the encoding process to the image code.
The image code allows each image to be described with a very small number of characters permitting the rapid transmission of the image over a data transmission medium. The receiving device has a decoding unit that is capable of extracting data information from the image code.
According to another broad aspect, the invention provides a method, apparatus and computer readable medium for decoding an image, the image comprising a set of basic elements, each basic element of the set of basic elements being associated to an element code. A processing step receives as input the code factors and the image code to derive the element codes. The element codes are then released.
As embodied and broadly described herein the invention further provides an apparatus for encoding an image, the image comprising a set of basic elements, each bas_Lc element of the set of basic elements being associated to an element code. The apparatus comprises a first input for receiving a set of element codes, each element code being representative of part of an image, an element code including at least one symbol, the symbol being representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, the values being indicative of variations of the certain characteristic. The apparatus also comprises a second input for receiving a plurality of code factors associated to respective symbols of said set of: element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire. The apparatus further comprises an encoding unit in operative relationship with said first input and said second input for processing said set of element codes to derive an image code, the image code being a compressed digital representation of the image. The image code is derived at least in part on the basis of said plurality of code factors. The apparatus also comprises an output for outputting the image code.
As embodied and broadly described herein the invention provides a method for encoding an image, said method comprising:
- receiving a set of element codes, each element code being g representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, said values being indicative of variations of the certain characteristic;
- receiving a plurality of code factors associated to respective symbols of said set of element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire;
- processing said set of element codes to derive an image code, said image code being a compressed digital representation of the image, said image code being derived at least in part on the basis of said plurality of code factors;
outputting said image code.
As embodied and broadly described herein the invention provides a computer data signal embodied in a carrier wave comprising an image code, said image code being derived by the above described method.
As embodied and broadly described herein the invention provides a computer readable storage medium comprising a program element suitable for use on a computer having a memory, said program element being operative to:
a) create a first input: for receiving an image code;
b) create a second input for receiving a plurality of code factors associated to respective symbols of a set of element codes, a given code factor being assigned a value treat exceeds the highest value that a symbol with which it is associated can acquire;
c) process said image code to derive set of element codes, each element: code of said set of element codes being representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code;
d) outputting said set of element codes.
Brief description of the drawings These and other features of the present invention will become apparent from the following detailed description considered in connection with the accompanying drawings. It is to be understood, however, that the drawings are designed for purposes of illustration only and not as a definition of the limits of the invention for which reference should be made to the appending claims.
Fig. 1 shows an apparatus including an embodiment of the invention;
Fig. 2 shows a high-level block diagram of functional units of the image system including an image encoder in accordance with the spirit of the invention;
Fig. 3 shows a high-level block diagram of functional units of the image system including an image decoder in accordance with the spirit of the invention;
Fig. 4 shows a detailed block diagram of the encoding process in accordance with the spirit of the invention;
Fig. 5 shows a detailed block diagram of the decoding process in accordance with the spirit of the invention;
Fig. 6a and 6b show flow diagrams for the creation of an image and the facial code in accordance with an embodiment of the invention;
1~
Fig. 7 shows an alternative apparatus including an embodiment of the invention;
Fig. 8 shows apparatuses including an embodiment of the invention connected by a data transmission medium.
Detailed Description In the preferred embodiment, the encoding method and apparatus in accordance with the invention is integrated into a picture system for creating images on the basis of images of individual parts, herein referred to as basic elements. For the sake of simplicity, the specification will describe an embodiment of the invention integrated into a composite picture system. It is to be understood that the encoding method and apparatus may be used in systems for creating images on the basis of individual constituent parts other than a composite picture system without detracting from the spirit of the invention.
In a preferred embodiment, as shown in figure 1, the composite picture system includes a general-purpose digital computer including a processor 100 linked to a machine-readable storage element 108 that may be in the form of a mass storage device such as a hard-drive, a CD-ROM or any other suitable storage medium. The system further includes a device for visualizing the facial image such as a computer monitor 110 or a printing device. The preferred embodiment also provides data input on which a user interface 112 is supported in order to allow the user to select through a touch screen, keyboard, pointing devicE: or other input means, the individual basic morphological elernents and to view the combined result on the display screen 110. 'rhe latter 110 is likely to be part of the data input. Optionally, the system further provides a data transmission medium 114 such as a telephone line, LAN, digital cable, optical cable, wireless transmission device or any other suitable means for transmitting an image from the general purpose digital computer to a receiving device. The computer readable medium 108 storing the composite picture system includes of a set of modules namely a library of pictorial entities and image qualifiers 104 and program instructions 102 interacting with the library of pictorial entities and image qualifiers to create a facial image. The computer readable medium 108 may also include symbols where each symbol is associated to a respective one of the pictorial entities and image qualifiers in the library of pictorial entities and image qualifiers 104. The computer readable medium further comprising a set of code factors, each code factor being associated to a set of symbols, a given code factor being larger that the largest symbol in the set with which it is associated. The computer readable medium further comprises an encoding program element 116 to encode a facial image.
In the preferred embodiment the composite picture system comprises an electronic library oj= pictorial entities and image qualifiers 104. Each pictorial entity in the library is an image of a facial part or an accessory such as glasses, earrings or other. The pictorial entities in the library 104 are organized into morphological classes, each class describing a part of the face. In a preferred embodiment, the following basic morphological classes are used: hairstyle, forehead, eyebrows, eyes, nose, mouth, chin, moustache, beard, wrinkles and glasses. The pictorial entities are stored on a computer readable medium. The images may be compressed in a format suitable for graphical storage such as a bitmap (BMP), GIF of JPEG file format. Other file formats may be used here without detracting from the spirit of the invention.
In the preferred embodiment., each pictorial entity is identified with a pictorial entity :symbol. Typically, the pictorial entity symbol is a sequence of alphanumeric characters. The pictorial entity symbols are stored on a computer readable medium in the database of symbols. Each image qualifier in the library is a characteristic of a corresponding class. The image qualifiers in the library 104 may be organized into qualifier types, each qualifier type describing a certain characteristic of the pictorial entity. In a preferred embodiment, the following qualifier types are used: position and color. Other image qualifiers such as zoom and the likes may be used without detracting from the spirit of the invention. The image qualifiers are stored on a computer readable medium. In the preferred embodiment, each image qualifier is identified with an image qualifier symbol. Typically, the image qualifier symbol is a sequence of: alphanumeric characters. The image qualifier symbols are stored on a computer readable medium in the database of symbols.
In a preferred embodiment, a basic morphological element includes a pictorial entity and a set of image qualifiers. The image qualifiers condition the pictorial entity to alter the visual effect of the latter. For example the image qualifier may modify the position, color zoom or any other visual effect of the pictorial entity. The purpose of the specification, the expression "basic morphological element" is used to refer to the pictorial entity conditioned by the image qualifiers. Each basic morphological element is associated to an element code. The element code contains a set of symbols. In a specific example, the element code for each basic morphological element includes two (2) symbols namely a pictorial entity :symbol and a position qualifier symbol. The pictorial entity symbol identifies the pictorial entity within a given class in the library of pictorial entities and image qualifiers. Preferably, the pictorial entities of a given class are each assigned a unique symbol. The symbols need not be consecutive provided they can be ordered and the largest symbol assigned to a pictorial entity of a given class can be determined.
The position qualifier symbol provides information on the position of the pictorial entity in the facial image. Preferably, the number of possible positions for a pictorial entity of a given class is predetermined. In a specific example, there may be 5 possible positions for the eyes in a facial image. Each position is assigned a position qualifier symbol such as a number from 1 to and each position qualifier symbol corresponds to a position the 5 pictorial entity with which it is associated can acquire. The element code may contain additional symbols without detracting from the spirit of the invention. For example, the element code may contain a "zoom" qualifier indicating the zoom level of the pictorial entity.
A facial image is constructed by a set of basic morphological elements. The basic morphological element present in a given facial image is said be "active" in the given image. The set of active basic morphological elements is stored in a data structure suitable for that purpose. In a specific example this data structure is an image data table. The image data table stores for each class a record. Each records describes an element code, each record containing a set of fielc'~,s, each field describing the pictorial entity symbol, position qualifier symbol and any other symbol. The entries in the image data table are referred to as active element symbols. The table below shows a specific example of an image data table.
Class Pictorial entity Position qualifier symbol symbol As shown above, a basic morphological element of class "EYES"
with a pictorial entity symbol "34" which is positioned at position "2" is active in the facial image.
The number variations in each of the symbols for each of the classes is stored in a table, herein referred to as a code factor table. The code factor table provides information about the number of possible variations in a facial image. For each class, the code factor table stores a record, each record containing a set of fields, each field describing a maximum factor. The maximum factor in the code factor table is the largest symbol assigned to an image qualifier or pictorial entity for a given class. Alternatively, the maximum factor is larger that the largest symbol assigned to an image qualifier or pictorial entity for a given class. This will best be understood in conjunction with a specific example. The table below shows an example of a code factor table.
Class Maximum pictorial Maximum position entity factor qualifier factor In the above table, there are three classes namely "EYES", "LIPS" and "GLASSES" having "900", "600" and "200" pictorial entities respectively as their maximum factor. In this specific example, the pictorial entities are' assigned numerical symbols no larger that the maximum factor for each respective class. In the case where pictorial entities are not assigned consecutive numerical symbols, the second column would contain the largest pictorial entity symbol assigned to the pictorial entities of the respective class. The third column includes the maximum position qualifier factor. Class "LIPS" for example has "26" as is maximum position qualifier factor. In this specific example, positions for the individual pictorial entities are pre-determined. Each pre-determined position is given a numerical position symbol that is between 1 and the maximum position qualifier factor in the code factor table.
IS
As shown in figure 2, a faci<~l code 206 for a given facial image may be created by combining the code factors 200 and the image data 202 with an encoding device 204. In a preferred embodiment, the encoding device 204 derives the facial code in accordance with the process described in figure 4.
The facial code is first inii_ialized at a based value 400.
Preferably, this base value is zero (0). Following this, the encoding method begins with the first class of the pictorial entities 402 and the first symbol of the element code of the class 404. The facial code is first multiplied 406 by the corresponding factor value in the code factor table. An example in conjunction with the factor table below will better illustrate this step 406.
Class Maximum pictorial Maximum position entity factor qualifier factor If class "EYES" for the pictorial entity is being considered, then the facial code is multiplied by the pictorial entity factor "900". Following this, the pictorial entity symbol from the image data table is added 408 to the facial code. An example in conjunction with the image data table below will better illustrate this step 408.
Class Pictorial entity Position qualifier symbol symbol If class "EYES" for pictorial entity is being considered, then the pictorial entity symbol "34" is added to the facial code. The system then proceeds to step 410 that checks if there are any symbols remaining for the current class. In the affirmative, the system proceeds to step 412 that determines which symbol to consider next. In the example above, the following symbol to consider is the position qualifier symbol. The system then restarts at step 406. In the event that all symbols for the current class have been processed, step 410 is answered in the negative and the system proceeds to step 414. Step 414 checks if there are any classes remaining. In the affirmative the system proceeds to step 416 that determines which class to consider next.
In the example above, the next class to consider is the "LIPS"
class. The system then restarts at step 404 with the first symbol of the element code of the new class. In the event that all classes have been processed, step 414 is answered in the negative and the system proceeds to step 418 with the complete facial code.
As a variant, the facial code may be further comprise version number information for the purpose of differentiating between different version numbers of the composite picture system. This in turn permits to insure that a composite picture system using the facial code produced by the process described above is not induced in error if its version is not the same than that of the composite picture system that created the image. In a specific example, the version number information is integrated to the facial code by multiplying the code by a specific number.
In the preferred embodiment, the facial code is a number in a given base. Preferably, a large base is used in order to obtain a reduced number of characters in the facial code. In a specific example, the facial code is a number in base "62" with characters {0-9, a-z, A-Z}. Other bases may be used without detracting from 1~
the spirit of the invention. It is to be noted that the computations in steps 406 and 408 of the encoding process may result in very large numbers in thf~ order of l0E+66 or bigger for large systems. It may therefore be preferable to provide some specialized functions for the comput=ation of the multiplication and addition operations for these numbers in order to avoid the possibility of overflow. The implementation of such computations will be readily available to the person skilled in the art to which this invention pertains.
As a variant, characters in the facial code that may be visually confusing are replaced by non-alphanumeric characters.
For instance the letter "0" and the number "0" are similar in appearance as are the letter "I", the letter "1" and the digit "1".
In a specific example, the characters in the facial code that may be visually confusing are replaced by non-alphanumeric characters such as "+" "_" "@" and so once t:he code is computed.
In a preferred embodiment, the facial code can be used to reproduce the facial image described by the facial code. As shown in figure 3, facial image data 304 may be obtained by combining the code factors 200 and the facial code 302 with a decoding device 300. The facial image data 304 is obtained by applying the inverse operations in the reverse order than those applied in the encoding process to the facial code. In a prE:ferred embodiment, the decoding device 300 derives the facial image data 804 in accordance with the process described in figure 5.
The facial code is first obtained 500. Following this, the decoding process begins with the last class of the pictorial entities 502 and the last symbol of the element code of that class 504. The facial code is first divided 506 by the factor value in the code factor table associated to the symbol being considered.
An example in conjunction with the factor table below will better illustrate this step 506.
Class Maximum pictorial Maximum position entity factor qualifier factor If class "GLASSES" for the position qualifier is being considered, then the facial code .is divided by the factor "23".
Following this, the remainder of the division performed in step 506 is stored as the corresponding position qualifier symbol in the image data table 508. The system then proceeds to step 510 that checks if there are any symbols remaining for the current class.
In the affirmative, the system. proceeds to step 512 that determines which symbol to consider next. In the example above, the following symbol to consider is thE~ pictorial entity symbol. The system then restarts at step 506. In the event that all symbols for the current class have been processed, step 510 is answered in the negative and the system proceeds to step 514. Step 514 checks if there are any classes remaining. In the affirmative the system proceeds to step 516 that determines which class to consider next.
In the example above, the next class to consider is the "LIPS"
class. The system then restarts at. step 504 with the last symbol of the element code of the new class. In the event that all classes have been processed, step 514 is answered in the negative and the system proceeds to step 518 with thE: image data table including the complete description of the image described by the facial code.
The image data table can then be used by the composite picture system to access the library of pictorial entities and image qualifiers 104 and produce a facia7_ image.
As shown in figure 3, the image data 304 is stored in an image data table that can be accessed by an image builder unit 306. The image builder unit 306 accesses the library of pictorial entities and image qualifiers 104 of the composite picture system to extract the pictorial entities specified by the image data. The image builder also extracts the image qualifiers specified by the image data and is operative to condition the pictorial entities on the basis of the these extracted image qualifiers. Following this the builder unit 300 outputs an image which may be displayed to the user of the composite picture system. Extracting data elements from a database on the basis of symbols is well known in the art to which this invention pertains.
In the event that the facial code comprises version number information, the reverse operation used to imbed the version number in the facial code is applied to the facial code during the decoding process. In a specific example where the version number information is integrated in the ~_acial code by multiplying the code by a specific number, the decoding process involves dividing the facial code by that number.
In the event that characters in the facial code that may be visually confusing were replaced by non-alphanumeric characters, the reverse operation is performed on the facial code.
An example of a typical interacaion will better illustrate the functionality of the encoding module implemented by the program instructions 102 of composite picture system and using the data components 104 106.
In a typical interaction, as shown in figure 6a, once the composite picture system is activated 600, the user selects a set of pictorial entities 602 through a user interface. The interface to the composite picture system may be a keyboard, pointing device, touch screen or any other suitable input means. The received input may be an address of the memory location where a given pictorial entity is located or some other way of identifying it. The selection is entered in the image data table in association with corresponding qualifier symbols. Preferably, the pictorial 5 entities in a given class as assigned default qualifier symbols.
Once the system has received the request, the entries in the image data table are used to locate in the library of pictorial entities and image qualifiers, the entries corresponding with the received input. When pictorial entity or im<~ge qualifier is selected it is 10 considered to be active. Following this, the selected pictorial entities and image qualifiers are combined to form a facial image.
The combination is performed by positioning each active pictorial entity in a same frame at the location specified by the position qualifier in the image data table. The system then displays the 15 facial image to allow the user to view it 604. Alternatively, after each selection of a pictorial entity, the systems displays it to allow the user to view the image as it stands with the current selection of pictorial entities. At condition 606, if the user is satisfied with the appearance of the facial image, the 20 composite picture is complete 610. The completeness of the image may be indicated by a user inputting a command indicative that the image is complete. The image data table is then processed by the encoding process to compute the facial code 612. The user of the system may then make use of the facial image and facial code as he pleases. For example, the user may print the resulting facial image, he may store the image by storing the facial code computed at step 612 or he may transmit the image to an external site by transmitting the facial code. In the event that the user is not satisfied with the appearance of the facial image, condition 606 is answered in the negative and the user may modify the facial image 608. The modification of the facial image may comprise different operations. For example, the user may replace a pictorial entity by another of th~~ same class; he may remove a pictorial entity all together; the element may be displaced in the vertical or horizontal direction. In a specific example, the user interface may include a means, such as arrows in the user interface, for displacing the pictorial entities in the vertical and horizontal directions. The arrows may be linked to functional modules that modify the position of the selected image in the screen. When the pictorial entity is displaced, the corresponding position qualifier symbol in the image table is also modified such as to reflect to current positioning of the pictorial entity. The user may select via a pointing device or other input means the element he wishes to displace in the facial image. The user then uses the displacement arrows to position the pictorial entity in the desired position in the facial image. Many variations in the user interface are possible and implementations different from the one presented above do not detract from the spirit of the invention. For every modification performed in step 608, the image data table is updated accordingly. Once the facial image has been modified by selecting a revised set of pictorial entities and image qualifiers, the latter are combined to form a facial image. The system then displays the facial image as described in the image data table to allow the user to view it at step 604.
Alternatively, after each selection of a pictorial entity or and image qualifier, the systems displays it to allow the user to view the updated image as it stands with the current selection. The process continues until the user is satisfied with the image and condition 606 is answered in the affirmative the system proceeds to step 610.
As a variant, as shown in figure 6b, the facial code may be computed incrementally as the user selects pictorial entities and image qualifiers and modifies the facial image. Following step 602, the image data table is processed 652 by the encoding unit to compute the facial code corresponding to the data in the image data table. The facial image may then be modified in accordance with steps 604 606 and 608 described previously. Following step 608, the image data table is reprocessed by the encoding unit 650 to compute the facial code corresponding to the updated data in the image data table. In this variant, the facial code for the image being created is computed as the user creates the image. Once the use stops entering new modifications, the code is readily computed without the need for the user to input a command indicative that the image is complete.
In another typical interaction, the composite picture system may receive as input the facial code describing a facial image .
Using this facial code, the composite picture system reconstructs the facial image. Therefore, the user interface may also include a means for entering the facial codes. The facial code is first decoded by the process described in connection with figure 5. The decoding process produces an image data table containing information for generating the fac_Lal image. The system accesses the library of pictorial entities and image qualifiers and extracts the pictorial entities and image qualifiers corresponding to the data contained in the image data table. The image is then displayed to the user which may make use of it as he please by modifying it, storing it, printing it or transmitting it.
Figure 7 shows an alternative embodiment of an apparatus including an embodiment of the invention. Such an apparatus comprises a user interface 706 such as a touch screen, mouse, keyboard are any other suitable input means for communicating with the user of the image system. The user interface communicates with an image builder unit 702 operative to generate graphical data on the basis of a given set of input data elements. The image builder unit may be implements on a general purpose computing platform running an application software o:f may be a dedicated CPU unit programmed specifically for the purpose of generating images. The Image builder unit 702 communicates with an output unit 704 such as a display unit or a printer unit to send the generated graphical data for output to the user. The image builder unit also communicates with a library of pictorial entities and image qualifiers 700. The library of pictorial entities and image qualifiers 700 may be implemented on a computer readable medium such as a hard disk, CD-ROM, non-volatile RAM or any other suitable device. The image builder unit 708 also communicates with a computer readable medium including image data 708. The image data specifies the pictorial entities that are active in the given image as well as any other relevant image qualifier such as position and zooming. The image data 708 may <~lso be modified by the image builder unit 702 to update its entries on the basis of inputs received by the image builder unit 702 from the user through the user interface 706. The image data 708 can be accessed by and encoder 710 operative to encode the image data according to the process described in this specification. The encoder may be implemented on a general purpose computing platform running an application software in accordance with the process described or may be a dedicated CPU unit programmed specifically for the purpose of encoding image data. The encoder 710 outputs the image code.
The encoder may further communicate with a communication unit 716 such as a modem, network card or arty other suitable communication devices suitable for transmitting data information over a communication channel 718. The image data 708 can be accessed by a decoder 714 operative to decode an image code according to the process described in this specification. The decoder 714 may be implemented on a general purpose computing platform running an application software in accordance with the process described or may be a dedicated CPU unit programmed specifically for the purpose of decoding image codes. The decoder 714 outputs the image data that is inputted to the computer readable medium containing image data. The decoder may further communicate with the communication unit 716 in order to receive image codes. The encoder 710 and decoder 714 also communicate with a computer readable medium including element code factors 712.
The facial code produced by th~~ process described above allows each facial image to be described with a very small number of S characters compared to a graphical. representation permitting the rapid transmission of the composite picture over data transmission medium. For example, as shown in figure 8, a police station at site A 804 using an embodiment of the invention can transmit the entire composite picture of a suspect to police station at site B
802 by simply sending the facial code for that facial image either verbally or through an electronic communication means 800. At the reception, police station at site B 800 enters the code into the composite picture system that displays the composite picture. The data transmission medium 800 between site A 802 and site B 804 may be a telephone line with a set of modems, and Ethernet connection, the Internet or any other communi~~ation medium suitable for the transfer of data. In the above example, site A 804 and site B 802 have on their local site a composite picture system of the type described in figure 1 or figure 7 of the drawings. A copy of the library of pictorial entities and image qualifiers is stored at each site and only the code needs to be transferred.
Advantageously, the invention further allows the storage of a facial image by storing the facial code only on a computer readable medium. This may result in substantial savings in terms of memory requirements for storing the images since only a single instance of each pictorial entity and image qualifier needs be stored, the instance being in the library of pictorial entities and image qualifiers.
Although the present invention has been described in considerable detail with reference to certain preferred versions thereof, other versions are possib:Le. For example, the method and apparatus described may be used in a system to encode a given image provided the image is build on the basis of constituent parts. In these types of application the library of pictorial entities and image qualifiers would include the appropriate set of pictorial entities and image qualifiers. Therefore, the spirit and scope of the appended claims should not be limited to the description of the 5 preferred Versions contained herein.
The reader's attention is directed to all papers and documents which are filed concurrently with or previous to this specification in connection with this application and which are open to public 10 inspection with this specification.
The size and quality of images i~; also particularly significant when the images are transmitted from one site to another via a digital link. For example, a given police station may transmit a composite picture to another police station in order to share information about a given suspect.
Thus, there exists a need in the industry to refine the process of encoding images such as to reduce the memory requirements for storage and the bandwidth required for the transmission of the image.
Summary of the Invention The invention provides a novel method and an apparatus for encoding images.
As embodied and broadly described herein the invention provides a computer readable storage medium comprising a program element suitable for use on a computer having a memory, the program element being operative to create a first input for receiving a set of element codes, each element code being representative of part of an image, an element code including at least one symbol. The symbol is representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, said values being indicative of variations of the ceri:ain characteristic. The program element is also operative to create a second input for receiving a plurality of code factors associated to respective symbols of said set of element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire. The program element is also operative to process the set of element codes to derive an image code, the image code being a compressed digital representation of the image.
The image code is derived at least in part on the basis of the plurality of code factors. The program is also operative to output the image code.
For the purpose of the specification, the expression "basic elements" is used to describe a part of a specific image. In the preferred embodiment, a basic element is comprised of a pictorial entity conditioned by a set of image qualifiers. Examples of pictorial entities in a facial image are noses, eyes, mouths and eyebrows. In the preferred embodiment, pictorial entities are grouped into classes. For example, in composite picture system, all nose pictorial entities are grouped into the "NOSE" class and all the eye pictorial entities are grouped in the "EYE" class. Each class of pictorial entities is associated to a set of image qualifiers that are used to condition the pictorial entities in the associated class. The image qualifiers may include position qualifiers, zoom qualifiers, color qualifier and the likes.
For the purpose of this specification, the basic elements used in the special case of a facial image are referred to as "basic morphological elements".
For the purpose of this specification, the word "symbol" is used to designate a representation of an object, image, qualifier or the likes. In a specific example, a symbol may be an index mapped to a memory location stoz-ing data elements such as a pictorial entity or image qualifier.
According to a broad aspect:, the invention provides, a computer readable storage medium comprising a program element suitable for use on a computer having a memory. The program element is operative to create a first input to receive a set of element codes. The element codes characterized a portion of an image and included at least one symbol. A given symbol is a representation of a certain characteristic of the portion of the element code. A given symbol can acquire a set of possible values indicative of variations of the certain characteristic with which it is associated. The program element is also operative to create a second input to receive code factors associated to respective symbols of the set of element codes. A given code factor is assigned a value that exceeds the highest value that the symbol with which it is associated can acquire. The program element is operative to process the set of element codes to derive an image code. The image code is a compressed digital representation of the image, and is derived at least :in part on the basis of the plurality of code factors. The image code can then be released as the output.
In a preferred embodiment, the image code is a number in a given base. Preferably, a large b<~se is used in order to obtain a reduced number of characters in the image code.
In a preferred embodiment of the invention, the encoding method and apparatus is integrated into a picture system. The picture system creates images on the basis of images of basic individual parts, herein referred to as basic elements. In the preferred embodiment, the picture system includes a library of pictorial entities and qualifiers, an image builder unit, an 5 encoding unit, a decoding unit and a factor table.
Each basic element in an image is assigned a unique identifier, herein referred to as element code. The element code contains information data elements, herein referred to as symbols.
In a specific embodiment, the element code for each basic element includes a symbol that characterize=s the pictorial element. In a preferred embodiment, the element code includes a plurality if symbols. In a specific example two (2) symbols are used namely an pictorial entity symbol and a position qualifier symbol. The element code may contain additional symbols without detracting from the spirit of the invention. For example symbols representative of other image qualifiers may be used. such as color, zoom and other image effects may be used. An image is constructed by a set of basic elements. The basic elements present in a given facial image are said be "active" in the given image. The set of active elements is stored in a data structure suitable for that purpose.
In a specific example this data structure is an image data table.
The image data table stores for e,~ch class a record, each record containing a set of fields, each field describing the active pictorial entity and qualifiers.
The number variations in each of the symbols for each of the classes is stored in a table, herein referred to as a code factor table. The code factor table provides information about the number of possible variations in an image. For each class, the code factor table stores a record, each record containing a set of fields, each field describing a ma~:imum factor. The maximum factor in the code factor table is the largest identifier used for the given factor. Each symbol in the image data table is mapped to a factor in the code factor table.
According to another broad aspect, the invention provides an apparatus for encoding an image, the image comprising a set of basic elements, each basic element. of the set of basic elements being associated to an element code. An encoding unit receiving as input the code factors and the element codes. The encoding unit processes the set of element codes to derive an image code, the image code being a compressed digii:al representation of the image derived at least in part on the basis of said plurality of code factors. The encoding unit then outputs the image code.
According to another broad aspect, the invention provides a method for encoding an image, the _Lmage comprising a set of basic elements, each basic element of the set of basic elements being associated to an element code. A processing step receives as input the code factors and the element codes to derive an image code.
The image code is a compressed dig~_tal representation of the image derived at least in part on the b<~sis of said plurality of code factors. The image code is the released.
In a preferred embodiment, the image code can be used to reproduce the image described by the image code. Image data may be obtained by combining the code factors and the image code with a decoding device. The image data is obtained by applying the inverse operations in the reverse order than those applied in the encoding process to the image code.
The image code allows each image to be described with a very small number of characters permitting the rapid transmission of the image over a data transmission medium. The receiving device has a decoding unit that is capable of extracting data information from the image code.
According to another broad aspect, the invention provides a method, apparatus and computer readable medium for decoding an image, the image comprising a set of basic elements, each basic element of the set of basic elements being associated to an element code. A processing step receives as input the code factors and the image code to derive the element codes. The element codes are then released.
As embodied and broadly described herein the invention further provides an apparatus for encoding an image, the image comprising a set of basic elements, each bas_Lc element of the set of basic elements being associated to an element code. The apparatus comprises a first input for receiving a set of element codes, each element code being representative of part of an image, an element code including at least one symbol, the symbol being representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, the values being indicative of variations of the certain characteristic. The apparatus also comprises a second input for receiving a plurality of code factors associated to respective symbols of said set of: element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire. The apparatus further comprises an encoding unit in operative relationship with said first input and said second input for processing said set of element codes to derive an image code, the image code being a compressed digital representation of the image. The image code is derived at least in part on the basis of said plurality of code factors. The apparatus also comprises an output for outputting the image code.
As embodied and broadly described herein the invention provides a method for encoding an image, said method comprising:
- receiving a set of element codes, each element code being g representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, said values being indicative of variations of the certain characteristic;
- receiving a plurality of code factors associated to respective symbols of said set of element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire;
- processing said set of element codes to derive an image code, said image code being a compressed digital representation of the image, said image code being derived at least in part on the basis of said plurality of code factors;
outputting said image code.
As embodied and broadly described herein the invention provides a computer data signal embodied in a carrier wave comprising an image code, said image code being derived by the above described method.
As embodied and broadly described herein the invention provides a computer readable storage medium comprising a program element suitable for use on a computer having a memory, said program element being operative to:
a) create a first input: for receiving an image code;
b) create a second input for receiving a plurality of code factors associated to respective symbols of a set of element codes, a given code factor being assigned a value treat exceeds the highest value that a symbol with which it is associated can acquire;
c) process said image code to derive set of element codes, each element: code of said set of element codes being representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code;
d) outputting said set of element codes.
Brief description of the drawings These and other features of the present invention will become apparent from the following detailed description considered in connection with the accompanying drawings. It is to be understood, however, that the drawings are designed for purposes of illustration only and not as a definition of the limits of the invention for which reference should be made to the appending claims.
Fig. 1 shows an apparatus including an embodiment of the invention;
Fig. 2 shows a high-level block diagram of functional units of the image system including an image encoder in accordance with the spirit of the invention;
Fig. 3 shows a high-level block diagram of functional units of the image system including an image decoder in accordance with the spirit of the invention;
Fig. 4 shows a detailed block diagram of the encoding process in accordance with the spirit of the invention;
Fig. 5 shows a detailed block diagram of the decoding process in accordance with the spirit of the invention;
Fig. 6a and 6b show flow diagrams for the creation of an image and the facial code in accordance with an embodiment of the invention;
1~
Fig. 7 shows an alternative apparatus including an embodiment of the invention;
Fig. 8 shows apparatuses including an embodiment of the invention connected by a data transmission medium.
Detailed Description In the preferred embodiment, the encoding method and apparatus in accordance with the invention is integrated into a picture system for creating images on the basis of images of individual parts, herein referred to as basic elements. For the sake of simplicity, the specification will describe an embodiment of the invention integrated into a composite picture system. It is to be understood that the encoding method and apparatus may be used in systems for creating images on the basis of individual constituent parts other than a composite picture system without detracting from the spirit of the invention.
In a preferred embodiment, as shown in figure 1, the composite picture system includes a general-purpose digital computer including a processor 100 linked to a machine-readable storage element 108 that may be in the form of a mass storage device such as a hard-drive, a CD-ROM or any other suitable storage medium. The system further includes a device for visualizing the facial image such as a computer monitor 110 or a printing device. The preferred embodiment also provides data input on which a user interface 112 is supported in order to allow the user to select through a touch screen, keyboard, pointing devicE: or other input means, the individual basic morphological elernents and to view the combined result on the display screen 110. 'rhe latter 110 is likely to be part of the data input. Optionally, the system further provides a data transmission medium 114 such as a telephone line, LAN, digital cable, optical cable, wireless transmission device or any other suitable means for transmitting an image from the general purpose digital computer to a receiving device. The computer readable medium 108 storing the composite picture system includes of a set of modules namely a library of pictorial entities and image qualifiers 104 and program instructions 102 interacting with the library of pictorial entities and image qualifiers to create a facial image. The computer readable medium 108 may also include symbols where each symbol is associated to a respective one of the pictorial entities and image qualifiers in the library of pictorial entities and image qualifiers 104. The computer readable medium further comprising a set of code factors, each code factor being associated to a set of symbols, a given code factor being larger that the largest symbol in the set with which it is associated. The computer readable medium further comprises an encoding program element 116 to encode a facial image.
In the preferred embodiment the composite picture system comprises an electronic library oj= pictorial entities and image qualifiers 104. Each pictorial entity in the library is an image of a facial part or an accessory such as glasses, earrings or other. The pictorial entities in the library 104 are organized into morphological classes, each class describing a part of the face. In a preferred embodiment, the following basic morphological classes are used: hairstyle, forehead, eyebrows, eyes, nose, mouth, chin, moustache, beard, wrinkles and glasses. The pictorial entities are stored on a computer readable medium. The images may be compressed in a format suitable for graphical storage such as a bitmap (BMP), GIF of JPEG file format. Other file formats may be used here without detracting from the spirit of the invention.
In the preferred embodiment., each pictorial entity is identified with a pictorial entity :symbol. Typically, the pictorial entity symbol is a sequence of alphanumeric characters. The pictorial entity symbols are stored on a computer readable medium in the database of symbols. Each image qualifier in the library is a characteristic of a corresponding class. The image qualifiers in the library 104 may be organized into qualifier types, each qualifier type describing a certain characteristic of the pictorial entity. In a preferred embodiment, the following qualifier types are used: position and color. Other image qualifiers such as zoom and the likes may be used without detracting from the spirit of the invention. The image qualifiers are stored on a computer readable medium. In the preferred embodiment, each image qualifier is identified with an image qualifier symbol. Typically, the image qualifier symbol is a sequence of: alphanumeric characters. The image qualifier symbols are stored on a computer readable medium in the database of symbols.
In a preferred embodiment, a basic morphological element includes a pictorial entity and a set of image qualifiers. The image qualifiers condition the pictorial entity to alter the visual effect of the latter. For example the image qualifier may modify the position, color zoom or any other visual effect of the pictorial entity. The purpose of the specification, the expression "basic morphological element" is used to refer to the pictorial entity conditioned by the image qualifiers. Each basic morphological element is associated to an element code. The element code contains a set of symbols. In a specific example, the element code for each basic morphological element includes two (2) symbols namely a pictorial entity :symbol and a position qualifier symbol. The pictorial entity symbol identifies the pictorial entity within a given class in the library of pictorial entities and image qualifiers. Preferably, the pictorial entities of a given class are each assigned a unique symbol. The symbols need not be consecutive provided they can be ordered and the largest symbol assigned to a pictorial entity of a given class can be determined.
The position qualifier symbol provides information on the position of the pictorial entity in the facial image. Preferably, the number of possible positions for a pictorial entity of a given class is predetermined. In a specific example, there may be 5 possible positions for the eyes in a facial image. Each position is assigned a position qualifier symbol such as a number from 1 to and each position qualifier symbol corresponds to a position the 5 pictorial entity with which it is associated can acquire. The element code may contain additional symbols without detracting from the spirit of the invention. For example, the element code may contain a "zoom" qualifier indicating the zoom level of the pictorial entity.
A facial image is constructed by a set of basic morphological elements. The basic morphological element present in a given facial image is said be "active" in the given image. The set of active basic morphological elements is stored in a data structure suitable for that purpose. In a specific example this data structure is an image data table. The image data table stores for each class a record. Each records describes an element code, each record containing a set of fielc'~,s, each field describing the pictorial entity symbol, position qualifier symbol and any other symbol. The entries in the image data table are referred to as active element symbols. The table below shows a specific example of an image data table.
Class Pictorial entity Position qualifier symbol symbol As shown above, a basic morphological element of class "EYES"
with a pictorial entity symbol "34" which is positioned at position "2" is active in the facial image.
The number variations in each of the symbols for each of the classes is stored in a table, herein referred to as a code factor table. The code factor table provides information about the number of possible variations in a facial image. For each class, the code factor table stores a record, each record containing a set of fields, each field describing a maximum factor. The maximum factor in the code factor table is the largest symbol assigned to an image qualifier or pictorial entity for a given class. Alternatively, the maximum factor is larger that the largest symbol assigned to an image qualifier or pictorial entity for a given class. This will best be understood in conjunction with a specific example. The table below shows an example of a code factor table.
Class Maximum pictorial Maximum position entity factor qualifier factor In the above table, there are three classes namely "EYES", "LIPS" and "GLASSES" having "900", "600" and "200" pictorial entities respectively as their maximum factor. In this specific example, the pictorial entities are' assigned numerical symbols no larger that the maximum factor for each respective class. In the case where pictorial entities are not assigned consecutive numerical symbols, the second column would contain the largest pictorial entity symbol assigned to the pictorial entities of the respective class. The third column includes the maximum position qualifier factor. Class "LIPS" for example has "26" as is maximum position qualifier factor. In this specific example, positions for the individual pictorial entities are pre-determined. Each pre-determined position is given a numerical position symbol that is between 1 and the maximum position qualifier factor in the code factor table.
IS
As shown in figure 2, a faci<~l code 206 for a given facial image may be created by combining the code factors 200 and the image data 202 with an encoding device 204. In a preferred embodiment, the encoding device 204 derives the facial code in accordance with the process described in figure 4.
The facial code is first inii_ialized at a based value 400.
Preferably, this base value is zero (0). Following this, the encoding method begins with the first class of the pictorial entities 402 and the first symbol of the element code of the class 404. The facial code is first multiplied 406 by the corresponding factor value in the code factor table. An example in conjunction with the factor table below will better illustrate this step 406.
Class Maximum pictorial Maximum position entity factor qualifier factor If class "EYES" for the pictorial entity is being considered, then the facial code is multiplied by the pictorial entity factor "900". Following this, the pictorial entity symbol from the image data table is added 408 to the facial code. An example in conjunction with the image data table below will better illustrate this step 408.
Class Pictorial entity Position qualifier symbol symbol If class "EYES" for pictorial entity is being considered, then the pictorial entity symbol "34" is added to the facial code. The system then proceeds to step 410 that checks if there are any symbols remaining for the current class. In the affirmative, the system proceeds to step 412 that determines which symbol to consider next. In the example above, the following symbol to consider is the position qualifier symbol. The system then restarts at step 406. In the event that all symbols for the current class have been processed, step 410 is answered in the negative and the system proceeds to step 414. Step 414 checks if there are any classes remaining. In the affirmative the system proceeds to step 416 that determines which class to consider next.
In the example above, the next class to consider is the "LIPS"
class. The system then restarts at step 404 with the first symbol of the element code of the new class. In the event that all classes have been processed, step 414 is answered in the negative and the system proceeds to step 418 with the complete facial code.
As a variant, the facial code may be further comprise version number information for the purpose of differentiating between different version numbers of the composite picture system. This in turn permits to insure that a composite picture system using the facial code produced by the process described above is not induced in error if its version is not the same than that of the composite picture system that created the image. In a specific example, the version number information is integrated to the facial code by multiplying the code by a specific number.
In the preferred embodiment, the facial code is a number in a given base. Preferably, a large base is used in order to obtain a reduced number of characters in the facial code. In a specific example, the facial code is a number in base "62" with characters {0-9, a-z, A-Z}. Other bases may be used without detracting from 1~
the spirit of the invention. It is to be noted that the computations in steps 406 and 408 of the encoding process may result in very large numbers in thf~ order of l0E+66 or bigger for large systems. It may therefore be preferable to provide some specialized functions for the comput=ation of the multiplication and addition operations for these numbers in order to avoid the possibility of overflow. The implementation of such computations will be readily available to the person skilled in the art to which this invention pertains.
As a variant, characters in the facial code that may be visually confusing are replaced by non-alphanumeric characters.
For instance the letter "0" and the number "0" are similar in appearance as are the letter "I", the letter "1" and the digit "1".
In a specific example, the characters in the facial code that may be visually confusing are replaced by non-alphanumeric characters such as "+" "_" "@" and so once t:he code is computed.
In a preferred embodiment, the facial code can be used to reproduce the facial image described by the facial code. As shown in figure 3, facial image data 304 may be obtained by combining the code factors 200 and the facial code 302 with a decoding device 300. The facial image data 304 is obtained by applying the inverse operations in the reverse order than those applied in the encoding process to the facial code. In a prE:ferred embodiment, the decoding device 300 derives the facial image data 804 in accordance with the process described in figure 5.
The facial code is first obtained 500. Following this, the decoding process begins with the last class of the pictorial entities 502 and the last symbol of the element code of that class 504. The facial code is first divided 506 by the factor value in the code factor table associated to the symbol being considered.
An example in conjunction with the factor table below will better illustrate this step 506.
Class Maximum pictorial Maximum position entity factor qualifier factor If class "GLASSES" for the position qualifier is being considered, then the facial code .is divided by the factor "23".
Following this, the remainder of the division performed in step 506 is stored as the corresponding position qualifier symbol in the image data table 508. The system then proceeds to step 510 that checks if there are any symbols remaining for the current class.
In the affirmative, the system. proceeds to step 512 that determines which symbol to consider next. In the example above, the following symbol to consider is thE~ pictorial entity symbol. The system then restarts at step 506. In the event that all symbols for the current class have been processed, step 510 is answered in the negative and the system proceeds to step 514. Step 514 checks if there are any classes remaining. In the affirmative the system proceeds to step 516 that determines which class to consider next.
In the example above, the next class to consider is the "LIPS"
class. The system then restarts at. step 504 with the last symbol of the element code of the new class. In the event that all classes have been processed, step 514 is answered in the negative and the system proceeds to step 518 with thE: image data table including the complete description of the image described by the facial code.
The image data table can then be used by the composite picture system to access the library of pictorial entities and image qualifiers 104 and produce a facia7_ image.
As shown in figure 3, the image data 304 is stored in an image data table that can be accessed by an image builder unit 306. The image builder unit 306 accesses the library of pictorial entities and image qualifiers 104 of the composite picture system to extract the pictorial entities specified by the image data. The image builder also extracts the image qualifiers specified by the image data and is operative to condition the pictorial entities on the basis of the these extracted image qualifiers. Following this the builder unit 300 outputs an image which may be displayed to the user of the composite picture system. Extracting data elements from a database on the basis of symbols is well known in the art to which this invention pertains.
In the event that the facial code comprises version number information, the reverse operation used to imbed the version number in the facial code is applied to the facial code during the decoding process. In a specific example where the version number information is integrated in the ~_acial code by multiplying the code by a specific number, the decoding process involves dividing the facial code by that number.
In the event that characters in the facial code that may be visually confusing were replaced by non-alphanumeric characters, the reverse operation is performed on the facial code.
An example of a typical interacaion will better illustrate the functionality of the encoding module implemented by the program instructions 102 of composite picture system and using the data components 104 106.
In a typical interaction, as shown in figure 6a, once the composite picture system is activated 600, the user selects a set of pictorial entities 602 through a user interface. The interface to the composite picture system may be a keyboard, pointing device, touch screen or any other suitable input means. The received input may be an address of the memory location where a given pictorial entity is located or some other way of identifying it. The selection is entered in the image data table in association with corresponding qualifier symbols. Preferably, the pictorial 5 entities in a given class as assigned default qualifier symbols.
Once the system has received the request, the entries in the image data table are used to locate in the library of pictorial entities and image qualifiers, the entries corresponding with the received input. When pictorial entity or im<~ge qualifier is selected it is 10 considered to be active. Following this, the selected pictorial entities and image qualifiers are combined to form a facial image.
The combination is performed by positioning each active pictorial entity in a same frame at the location specified by the position qualifier in the image data table. The system then displays the 15 facial image to allow the user to view it 604. Alternatively, after each selection of a pictorial entity, the systems displays it to allow the user to view the image as it stands with the current selection of pictorial entities. At condition 606, if the user is satisfied with the appearance of the facial image, the 20 composite picture is complete 610. The completeness of the image may be indicated by a user inputting a command indicative that the image is complete. The image data table is then processed by the encoding process to compute the facial code 612. The user of the system may then make use of the facial image and facial code as he pleases. For example, the user may print the resulting facial image, he may store the image by storing the facial code computed at step 612 or he may transmit the image to an external site by transmitting the facial code. In the event that the user is not satisfied with the appearance of the facial image, condition 606 is answered in the negative and the user may modify the facial image 608. The modification of the facial image may comprise different operations. For example, the user may replace a pictorial entity by another of th~~ same class; he may remove a pictorial entity all together; the element may be displaced in the vertical or horizontal direction. In a specific example, the user interface may include a means, such as arrows in the user interface, for displacing the pictorial entities in the vertical and horizontal directions. The arrows may be linked to functional modules that modify the position of the selected image in the screen. When the pictorial entity is displaced, the corresponding position qualifier symbol in the image table is also modified such as to reflect to current positioning of the pictorial entity. The user may select via a pointing device or other input means the element he wishes to displace in the facial image. The user then uses the displacement arrows to position the pictorial entity in the desired position in the facial image. Many variations in the user interface are possible and implementations different from the one presented above do not detract from the spirit of the invention. For every modification performed in step 608, the image data table is updated accordingly. Once the facial image has been modified by selecting a revised set of pictorial entities and image qualifiers, the latter are combined to form a facial image. The system then displays the facial image as described in the image data table to allow the user to view it at step 604.
Alternatively, after each selection of a pictorial entity or and image qualifier, the systems displays it to allow the user to view the updated image as it stands with the current selection. The process continues until the user is satisfied with the image and condition 606 is answered in the affirmative the system proceeds to step 610.
As a variant, as shown in figure 6b, the facial code may be computed incrementally as the user selects pictorial entities and image qualifiers and modifies the facial image. Following step 602, the image data table is processed 652 by the encoding unit to compute the facial code corresponding to the data in the image data table. The facial image may then be modified in accordance with steps 604 606 and 608 described previously. Following step 608, the image data table is reprocessed by the encoding unit 650 to compute the facial code corresponding to the updated data in the image data table. In this variant, the facial code for the image being created is computed as the user creates the image. Once the use stops entering new modifications, the code is readily computed without the need for the user to input a command indicative that the image is complete.
In another typical interaction, the composite picture system may receive as input the facial code describing a facial image .
Using this facial code, the composite picture system reconstructs the facial image. Therefore, the user interface may also include a means for entering the facial codes. The facial code is first decoded by the process described in connection with figure 5. The decoding process produces an image data table containing information for generating the fac_Lal image. The system accesses the library of pictorial entities and image qualifiers and extracts the pictorial entities and image qualifiers corresponding to the data contained in the image data table. The image is then displayed to the user which may make use of it as he please by modifying it, storing it, printing it or transmitting it.
Figure 7 shows an alternative embodiment of an apparatus including an embodiment of the invention. Such an apparatus comprises a user interface 706 such as a touch screen, mouse, keyboard are any other suitable input means for communicating with the user of the image system. The user interface communicates with an image builder unit 702 operative to generate graphical data on the basis of a given set of input data elements. The image builder unit may be implements on a general purpose computing platform running an application software o:f may be a dedicated CPU unit programmed specifically for the purpose of generating images. The Image builder unit 702 communicates with an output unit 704 such as a display unit or a printer unit to send the generated graphical data for output to the user. The image builder unit also communicates with a library of pictorial entities and image qualifiers 700. The library of pictorial entities and image qualifiers 700 may be implemented on a computer readable medium such as a hard disk, CD-ROM, non-volatile RAM or any other suitable device. The image builder unit 708 also communicates with a computer readable medium including image data 708. The image data specifies the pictorial entities that are active in the given image as well as any other relevant image qualifier such as position and zooming. The image data 708 may <~lso be modified by the image builder unit 702 to update its entries on the basis of inputs received by the image builder unit 702 from the user through the user interface 706. The image data 708 can be accessed by and encoder 710 operative to encode the image data according to the process described in this specification. The encoder may be implemented on a general purpose computing platform running an application software in accordance with the process described or may be a dedicated CPU unit programmed specifically for the purpose of encoding image data. The encoder 710 outputs the image code.
The encoder may further communicate with a communication unit 716 such as a modem, network card or arty other suitable communication devices suitable for transmitting data information over a communication channel 718. The image data 708 can be accessed by a decoder 714 operative to decode an image code according to the process described in this specification. The decoder 714 may be implemented on a general purpose computing platform running an application software in accordance with the process described or may be a dedicated CPU unit programmed specifically for the purpose of decoding image codes. The decoder 714 outputs the image data that is inputted to the computer readable medium containing image data. The decoder may further communicate with the communication unit 716 in order to receive image codes. The encoder 710 and decoder 714 also communicate with a computer readable medium including element code factors 712.
The facial code produced by th~~ process described above allows each facial image to be described with a very small number of S characters compared to a graphical. representation permitting the rapid transmission of the composite picture over data transmission medium. For example, as shown in figure 8, a police station at site A 804 using an embodiment of the invention can transmit the entire composite picture of a suspect to police station at site B
802 by simply sending the facial code for that facial image either verbally or through an electronic communication means 800. At the reception, police station at site B 800 enters the code into the composite picture system that displays the composite picture. The data transmission medium 800 between site A 802 and site B 804 may be a telephone line with a set of modems, and Ethernet connection, the Internet or any other communi~~ation medium suitable for the transfer of data. In the above example, site A 804 and site B 802 have on their local site a composite picture system of the type described in figure 1 or figure 7 of the drawings. A copy of the library of pictorial entities and image qualifiers is stored at each site and only the code needs to be transferred.
Advantageously, the invention further allows the storage of a facial image by storing the facial code only on a computer readable medium. This may result in substantial savings in terms of memory requirements for storing the images since only a single instance of each pictorial entity and image qualifier needs be stored, the instance being in the library of pictorial entities and image qualifiers.
Although the present invention has been described in considerable detail with reference to certain preferred versions thereof, other versions are possib:Le. For example, the method and apparatus described may be used in a system to encode a given image provided the image is build on the basis of constituent parts. In these types of application the library of pictorial entities and image qualifiers would include the appropriate set of pictorial entities and image qualifiers. Therefore, the spirit and scope of the appended claims should not be limited to the description of the 5 preferred Versions contained herein.
The reader's attention is directed to all papers and documents which are filed concurrently with or previous to this specification in connection with this application and which are open to public 10 inspection with this specification.
Claims (31)
1. A computer readable storage medium comprising a program element suitable for use on a computer having a memory, said program element being operative to:
a) create a first input for receiving a set of element codes, each element code being representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, said values being indicative of variations of the certain characteristic;
b) create a second input for receiving a plurality of code factors associated to respective symbols of said set of element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire;
c) process said set of element codes to derive an image code, said image code being a compressed digital representation of the image, said image code being derived at least in part on the basis of said plurality of code factors;
d) output the image code.
a) create a first input for receiving a set of element codes, each element code being representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, said values being indicative of variations of the certain characteristic;
b) create a second input for receiving a plurality of code factors associated to respective symbols of said set of element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire;
c) process said set of element codes to derive an image code, said image code being a compressed digital representation of the image, said image code being derived at least in part on the basis of said plurality of code factors;
d) output the image code.
2. A computer readable storage medium as defined in claim 1, further comprising a plurality of code factors suitable to be received by said second input.
3. A computer readable storage medium as defined in claim 1, further comprising a set of element codes suitable to be received by said first input.
4. A computer readable storage medium as defined in claim 3, wherein each element code of said set is associated to a basic element of the image.
5. A computer readable storage medium as defined in claim 4, wherein said set of element codes are arranged in a first table, each element code being an entry is said first table, each element code including a plurality of symbols.
6. A computer readable storage medium as defined in claim 5, further comprising a plurality of code factors suitable to be received by said second input.
7. A computer readable storage medium as defined in claim 6, wherein said plurality of code factors are arranged in a second table, each code factor being an entry is said second table, each code factor corresponding to a given symbol in said first table.
8. A computer readable storage medium as defined in claim 1, wherein said program element is operative to multiply a symbol by a code factor.
9. A computer readable storage medium as defined in claim 1, wherein said program element is operative to increment said image code by a symbol.
10. A computer readable storage medium as defined in claim 7, wherein said program element is operative to multiply said image code by said code factors.
11. A computer readable storage medium as defined in claim 1, wherein said image code is an alphanumeric data entity.
12. An apparatus for encoding an image, the image comprising a set of basic elements, each basic element of the set of basic elements being associated to an element code, said apparatus comprising:
- a first input for receiving a set of element codes, each element code being representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, said values being indicative of variations of the certain characteristic;
- a second input for receiving a plurality of code factors associated to respective symbols of said set of element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire;
- an encoding unit in operative relationship with said first input and said second input for processing said set of element codes to derive an image code, said image code being a compressed digital representation of the image, said image code being derived at least in part on the basis of said plurality of code factors;
- an output for outputting said image code.
- a first input for receiving a set of element codes, each element code being representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, said values being indicative of variations of the certain characteristic;
- a second input for receiving a plurality of code factors associated to respective symbols of said set of element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire;
- an encoding unit in operative relationship with said first input and said second input for processing said set of element codes to derive an image code, said image code being a compressed digital representation of the image, said image code being derived at least in part on the basis of said plurality of code factors;
- an output for outputting said image code.
13. An apparatus as defined in claim 12, further comprising a second memory unit operatively connected to said second input, said second memory unit comprising a plurality of code factors suitable to be received by said second input.
14. An apparatus as defined in claim 12, further comprising a first memory unit operatively connected to said first input, said first memory unit comprising a set of element codes suitable to be received by said first input.
15. An apparatus as defined in claim 14, wherein each element code of said set is associated to a basic element of the image.
16. An apparatus as defined in claim 15, wherein said set of element codes are arranged in a first table, each element code being an entry is said first table, each element code including a plurality of symbols.
17. An apparatus as defined in claim 16, further comprising a second memory unit operatively connected to said second input, said second memory unit comprising a plurality of code factors suitable to be received by said second input.
18. An apparatus as defined in claim 17, wherein said plurality of code factors are arranged in a second table, each code factor being an entry is said second table, each code factor corresponding to a given symbol in said first table.
19. An apparatus as defined in claim 12, wherein said encoding unit is operative to multiply a symbol by a code factor.
20. An apparatus as defined in claim 12, wherein said encoding unit is operative to increment said image code by a symbol.
21. An apparatus as defined in claim 18, wherein said encoding unit is operative to multiply said image code by said code factors.
22. An apparatus as defined in claim 12, wherein said image code is an alphanumeric data entity.
23. A method for encoding an image, said method comprising:
- receiving a set of element codes, each element code being representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, said values being indicative of variations of the certain characteristic;
- receiving a plurality of code factors associated to respective symbols of said set of element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire;
- processing said set of element codes to derive an image code, said image code being a compressed digital representation of the image, said image code being derived at least in part on the basis of said plurality of code factors;
- outputting said image code.
- receiving a set of element codes, each element code being representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code, the symbol being capable of acquiring a plurality of possible values, said values being indicative of variations of the certain characteristic;
- receiving a plurality of code factors associated to respective symbols of said set of element codes, a given code factor being assigned a value that exceeds the highest value that the symbol with which it is associated can acquire;
- processing said set of element codes to derive an image code, said image code being a compressed digital representation of the image, said image code being derived at least in part on the basis of said plurality of code factors;
- outputting said image code.
24. A method as defined in claim 23, wherein each element code of said set is associated to a basic element of the image.
25. A method as defined in claim 24, wherein said set of element codes are arranged in a first table, each element code being an entry is said first table, each element code including a plurality of symbols.
26. A method as defined in claim 25, wherein said plurality of code factors are arranged in a second table, each code factor being an entry is said second table, each code factor corresponding to a given symbol in said first table.
27. A method as defined in claim 23, wherein said processing step multiplies a symbol by a code factor.
28. A method as defined in claim 23, wherein said processing step increments said image code by a symbol.
29. A method as defined in claim 23, wherein said image code is an alphanumeric data entity.
30. A computer data signal embodied in a carrier wave comprising an image code, said image code being derived by the method defined in claim 23.
31. A computer readable storage medium comprising a program element suitable for use on a computer having a memory, said program element being operative to:
a) create a first input: for receiving an image code;
b) create a second input for receiving a plurality of code factors associated to respective symbols of a set of element codes, a given code factor being assigned a value that exceeds the highest value that a symbol with which it is associated can acquire;
c) process said image code to derive set of element codes, each element code of said set of element codes being representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code;
d) outputting said set of element codes.
a) create a first input: for receiving an image code;
b) create a second input for receiving a plurality of code factors associated to respective symbols of a set of element codes, a given code factor being assigned a value that exceeds the highest value that a symbol with which it is associated can acquire;
c) process said image code to derive set of element codes, each element code of said set of element codes being representative of part of an image, an element code including at least one symbol, said symbol being representative of a certain characteristic of the image part associated with the element code;
d) outputting said set of element codes.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US09/322,932 US6690830B1 (en) | 1998-04-29 | 1999-05-28 | Method and apparatus for encoding/decoding image data |
| CA 2273188 CA2273188A1 (en) | 1999-05-28 | 1999-05-28 | Method and apparatus for encoding/decoding image data |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US09/322,932 US6690830B1 (en) | 1998-04-29 | 1999-05-28 | Method and apparatus for encoding/decoding image data |
| CA 2273188 CA2273188A1 (en) | 1999-05-28 | 1999-05-28 | Method and apparatus for encoding/decoding image data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2273188A1 true CA2273188A1 (en) | 2000-11-28 |
Family
ID=30770791
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA 2273188 Abandoned CA2273188A1 (en) | 1998-04-29 | 1999-05-28 | Method and apparatus for encoding/decoding image data |
Country Status (2)
| Country | Link |
|---|---|
| US (11) | US6690830B1 (en) |
| CA (1) | CA2273188A1 (en) |
Families Citing this family (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2273188A1 (en) * | 1999-05-28 | 2000-11-28 | Interquest Inc. | Method and apparatus for encoding/decoding image data |
| US6981016B1 (en) * | 1999-06-11 | 2005-12-27 | Visage Development Limited | Distributed client/server computer network |
| DE10018143C5 (en) * | 2000-04-12 | 2012-09-06 | Oerlikon Trading Ag, Trübbach | DLC layer system and method and apparatus for producing such a layer system |
| US6963839B1 (en) * | 2000-11-03 | 2005-11-08 | At&T Corp. | System and method of controlling sound in a multi-media communication application |
| US6990452B1 (en) | 2000-11-03 | 2006-01-24 | At&T Corp. | Method for sending multi-media messages using emoticons |
| US7091976B1 (en) | 2000-11-03 | 2006-08-15 | At&T Corp. | System and method of customizing animated entities for use in a multi-media communication application |
| US7203648B1 (en) | 2000-11-03 | 2007-04-10 | At&T Corp. | Method for sending multi-media messages with customized audio |
| US20080040227A1 (en) | 2000-11-03 | 2008-02-14 | At&T Corp. | System and method of marketing using a multi-media communication system |
| US6976082B1 (en) | 2000-11-03 | 2005-12-13 | At&T Corp. | System and method for receiving multi-media messages |
| US7035803B1 (en) * | 2000-11-03 | 2006-04-25 | At&T Corp. | Method for sending multi-media messages using customizable background images |
| US7671861B1 (en) | 2001-11-02 | 2010-03-02 | At&T Intellectual Property Ii, L.P. | Apparatus and method of customizing animated entities for use in a multi-media communication application |
| JP2004046793A (en) * | 2002-05-17 | 2004-02-12 | Nintendo Co Ltd | Image processing system |
| US7081887B2 (en) * | 2002-12-19 | 2006-07-25 | Intel Corporation | Method and apparatus for positioning a software keyboard |
| US7426052B2 (en) * | 2004-03-29 | 2008-09-16 | Dell Products L.P. | System and method for remotely building an information handling system manufacturing image |
| US7668402B2 (en) * | 2004-11-05 | 2010-02-23 | Intergraph Technologies Company | Method for generating a composite image |
| TWI299487B (en) * | 2005-09-07 | 2008-08-01 | Via Tech Inc | System and method for modifying firmware of an optical storage medium device without enabling a compiling process |
| US7450740B2 (en) * | 2005-09-28 | 2008-11-11 | Facedouble, Inc. | Image classification and information retrieval over wireless digital networks and the internet |
| US7809172B2 (en) * | 2005-11-07 | 2010-10-05 | International Barcode Corporation | Method and system for generating and linking composite images |
| US8166418B2 (en) * | 2006-05-26 | 2012-04-24 | Zi Corporation Of Canada, Inc. | Device and method of conveying meaning |
| JP4986279B2 (en) * | 2006-09-08 | 2012-07-25 | 任天堂株式会社 | GAME PROGRAM AND GAME DEVICE |
| US20080079716A1 (en) * | 2006-09-29 | 2008-04-03 | Lynch Thomas W | Modulating facial expressions to form a rendered face |
| US7889953B2 (en) * | 2007-03-28 | 2011-02-15 | Dell Products L.P. | System and method for managing images using parent-child relationship |
| US9794448B1 (en) * | 2008-06-04 | 2017-10-17 | Hao-jan Chang | Visible multiple codes system, method and apparatus |
| US8744119B2 (en) * | 2011-01-12 | 2014-06-03 | Gary S. Shuster | Graphic data alteration to enhance online privacy |
| US9846799B2 (en) | 2012-05-18 | 2017-12-19 | Apple Inc. | Efficient texture comparison |
| US9135496B2 (en) | 2012-05-18 | 2015-09-15 | Apple Inc. | Efficient texture comparison |
| US9202099B2 (en) * | 2012-06-29 | 2015-12-01 | Apple Inc. | Fingerprint sensing and enrollment |
| US9715616B2 (en) | 2012-06-29 | 2017-07-25 | Apple Inc. | Fingerprint sensing and enrollment |
| US9318805B2 (en) | 2012-08-21 | 2016-04-19 | Qualcomm Incorporated | Updating a beam pattern table |
| US9111125B2 (en) | 2013-02-08 | 2015-08-18 | Apple Inc. | Fingerprint imaging and quality characterization |
| US10068120B2 (en) | 2013-03-15 | 2018-09-04 | Apple Inc. | High dynamic range fingerprint sensing |
| KR20150068609A (en) * | 2013-12-12 | 2015-06-22 | 삼성전자주식회사 | Method and apparatus for displaying image information |
| CN105303586B (en) * | 2014-07-16 | 2018-05-11 | 深圳Tcl新技术有限公司 | Obtain method, the method and image processing apparatus of luminance dynamic adjustment of histogram |
| US9983919B2 (en) | 2015-05-19 | 2018-05-29 | The United States Of America, As Represented By The Secretary Of The Navy | Dynamic error code, fault location, and test and troubleshooting user experience correlation/visualization systems and methods |
| KR20180028782A (en) * | 2016-09-09 | 2018-03-19 | 삼성전자주식회사 | Electronic apparatus and operating method for the same |
| US11157721B2 (en) | 2018-07-02 | 2021-10-26 | Stowers Institute For Medical Research | Facial image recognition using pseudo-images |
Family Cites Families (50)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB1605135A (en) | 1978-05-31 | 1982-02-10 | Secretary Industry Brit | Variable image display apparatus |
| GB2160480B (en) | 1984-03-12 | 1987-12-31 | Valley Printing Co | Identification kit |
| JPH01187675A (en) | 1988-01-22 | 1989-07-27 | Esuto:Kk | Picture synthesizing device and picture transfer system |
| US5214758A (en) | 1989-11-14 | 1993-05-25 | Sony Corporation | Animation producing apparatus |
| JP3179474B2 (en) | 1990-11-28 | 2001-06-25 | 株式会社日立製作所 | Computer graphic display method and information processing apparatus |
| JP2979718B2 (en) | 1991-06-06 | 1999-11-15 | ブラザー工業株式会社 | Child caricature creation device |
| US5459830A (en) | 1991-07-22 | 1995-10-17 | Sony Corporation | Animation data index creation drawn from image data sampling composites |
| JP2985387B2 (en) | 1991-07-24 | 1999-11-29 | ブラザー工業株式会社 | Caricature making device |
| US5537662A (en) | 1992-05-29 | 1996-07-16 | Casio Computer Co., Ltd. | Electronic montage composing apparatus |
| US5375195A (en) | 1992-06-29 | 1994-12-20 | Johnston; Victor S. | Method and apparatus for generating composites of human faces |
| DE69328599T2 (en) | 1992-08-24 | 2000-08-24 | Casio Computer Co Ltd | Data search device |
| US5542037A (en) | 1992-08-24 | 1996-07-30 | Casio Computer Co., Ltd. | Image displaying apparatus wherein selected stored image data is combined and the combined image data is displayed |
| US5432864A (en) * | 1992-10-05 | 1995-07-11 | Daozheng Lu | Identification card verification system |
| JPH06168314A (en) * | 1992-11-30 | 1994-06-14 | Matsushita Electric Ind Co Ltd | Amusement device |
| WO1994008311A1 (en) | 1992-10-07 | 1994-04-14 | Aspley Limited | Image display system |
| US5491777A (en) | 1992-12-14 | 1996-02-13 | Casio Computer Co., Ltd. | Image data processor |
| MY109854A (en) * | 1992-12-21 | 1997-09-30 | Casio Computer Co Ltd | Object image display devices |
| JP3201028B2 (en) | 1992-12-28 | 2001-08-20 | カシオ計算機株式会社 | Image creation apparatus and face image communication method |
| JP3334230B2 (en) | 1993-03-18 | 2002-10-15 | カシオ計算機株式会社 | Montage image display control device and montage image display control method |
| US5572656A (en) * | 1993-06-01 | 1996-11-05 | Brother Kogyo Kabushiki Kaisha | Portrait drawing apparatus having image data input function |
| JP3298242B2 (en) | 1993-06-07 | 2002-07-02 | カシオ計算機株式会社 | Face image creation device and face image creation method |
| US5680531A (en) | 1993-07-02 | 1997-10-21 | Apple Computer, Inc. | Animation system which employs scattered data interpolation and discontinuities for limiting interpolation ranges |
| US7859551B2 (en) * | 1993-10-15 | 2010-12-28 | Bulman Richard L | Object customization and presentation system |
| US5600767A (en) | 1994-02-25 | 1997-02-04 | Casio Computer Co., Ltd. | Image creation device |
| ES2105936B1 (en) | 1994-03-21 | 1998-06-01 | I D Tec S L | IMPROVEMENTS INTRODUCED IN INVENTION PATENT N. P-9400595/8 BY: BIOMETRIC PROCEDURE FOR SECURITY AND IDENTIFICATION AND CREDIT CARDS, VISAS, PASSPORTS AND FACIAL RECOGNITION. |
| US5852669A (en) | 1994-04-06 | 1998-12-22 | Lucent Technologies Inc. | Automatic face and facial feature location detection for low bit rate model-assisted H.261 compatible coding of video |
| JP3046224B2 (en) | 1994-07-26 | 2000-05-29 | 三星電子株式会社 | Constant bit rate coding method and apparatus and tracking method for fast search using the same |
| US5808624A (en) * | 1994-07-29 | 1998-09-15 | Brother Kogyo Kabushiki Kaisha | Picture making apparatus for creating a picture for printing by assembling and positioning component parts |
| US5649086A (en) | 1995-03-08 | 1997-07-15 | Nfx Corporation | System and method for parameter-based image synthesis using hierarchical networks |
| JP3671257B2 (en) | 1995-04-21 | 2005-07-13 | カシオ計算機株式会社 | Composite pattern output device |
| JP3671260B2 (en) | 1995-05-10 | 2005-07-13 | カシオ計算機株式会社 | Image creation apparatus and image creation control method |
| JPH08305837A (en) | 1995-05-10 | 1996-11-22 | Casio Comput Co Ltd | Image generating device |
| US5842194A (en) * | 1995-07-28 | 1998-11-24 | Mitsubishi Denki Kabushiki Kaisha | Method of recognizing images of faces or general images using fuzzy combination of multiple resolutions |
| JPH09135447A (en) | 1995-11-07 | 1997-05-20 | Tsushin Hoso Kiko | Intelligent encoding/decoding method, feature point display method and interactive intelligent encoding supporting device |
| JP2930006B2 (en) | 1996-05-29 | 1999-08-03 | 日本電気株式会社 | Caricature making device |
| JP3838282B2 (en) | 1996-06-20 | 2006-10-25 | ブラザー工業株式会社 | Picture creation device |
| JP2943703B2 (en) | 1996-07-22 | 1999-08-30 | 日本電気株式会社 | Three-dimensional character creation device and three-dimensional character creation method |
| US6044168A (en) | 1996-11-25 | 2000-03-28 | Texas Instruments Incorporated | Model based faced coding and decoding using feature detection and eigenface coding |
| JPH11154240A (en) | 1997-11-20 | 1999-06-08 | Nintendo Co Ltd | Image producing device to produce image by using fetched image |
| AU1613599A (en) * | 1997-12-01 | 1999-06-16 | Arsev H. Eraslan | Three-dimensional face identification system |
| US6256620B1 (en) | 1998-01-16 | 2001-07-03 | Aspect Communications | Method and apparatus for monitoring information access |
| US6144991A (en) | 1998-02-19 | 2000-11-07 | Telcordia Technologies, Inc. | System and method for managing interactions between users in a browser-based telecommunications network |
| CA2273188A1 (en) | 1999-05-28 | 2000-11-28 | Interquest Inc. | Method and apparatus for encoding/decoding image data |
| CA2236388A1 (en) | 1998-04-29 | 1999-10-29 | Inter Quest | Method and apparatus for creating facial images |
| US6339826B2 (en) | 1998-05-05 | 2002-01-15 | International Business Machines Corp. | Client-server system for maintaining a user desktop consistent with server application user access permissions |
| US6240446B1 (en) * | 1998-10-14 | 2001-05-29 | International Business Machines Corporation | Multiplexing of multiple data packets for multiple input/output operations between multiple input/output devices and a channel subsystem having multiple channels |
| WO2000033240A1 (en) | 1998-12-02 | 2000-06-08 | The Victoria University Of Manchester | Face sub-space determination |
| US6338082B1 (en) | 1999-03-22 | 2002-01-08 | Eric Schneider | Method, product, and apparatus for requesting a network resource |
| US6807290B2 (en) | 2000-03-09 | 2004-10-19 | Microsoft Corporation | Rapid computer modeling of faces for animation |
| US7003140B2 (en) | 2003-11-13 | 2006-02-21 | Iq Biometrix | System and method of searching for image data in a storage medium |
-
1999
- 1999-05-28 CA CA 2273188 patent/CA2273188A1/en not_active Abandoned
- 1999-05-28 US US09/322,932 patent/US6690830B1/en not_active Expired - Fee Related
-
2003
- 2003-11-04 US US10/699,681 patent/US7146061B2/en not_active Expired - Fee Related
- 2003-11-04 US US10/699,679 patent/US7139413B2/en not_active Expired - Fee Related
- 2003-11-04 US US10/699,729 patent/US7113642B2/en not_active Expired - Fee Related
-
2004
- 2004-01-20 US US10/759,225 patent/US7289647B2/en not_active Expired - Fee Related
- 2004-01-22 US US10/761,434 patent/US7471835B2/en not_active Expired - Fee Related
-
2008
- 2008-11-24 US US12/276,742 patent/US20090074309A1/en not_active Abandoned
-
2009
- 2009-12-11 US US12/636,302 patent/US8005303B2/en not_active Expired - Fee Related
-
2011
- 2011-08-22 US US13/215,025 patent/US20120045138A1/en not_active Abandoned
-
2012
- 2012-12-04 US US13/705,026 patent/US9230353B2/en not_active Expired - Fee Related
-
2015
- 2015-12-02 US US14/956,972 patent/US20160086354A1/en not_active Abandoned
Also Published As
| Publication number | Publication date |
|---|---|
| US20160086354A1 (en) | 2016-03-24 |
| US20130278630A1 (en) | 2013-10-24 |
| US20120045138A1 (en) | 2012-02-23 |
| US20040091154A1 (en) | 2004-05-13 |
| US7139413B2 (en) | 2006-11-21 |
| US20090074309A1 (en) | 2009-03-19 |
| US7146061B2 (en) | 2006-12-05 |
| US7113642B2 (en) | 2006-09-26 |
| US20100142834A1 (en) | 2010-06-10 |
| US20040207645A1 (en) | 2004-10-21 |
| US20040091155A1 (en) | 2004-05-13 |
| US20040207646A1 (en) | 2004-10-21 |
| US6690830B1 (en) | 2004-02-10 |
| US20040091156A1 (en) | 2004-05-13 |
| US9230353B2 (en) | 2016-01-05 |
| US8005303B2 (en) | 2011-08-23 |
| US7289647B2 (en) | 2007-10-30 |
| US7471835B2 (en) | 2008-12-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6690830B1 (en) | Method and apparatus for encoding/decoding image data | |
| US7003140B2 (en) | System and method of searching for image data in a storage medium | |
| US6330071B1 (en) | Variable data print job system | |
| KR20000064110A (en) | Device and method for automatic character generation based on a facial image | |
| JPS6165290A (en) | Generator for vector character font | |
| US6731302B1 (en) | Method and apparatus for creating facial images | |
| Yamada et al. | Comic image decomposition for reading comics on cellular phones | |
| Ferilli | Automatic digital document processing and management: Problems, algorithms and techniques | |
| JP2000348127A (en) | Print information processing system | |
| CN109711922A (en) | Part method, apparatus, system and storage medium are posted in customization | |
| CN106447295A (en) | Sign-off file template generation method and apparatus thereof | |
| CN113268971B (en) | Intelligent generation method and device of demonstration report, computer equipment and storage medium | |
| JP3613403B2 (en) | Multimedia document storage device | |
| JP4530572B2 (en) | Document creation system and document creation method | |
| CN115983200A (en) | Problem solving method and device | |
| JPS6120908B2 (en) | ||
| CN113486679A (en) | Statement translation method and device based on neural network | |
| JP2004265433A (en) | Construction method of image in image storage device | |
| JPH07129655A (en) | Data flow chart generating device | |
| JPH0512269A (en) | Document processing system | |
| JPH0435465A (en) | Code image data converter | |
| JPH06110621A (en) | Batch preparing system for setup headline | |
| JP2003132044A (en) | Tag structure data sharing system | |
| JPS62144291A (en) | Input device for sequencer ladder chart | |
| JPH11110383A (en) | Overall print design producing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FZDE | Discontinued |