|Numéro de publication||US5493677 A|
|Type de publication||Octroi|
|Numéro de demande||US 08/255,379|
|Date de publication||20 févr. 1996|
|Date de dépôt||8 juin 1994|
|Date de priorité||8 juin 1994|
|État de paiement des frais||Payé|
|Autre référence de publication||US5617119, US5893101|
|Numéro de publication||08255379, 255379, US 5493677 A, US 5493677A, US-A-5493677, US5493677 A, US5493677A|
|Inventeurs||Aristotle Balogh, Hatte Blejer, Eugene Chen, Sharon Flank, Carmen Iannacone, John Maloney, Patrick Martin, James Rothey, Gary Schmid, Linda T. Dozier, Michael Lorton|
|Cessionnaire d'origine||Systems Research & Applications Corporation|
|Exporter la citation||BiBTeX, EndNote, RefMan|
|Citations de brevets (11), Référencé par (482), Classifications (49), Événements juridiques (8)|
|Liens externes: USPTO, Cession USPTO, Espacenet|
The present invention relates generally to image processing and specifically to archiving and retrieving of images, such as digitized photographs, works of art, or graphic illustrations, by use of a natural language such as English.
Numerous schemes have been used in the past for archiving images and selecting images for retrieval from such archives. Before computers became widely available, simple index cards were often used to keep track of stock photographs, and personnel within photo agencies often relied on their own experience to retrieve photographs that corresponded to a potential customer's request.
Such methods of archiving and retrieving stock photographs provided imperfect results, and were difficult, time-consuming and expensive to implement. As image libraries grew, the shortcomings of conventional archiving and retrieval techniques became yet more pronounced.
The advent of photo Compact Disc ("CD") technology allowed certain advances to be made in this field. With CDs, a customer may purchase rights to use a large number of pictures that may be stored on a single disc and selectively browsed using a CD-ROM drive. However, the number of images available on a CD is still somewhat limited, and most CD-based photo portfolios require a relatively large up-front payment for all of the images on the CD, regardless of how many the user may be interested in. Finally, image quality on CD-based photo portfolios is not always production quality.
Some on-line systems have recently become available that include photo CD technology, such as the KODAK PICTURE EXCHANGE ("KPX") and the COMSTOCK BULLETIN BOARD SERVICE. Such services typically include relatively large libraries of images, and permit conventional keyword search techniques. However, none of the known systems provide an easy to use, natural language search capability, nor do they allow for automating the process of pricing, ordering, and delivering selected images.
It would be desirable to allow users to select images from a library based on conceptual characteristics of such images, to obtain immediate pricing information regarding selected images, and to order and obtain production-quality versions of such images directly.
In accordance with the present invention, images are archived and retrieved by associating metadata with an image, the metadata including bibliographic data, a caption, and a set of suggestions evoked by the image, removing ambiguities from the metadata, storing the image and metadata in a database with other images and metadata, and selecting certain images from the database that have metadata corresponding to a user's search request.
In one aspect of the invention, a natural language processing technique is used in connection with the selection of images based on the user's search request.
In another aspect of the invention, an image is watermarked so as to allow the image to be viewed for selection on a computer monitor, but not to be printed in a usable format or downloaded for digital publishing.
In yet another aspect of the invention, the user may order and obtain delivery of selected images directly over a computer connection.
In still another aspect of the invention, ambiguities in the metadata are removed by highlighting portions of the metadata that are recognized as having multiple senses, providing a list of possible senses for those portions, and allowing the user to select the appropriate sense.
In accordance with the present invention, apparatus (100) for image archive and retrieval includes an ingestion center (110), an image center (120), and user workstations (130-132).
FIG. 1 is a physical block diagram of apparatus for pattern recognition in accordance with the present invention.
FIG. 2 is a functional block diagram of the ingestion center portion of the apparatus of FIG. 1, in accordance with the present invention.
FIG. 3 is a functional block diagram of the image center portion of the apparatus of FIG. 1, in accordance with the present invention.
FIG. 4 is a flow diagram illustrating disambiguation processing, in accordance with the present invention.
FIG. 5 is a flow diagram illustrating watermarking, in accordance with the present invention.
FIG. 6 illustrates an index card screen used in conjunction with the ingestion center portion of the apparatus of FIG. 1, in accordance with the present invention.
FIG. 7 illustrates an interpreter screen used in conjunction with the ingestion center portion of the apparatus of FIG. 1, in accordance with the present invention.
FIG. 8 is a flow diagram of upload processing, in accordance with the present invention.
FIG. 9 is a flow diagram of index server upload processing, in accordance with the present invention.
FIG. 10 is a flow diagram of search engine processing in accordance with the present invention.
FIG. 11 illustrates communications layers of the apparatus of FIG. 1, in accordance with the present invention.
FIG. 12 illustrates a match list screen used in conjunction with the image center portion of the apparatus of FIG. 1, in accordance with the present invention.
FIG. 13 illustrates an image browser screen used in conjunction with the image center portion of the apparatus of FIG. 1, in accordance with the present invention.
FIG. 14 illustrates an information screen used in conjunction with the image center portion of the apparatus of FIG. 1, in accordance with the present invention.
FIG. 15 illustrates a lightbox screen used in conjunction with the image center portion of the apparatus of FIG. 1, in accordance with the present invention.
FIG. 16 illustrates a pricing screen used in conjunction with the image center portion of the apparatus of FIG. 1, in accordance with the present invention.
Referring now to FIG. 1, there is shown a system 100 for archiving and retrieving images in accordance with the present invention. Briefly, the system 100 is comprised of three major functional blocks. Ingestion center 110 is used to enter images and associated characterizing data (described below as "metadata") into system 100. Image center 120 is used to store the image data and metadata, and to process queries for images based on the metadata. User workstations 130-132 are used to allow remote users to enter queries for images, to view the images sent by image center 120, to obtain pricing information on such images, to order such images, and to obtain delivery of such images.
More specifically, ingestion center 110 includes a data entry processor 112, disambiguation processor 114, and natural language processing ("NLP") database 116. Image and basic bibliographic information provided by stock photography agents are converted into digital format if not provided in that form by the agents, and conventionally input to ingestion center 110 using data entry processor 112. Typically, the basic bibliographic information provided by the agents includes the artist's name, source, copyright holder, location, artist's project name or series, dates, release information, and any notes relating to the photograph supplied by the artist. The data entry processor 112 permits input of the image data and this textual data to 110, and also allows an operator known as a "captioner" to verify the quality of both the image data and the bibliographic data, to write a short caption, or description, of the salient features of the image, and to select certain attributes of the image. The caption may be a set of regular English language sentences, as opposed to merely a listing of unconnected keywords. The attributes may include, for example, the type of image (photograph, computer-generated graphic, video clip or other multimedia object, background pattern, portrait, abstract, aerial, or special effect), predominant hue, and image orientation (landscape or portrait). The captioner also provides as part of the metadata a "suggests" text field describing the emotional suggestions evoked by the image. If not already provided by the photo agency with the bibliographic data, the captioner may obtain and add to the bibliographic data information concerning the prices and other terms under which such image may be licensed. Collectively, the bibliographic data, the caption, the attributes and the suggests field are known as the "metadata" associated with the image.
A disambiguation processor 114 takes as input the metadata of the image and identifies for the captioner any portions of the metadata that are capable of multiple interpretations, based on information previously stored in NLP database 116. The captioner may then select which interpretation is desired, or may enter a new interpretation. The disambiguation processor 114 also serves to standardize the form of the caption, so that all captions use conjunction and disjunction in a standard way, and so that all captions are written in the same anaphoric reference style. Furthermore, if the style of captions is standardized, the location of information within a caption may even provide useful information. If, for example, the most important descriptive information is consistently placed in the first sentence of a caption, that information can be weighted more heavily in making decisions about the relative "closeness" of a query to the caption.
In a preferred embodiment, data entry processor 112, disambiguation processor 114, and NLP database 116 are implemented using conventional client/server computer systems, with client workstations being personal computers such as the APPLE MACINTOSH or IBM-compatible personal computers and servers being conventional computers such as the SUN SPARCSTATION.
Memory map B-trees are used to implement NLP database 116, as described in R. Sedgewick, ALGORITHMS IN C++, Reading, Mass.: Addison-Wesley (1992), the teachings of which are incorporated herein by reference. NLP database 116 contains information about words, their senses, and how those senses are linked together. Word senses are represented as unique numbers. An "expansions" portion of NLP database 116 represents each link as a database record incorporating (i) the word sense, represented by a unique number, (ii) a word sense to which the sense in (i) is linked, represented by another unique number, and (iii) the type of link between the senses in (i) and (ii), e.g., "synonym", "antonym", "a kind of", "a part of."
The primary components of image center 120 include upload processor 122, database processor 124, browse processor 126, and order processor 128. Upload processor 122 is used to take the image and metadata information from ingestion center 110 and store it in a form usable by database processor 124. Database processor 124 stores images and metadata for use by browse processor 126 and order processor 128, and also archives image data for long-term storage. In a preferred embodiment, database processor stores images in three separate resolutions for "thumbnail", quarter-sized, and full-sized display as desired, and uses VHS-type videotape as the medium for archiving full-resolution images. Browse processor 126 permits a user to see both image data and metadata for selected images, and order processor 128 permits the user to learn pricing information for such images, to order such images, and to obtain delivery of such images. In a preferred embodiment, processors 122-128 are implemented using conventional client/server architecture as described above in connection with the components of ingestion center 110.
User workstations 130-132 permit users of system 100 to access the image center 120 for the purpose of posting image queries, for reviewing the results of such queries, for selecting images to order, for completing ordering transactions, and for receiving print-quality images. For purposes of illustration, three user workstations 130-132 are shown but it should be recognized that any number of such workstations may be used in accordance with the invention. In a preferred embodiment, workstations 130-132 are implemented using conventional personal computers such as described above in connection with the client computers of ingestion center 110, programmed to provide the functionality described herein.
The components of system 100 illustrated in FIG. 1 are further described below in connection with the other figures.
Referring now also to FIG. 2, there is shown a functional block diagram of ingestion center 110. In operation, a digitized picture 250 and bibliographic data 252 (shown in simplified form in FIG. 2) are applied to an image/bibliographic input and quality control service 202. Service 202, implemented primarily by data entry processor 112, permits input of the image and agency-supplied bibliographic data into system 100. Service 202 also displays the image and data so that a captioner may perform quality control to ensure that the image is right-side up and in focus, that the colors are correct, and that the bibliographic data 252 was scanned or otherwise input correctly and matches the image 250.
After processing by service 202 is complete, the image and bibliographic data are applied to a caption/suggests field entry service 204. This service 204 permits a captioner to enter the caption and suggests field information as described in connection with FIG. 1. In a preferred embodiment, service 204 is implemented using data entry processor disambiguation processor 114, but other processors, e.g., data entry processor 112, could also provide this functionality.
The data are next applied to a disambiguation of caption and suggests field tool 206. This tool 206 provides processing, described in greater detail in connection with FIG. 4, that checks the spelling of words in the bibliographic data, allows for supplementation of information in the bibliographic data (e.g., to provide more complete location information), "tags" words in the caption and suggests field as being particular parts of speech, checks the spelling of words in the caption and suggests field, links logically connected adjacent words in the captions and suggests field as "multiwords" (e.g., "United States" and "home run"), and removes ambiguities from the caption and the suggests field by allowing the captioner to select a word sense that most closely matches the concept or intended meaning of any particular word in the context. For instance, the word "crane" has both noun and verb meanings, and the noun meaning is also ambiguous between a "heavy equipment" sense and a "bird" sense. The captioner is presented with a list of possible senses and asked to indicate which sense is intended. From that point on, the word is marked with the intended sense so that requests for images related to the other senses of the word do not pull up that image.
The disambiguation tool 206 uses a semantic net of word senses, including a hierarchy of synonyms and related words. This net acts as a thesaurus to link related words in both the disambiguation service 206 and in the image center 120 so that even if the end user does not request "crane", but instead requests "heron", images captioned using the bird sense of crane may be retrieved.
The disambiguation tool 206 permits a captioner to add new words and new senses to the semantic net. In a preferred embodiment, disambiguation tool 206 is implemented using disambiguation processor 114 and NLP database 116. Referring now also to FIG. 4, greater detail is provided concerning the data flow of disambiguation tool 206.
The data with ambiguities removed is next applied to captions/suggests field quality control service 208, wherein the captioner is provided with an opportunity to again check the accuracy of the caption and suggests field information. In a preferred embodiment, caption/suggests field quality control service is also implemented using disambiguation processor 114.
Referring now to FIG. 6, there is shown an index card screen 600 by which data entry for the quality control services 202, 208 and caption/suggests field entry services 204 may be accomplished. Index card screen 600 displays image 250 in a picture display area 602, allows the captioner to review and modify bibliographic data in bibliographic data area 610, allows the captioner to add or review a caption in caption area 604, allows the captioner to add or revise suggests field information in suggests field area 606, and allows the captioner to add or revise photographer's notes in photographer's notes area 608. Screen 600 also provides an area 612 in which the captioner may specify the image characteristics (e.g., predominant hue, type of image). Furthermore, screen 600 provides a set of navigation buttons 618 by which the captioner may move among images, reject an image that is of faulty quality, or change default values for the data. In a preferred embodiment, screen 600 is implemented to operate in conjunction in the conventional windowing environment of a UNIX workstation such as a SUN SPARCSTATION or an IBM model RS6000 workstation. In a preferred embodiment, a separate screen similar to screen 600 is used for data entry and correction of pricing and delivery information for images, but it should be recognized that this information could be provided on screen 600 if desired.
Referring now to FIG. 7, there is shown an interpreter screen 700 that is presented to the captioner when the disambiguation tool 206 is invoked by the captioner's selection of a "next" choice from navigation buttons 618 on screen 600. Interpreter screen 700 includes an area 702 for display of tokens, or words, in a caption, an area 704 for display of the various sense choices known in NLP database 116 for a selected word in display area 702, an area 706 for more detailed interpretation of a selected one of the sense choices that is displayed in area 704, and an area 712 for display of the part of speech of the selected token. A user commands area 710 displays button choices that the captioner may invoke to add or subtract information, to form or break multiwords, and to add new sense definitions. A navigation commands area 708 displays button choices that the captioner may invoke to finalize disambiguation selections, to ignore tokens that are flagged as being potentially ambiguous, or to finish or cancel a session. In operation, the caption displayed in the tokens area may include a number of words that the disambiguation tool determines to be ambiguous, and may also mark selected groups of words as multiword candidates.
Referring now also to FIG. 4, the process of disambiguation corresponding to the screens in FIGS. 6 and 7 begins by invoking 401 the disambiguation tool 206. A conventional spell-checker is then invoked 402 to correct any spelling errors that appear in the caption. Next, a check 403 is made to determine whether the caption contains any likely multiwords. If so, the multiwords are marked 404 by the captioner underlining them on screen 600. In one embodiment, the ingestion center 110 automatically provides suggestions for multiwords and provides the captioner an opportunity to modify those selections as desired. For example, a caption may include the term "blue collar", and it is up to the captioner to determine whether this term merely describes the color of a shirt collar and should therefore be considered as two separate words, or whether it relates to manual labor, in which case it should be considered as a multiword. The system may at times present a large number of choices for multiwords. For example, if the caption includes "Mt. Rushmore National Park, South Dakota", a number of possible multiwords may be presented, ranging from no multiwords, to a combination of the multiwords "Mt. Rushmore", "National Park", and "South Dakota", to a large single multiword containing the entire phrase. The proper selection is left to the captioner's discretion, and should be made in a manner that will be most helpful in searching for images. In the above example, one likely selection would be of the multiwords "Mt. Rushmore National Park" and "South Dakota".
Processing then invokes 405 a disambiguation/part of speech tagger and allows the captioner to select a word for processing. A check 406 is made to determine whether the selected word is recognized, i.e., is known by the NLP database 116. If not, an unknown word handler is invoked 412 so that the disambiguation tool 206 enters a learning mode, and the captioner is prompted 413 to enter the word type, i.e., a proper name, a location, or other. In a preferred embodiment, unknown words of a caption are immediately displayed using a different color, e.g., red, from recognized words to ensure that the captioner provides such unrecognized words with special attention. In typical operation of the preferred embodiment, all words in a caption and in a suggests field are selected by the captioner for disambiguation, but it should be recognized that operation in which only some words are so processed is also possible.
If the captioner indicates that the type of the unknown word is a name, the word is stored 415 as a name in the NLP database 116, and processing returns to 405 for disambiguation of subsequent words in the caption. If the word type is a location, the word is stored 414 as a location in the NLP database 116, and processing returns to 405 for disambiguation of subsequent words in the caption. If the captioner indicated any other word type, the captioner is prompted to identify 416 the part of speech of the word (e.g., noun, verb, adjective, adverb, date, keyword, helping word) and to associate 417 the word with a word that is known by the NLP database 116. Keywords are acronyms, company names, newly-defined terms in common usage, slang, and words that do not fall into the other categories. Examples of keywords might be names of musical groups such as "Peter, Paul & Mary" and of cultural movements such as "New Age" or "grunge". Helping (or "function") words are determiners such as prepositions, conjunctions and possessive pronouns when used in a manner that would not assist in image searching. For instance, a caption that reads "A boy runs past a house" should have the word "past" marked as a helping word.
In a preferred embodiment, three types of associations are provided for unknown words. The first, a "kind of" association, links genus terms with species terms. For instance, Halloween is a "kind of" holiday. The second type of association is a synonym association. For instance, the words "trauma" and "shock" may be linked in this manner. The third type of association is a "sister term" association, and is used to link two species within the same genus. For instance, the multiword terms "tank top" and "tee shirt" would be linked as sister terms. This information is used to determine the unknown word's placement in NLP database 116. For instance, if NLP database 116 already recognizes "tank top" as a kind of shirt, linking "tee shirt" as a sister term for "tank top" establishes tee shirt" as also being a kind of shirt. It should be recognized that additional or other types of associations may be provided.
The captioner may use the information stored in NLP database 116 as a dictionary or thesaurus by free associating other possible words with the unknown word in interpretation area 706. Once the captioner has typed in a proposed associated word that is recognized as being in NLP database 116, the disambiguation tool will allow that proposed associated word to be the sense with which the unknown word is tagged. For instance, if the word "biker" appears in a caption and is unknown in NLP database 116, the captioner may try free associating the term "bicyclist". If that term is unknown as well, the captioner may try the term "cyclist." If cyclist is in the NLP database 116, the captioner can choose that "biker" be tagged with the sense "cyclist" in that caption. Image searching can also be enhanced by free associating proper names or dates with other terms in NLP database 116. For example, the captioner may associate the proper name "Abraham Lincoln" with the noun "president". Similarly, nouns may be associated with verbs, for instance "explosion" with "combust". As a more complete example, the captioner may mark the words "boat people" as a multiword, indicate that the part of speech is a noun, and associate this multiword with the known term "refugees".
All of the new information provided by the captioner while disambiguation tool is in a learning mode is recorded in a log for future use in disambiguation and, once uploaded to image center 120, for use in image searching.
If check 406 indicates that the word is recognized in the NLP database 116, then a check 407 is made to determine whether the part of speech assumed by disambiguation tool 206 for the word is correct. This check 407 is accomplished by prompting the captioner to indicate whether there is an error in the assumed part of speech, which is conventionally determined by word order and statistical information concerning usage of each word. If there is an error, the captioner indicates 408 the correct part of speech. If the part of speech is determined 409 to be as a function (or "helping") word, the word is ignored 410 for purposes of disambiguation and processing returns to 405. A function word, as opposed to a content word, is a word that only links together or supports words that describe things, actions, and properties. For example, content words would include "house", "walk" or "crooked", while function words would include "the", "and", "could", and "if". If the word is not a function word, the captioner is prompted 411 to indicate the correct sense of the word and thereby mark that instance of the word with the desired sense. This prompting 411 takes place even if the NLP database 116 is currently aware of only one sense of the word, in order to give the captioner an opportunity to add a new sense for that word to the NLP database 116.
Disambiguation tool 206 is implemented in a preferred embodiment in a conventional manner using disambiguation processor 114 and NLP database 116. Further information on known techniques of natural language processing for text-only retrieval systems are found, for example, in T. Strzalkowski and B. Vauthey, Information Retrieval Using Robust Natural Language Processing, PROCEEDINGS OF THE 30TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 28 Jun.-2 Jul. 1992, Newark, Del., pp. 104-111; P. Nelson, Site Report for the Text REtrieval Conference, TREC: The First Text REtrieval Conference (TREC-1), D. K. Harman, ed., Computer Systems Laboratory, National Institute of Standards and Technology, Gaithersburg, Md., NIST Special Publication 500-207 (hereinafter, "TREC"), pp. 287-296 (1993); D. Evans, et al., CLARIT TREC Design, Experiments, and Results, TREC, pp. 251-286 (1993); T. Strzalkowski, Natural Language Processing in Large-Scale Text Retrieval Tasks, TREC, pp. 173-187 (1993); S. Abney, Parsing by Chunks, PRINCIPLE-BASED PARSING: COMPUTATION AND PSYCHOLINGUISTICS, Berwick et al., eds., Dordrecht: Kluwer Academic Publishers, pp. 257-78 (1991), the teachings of which are incorporated herein by reference.
In a preferred embodiment, each word sense is represented using a unique identifying number. An ambiguous word, such as "crane", may have several senses, and disambiguation refers to selecting the correct sense in a particular context or, in other words, discarding those senses of the word that are not appropriate in the current context. It should be recognized that this disambiguation may be performed either manually, i.e., with the captioner selecting a proper sense for each word, or may be performed automatically, e.g., with a system that uses statistical information to select the most likely sense in a given context.
The output of ingestion center 110 includes image 250 and metadata 262 and may, as desired, be in the form of a data stream on a bus connecting ingestion center 110 to image center 120, or may be written onto storage media such as magnetic or optical disks or tapes.
Referring now to FIG. 3, there is shown a functional block diagram of image center 120. Image 250 and metadata 262 are applied to uploading, archiving, watermarking and indexing service 302 for initial processing. Service 302 transfers full-resolution images, e.g., 250 for long-term storage onto a conventional medium such as magnetic tape; generates browse-resolution images, watermarks such images and stores them for browsing service 308; stores metadata and any additions to the semantic net resulting from disambiguation for index querying service 306, and stores licensing and pricing information for use by purchase and delivery service 310 to permit on-line delivery of a full-resolution image 350. In a preferred embodiment, separate databases within database processor 124 are used to provide such storage, but it should be recognized that any conventional storage scheme could be used for storage of the browse-resolution images, the metadata, the semantic net information, and the licensing and pricing information.
Still referring to FIG. 3, a user workstation, e.g., 130, communicates with image center 120 by connection to credentials verification service 304. Service 304 verifies an user's credentials by checking an input user identification number, organization identification number, user name, and password. Users are assigned a permission level to indicate whether they are authorized only to search for images or to both search for and purchase rights to images. Service 304 also maintains audit trails of system usage, such as connect time and login attempts, both for billing purposes and for tracing attempted unauthorized use of system 100. In a preferred embodiment, credentials verification service 304 is implemented partially on user workstation 130 and partially on image center 120, specifically database processor 124. It should be recognized, however, that other equivalent implementations could be used to achieve the function of credentials verification service 304. In an alternative embodiment, service 304 provides users with access to only a subset of the available images. Such limited access might be based on different archive groupings, e.g., for various image price levels or for certain photo agencies.
The uploading portion of the operation of uploading, archiving, watermarking, and indexing service 302 is described in the flow diagram of FIG. 8. Processing starts by invoking 801 an uploading tool to control subsequent processing. Next, the full-resolution version of an image to be uploaded is sent 802 to an archiving server, which is in a preferred embodiment a part of database processor 124. As previously described, the full-resolution image is stored for archiving purposes on a medium such as magnetic tape. The browse-resolution image is then sent 803 to browsing service 308. In a preferred embodiment, browsing service 308 is implemented using both browse processor 126 and database processor 124 and the browse image data are stored in database processor 124, but it should be recognized that other architectures could be used as well. Next, metadata are sent 804 to index querying service 306. In a preferred embodiment, index querying service 306 is implemented using both browse processor 126 and database processor 124 and the index image data are stored in database processor 124, but it should be recognized that other architectures could be used as well. Finally, licensing and pricing information are sent 805 to purchase/delivery service 310. In a preferred embodiment, purchase/delivery service 310 is implemented using both order processor 128 and database processor 124, but it should be recognized that other architectures could be used as well.
Referring now to FIG. 9, there is shown in greater detail how metadata are uploaded to index querying service 306. Processing begins by invoking 901 an index service upload process, which controls further processing flow. Next, the metadata for a current image are expanded and the next portion of the metadata are obtained. Specifically, each word is looked up, words that may be related are found based on stored links, and the looked-up word, along with any related words are displayed as the "expansion" of that word. Then, a check 903 is made to determine whether the current portion of data (e.g., the current word) corresponds to a proper name, a location, or something else. If the current portion corresponds to a name, a name expansion process is invoked 906 that displays the name and related names such as nicknames and other variants, based on linked name information already stored in a name database portion of database processor 124. If the current portion corresponds to a location, a location expansion process is invoked 904 that displays the location and related locations, such as "Arlington, Virginia" and "Arlington, Massachusetts" for "Arlington", based on linked location information already stored in a location database portion of database processor 124. If the current portion corresponds to neither a name nor a location, the portion is expanded 905 as explained above using semantic net links and weights based on information stored in semantic net link and weights portions of database processor 124. Strongly related concepts are given high weights, while more remotely related concepts are given lower weights, marking them as less exact matches. Thus, for a query on "car," captions containing "car" and "automobile" are listed highest, followed by those with "sedan," "coupe," and "convertible," and then by more remotely related concepts such as "transmission," "hood," and "trunk". In a preferred embodiment, four factors are used for weighting. First, the type of relationship (e.g., synonym, a kind of, a part of) is considered. Second, the closeness of the relationship, as determined by the number of links forming the relationship, is used. For example, the words "content" and "overjoyed" may be linked because "content" is linked as a synonym of "happy", which is in turn linked as a synonym of "joyous", which is in turn linked as a synonym of "overjoyed", but this relationship is not weighted strongly because three links are required to establish the relationship. Syntactic relations and word position within a caption are the final two factors. The head of a noun phrase is weighted more highly than modifiers, and nouns are weighted more highly than verbs. Words positioned at the beginning of the caption receive more weight than those later in the caption, and those in the first sentence of a caption are deemed more significant than those in subsequent sentences.
In any event, once the appropriate expansion is complete, the current portion of the metadata is stored 907 in an index database portion of database processor 124, is available for use in image searching as described below, and processing returns to 902 for the next portion of the metadata.
Uploading, archiving, watermarking, and indexing service 302 watermarks an image by overlaying the digital representation of an image with a digital watermark in a manner that allows the image to be viewed without obstruction on a computer monitor, but that prevents high-quality printout of the image and thereby prevents unlicensed use of images. Specifically, a mask corresponding to the shape of the watermark is "tiled" over the image to be marked, and the blue component (in the RGB color space) of those pixels of the image that overlap with the watermark are altered. The manner in which those pixels are altered results in an image that appears unchanged when viewed in low resolution on a computer monitor, but appears corrupted by the watermark when printed. Referring now also to FIG. 5, the watermarking operation is described in greater detail. When watermarking is invoked 501, the image to be watermarked is read 502 into memory. Once the image is read 502, a pixel from the image is obtained and a check 503 is performed to determine whether the current pixel is the last one in the image. If so, the image is written 504 to disk storage. Next, a formula is employed to determine 505 how the watermark will be positioned with respect to the image. In other words, a formula is employed to determine 505 whether any particular pixel from the image is to be corrupted by the watermark. If x and y represent, respectively, horizontal and vertical positions in an original image, and if a and b represent, respectively, vertical and horizontal positions in bitmap masks, and if watermark-- height and watermark-- width represent, respectively, the height and width of the watermark image in pixels, then in one embodiment, the formula used to determine the image pixel to bitmap pixel transformation is:
a=y modulus watermark-- height
b=x modulus watermark-- width Eq. 1
If equation 1 results in a determination that the current pixel is to be corrupted by the watermark, the pixel is modified by altering the blue component of the pixel in the RGB color space by a certain "offset" value. The offset depends on the brightness of the pixel. In one embodiment, the offset is retrieved 506 by use of the equation:
offset=(Brightness * MaxOffset)/MaxBrightness+MinOffset (Eq. 2)
where Brightness is the blue value of the pixel, MaxOffset is a constant that in this embodiment is set at 40, MaxBrightness is a maximum image brightness, usually 255, and MinOffset is a constant that in this embodiment is set at 10.
Once the offset is retrieved 506, a check 507 is performed to determine whether the brightness of the current pixel (i.e., the value of the blue component of the pixel) is above or below half of the maximum. If this blue brightness is over half, then the pixel is modified by subtracting 508 the offset value from the blue brightness value for that pixel. If this blue brightness is under half, then the pixel is modified by adding 509 the offset value to the blue brightness value. Either way, the modified blue value is then stored 510 in image memory for the current pixel, and processing flows back to check 503 to begin again for the next pixel. Thus, the watermark will stand out by being bright on a dark background and darker on a bright background. While this variation is only minimally perceptible when the image is viewed on a computer monitor based on an RGB color space, when the image is converted to CMYK color space for printing or other processing, the modifications to the blue intensity become vividly apparent in the yellow layer of such CMYK-based reproduction. Thus, the watermark allows virtually unnoticeable reproduction of an image on a computer monitor but prevents usable color hardcopy from being generated by the watermarked image.
Referring now to FIG. 10, there is shown a flow diagram for a search engine process in accordance with the present invention. Processing begins by a query arriving 1001 at the index service. In a preferred embodiment, search engine processing is primarily accomplished by operation of browse processor 126, although some portions are also accomplished by database processor 124 and a user workstation, e.g., 130. User input is obtained concerning the type of image that the user desires. For example, a user may type a query in ordinary English, such as "red trucks". Additionally, a user may enter query data into bibliographic fields, specifying, for example, images produced by a particular artist or agency. Finally, a user may also limit a query based on image characteristics such as predominant hue or image type, as described above in connection with FIG. 6. User queries may include standard Boolean connectors for interpretation in a conventional manner. A conventional user interface screen prompting the user to provide image specifications, as well as bibliographic data and image characteristics, is used to obtain such query information. The user may provide as much or as little information as desired, based on the user's requirements.
Once a user forms a complete query, it is sent to the index server 306 for processing. Any image characteristics in the query and bibliographic information in the query are processed as in conventional keyword search techniques. In a preferred embodiment, conventional keyword search techniques for bibliographic information are supplemented in several ways. First, bibliographic information pertaining to location of an image is stored in a location database and processed so that precise locations are tagged with more general location data. For example, an image of the Eiffel Tower may include bibliographic data stating the location as "Paris", but when stored in database processor 124, this location information will be encoded as "Paris, France" because an association has previously been entered into the database between Paris and France. Similarly, "Los Angeles" would be associated with "California" and "United States." A second related way in which conventional keyword searching is enhanced is by associating names and spellings with their common variants. Thus, nicknames "Beth", "Betsy" and "Liz" are associated with "Elizabeth". Similarly, "Stephen" and "Steven" are associated. Yet a third way in which enhancement over traditional keyword searching is achieved is by recognizing dates in any one of several formats, e.g., "March 17, 1994" or "17 March 1994" or 3/17/94" or "17 Mar 94" or "March 1994" or "1994".
Processing of the "free text" portion of a query for matching with captions or suggests field entries proceeds by tokenizing 1002 the input string of the query so that it is divided into a number of individual tokens, which may be single words or multiwords.
In order to determine whether a word should be treated independently or as part of a multiword, a variation of conventional pattern matching is used. Specifically, if a single word is recognized as matching a word that is part of a stored multiword, a decision on whether to treat the single word as part of a multiword is made based on the contents of the stored pattern and the input pattern. Stored patterns include not just literal words, but also syntactic categories (e.g., adjective, non-verb), semantic categories (e.g., nationality, verb of motion), or exact matches. If the input matches, or comes close to matching, the stored pattern information, then the input is interpreted as a multiword rather than independent words. Further explanation of such pattern matching is provided in C. Aone et al., SRA: DESCRIPTION OF THE SOLOMON SYSTEM AS USED FOR MUC-4, Proceedings of the Fourth Message Understanding Conference (MUC-4), sponsored by Defense Advanced Research Projects Agency, June 1992, McLean, Va., pp. 259-267, which is incorporated herein by reference.
A part-of-speech tagger then makes use of linguistic and statistical information to tag 1003 the parts of speech of incoming query portions. Implementation of such taggers is well known and is described, for example, in Strzalkowski (1993) incorporated by reference above. Only words that match by part of speech are considered to match, and if two or more parts of speech are possible for a particular word, it is tagged with both.
After tagging 1003 parts of speech, word affixes (i.e., suffixes) are stripped 1004 from query words to obtain a word root, in accordance with conventional inflectional morphology. If a word in a query is not known, affixes are stripped from the word one-by-one until a known word is found. If such a root word is found, the word is understood to mean the root word, plus any information that may be gleaned from the stripped affix. For instance, the word "walked" is stripped to "walk", and the "ed" affix is interpreted as past tense. Further details on implementing such affix-stripping functionality is provided in Strzalkowski (1993), incorporated by reference above. In an alternative embodiment, derivational morphology is used for affix-stripping.
Processing then checks 1005 to determine whether the resulting word is a function word or a content word. If it is a function word, it is ignored 1006. If not, the concepts of that word in each of its senses are retrieved 1007 from a semantic net database portion of database processor 124.
In retrieving concepts 1007, not only single words, but groups of words, are processed. To begin with, words are grouped based on identified parts of speech to obtain noun phrases consisting of adjacent nouns and adjectives. For instance, the adjacent words "window glass" in a query are grouped to form a noun phrase. Then, a head noun is identified as that noun which is most salient in the phrase, based on the relative position of the words in the phrase. In the "window glass" example, "glass" would be the head noun because of its position after "window". A second grouping of words or noun phrases is used to identify subjects and objects in a query. It should be recognized that this identification may be based not only on relative positions of words, but also on whether the verb linking two noun phrases is active or passive and other sentence information, e.g., whether the verb is a "middle" verb as in "The window broke" (i.e., got broken) as opposed to "The hammer broke the window" (which is understood to mean that the window, not the hammer, got broken). Using these techniques, distinction is possible between similar looking query pairs "window glass" and "glass window", "red fish in blue coral" and "blue fish in red coral", and "man bites dog" and "dog bites man." Further description of such syntactic processing in the context of text retrieval systems is found in the two Strzalkowski articles incorporated by reference above.
Once concepts are retrieved 1007, a check 1008 is made to determine whether the word root is known by database processor 124. If not, the word is treated 1009 as a keyword, requiring an exact match. Otherwise, the word is identified 1010, as a special type of word as appropriate. Multiwords are identified so that they may be matched as a whole unit rather than independent words to prevent, for instance, a query for "prairie dogs" retrieving with strong weighting a caption reading "In the prairie dogs frolic". Similarly, names and locations are identified so that the separate name and location database portions may be searched for such terms. Next, noun phrases and other syntactical information is identified 1011, as appropriate. Thus, information is obtained 1010 or 1011 as to both types of words, e.g., multiwords, names, or locations, and syntax.
An intermediate query is then formulated 1012 to match 1013 against information stored in database processor 124 corresponding to stored images. This formulation includes recognizing that the juxtaposition of certain words implicitly imposes Boolean relationships. For example, a sentence that reads "A black cat . . . " may be interpreted so as to formulate an intermediate query of the form "black AND cat . . . " so that retrieved images have both the concept "black" and the concept "cats". Explicitly stated Boolean relations are interpreted as written by treating words such as "AND", "OR", "BUT", "WITHOUT", "EXCEPT", and "NOT" as concepts for linking search terms rather than as search terms.
Captions that match queries are then returned 1014, ranked and displayed to the user, with those captions that match the query best being placed at the top of the list, and with matches of equal weighting being randomized so that no one of such images receives more prominent display than others time after time. The determination of whether a caption matches a query and which captions match better than others is made by the use of weights corresponding to the associations made between words and related concepts, and by weights corresponding to the number and location of matching elements. For instance, if a query includes the word "car" and a match is found based on the related concept "automobile", that would be considered a very strong match because "car" and "automobile" are synonyms. If, however, the match to the query word "car" was found based on the weakly related concept "transmission", that would be considered a weaker match. Weight data for related concepts is maintained in a weight database portion of database processor 124.
As with other known semantic net retrieval systems, matches among less common elements are considered more important than matches among more common elements. For example if the query contains the words "man" and "xylophone", matches of "xylophone" are given a higher ranking than matches of "man."
Similarly, syntactic information is used for weighting after the word-by-word processing so that a noun phrase that forms the subject in the first sentence is given more weight than, say, a word in a noun phrase that is part of the object of the second sentence of a caption. In one embodiment, the first sentence of a caption is weighted more strongly than subsequent sentences, and heads of noun phrases are weighted more heavily than modifiers, nouns are considered more important than other parts of speech, subjects are considered more important than objects, both subjects and objects are given greater weight than obliques, i.e., indirect objects and objects of prepositional phrases.
Once some matching captions are retrieved for the user and reviewed along with their corresponding images, further searches may be made by the user specifying selected matches that come most close to the desired image. Those matches are then used to generate second-level queries, and the process may continue iteratively as desired by the user. Such querying by example may, in one embodiment, encompass two modes. In a first mode, the caption of a retrieved image is used directly as the query for a subsequent search. In a second mode, the bibliographic data for a retrieved image are used as a query so that images with similar bibliographic data are retrieved. From a user's perspective, such iterative querying is implemented by selecting the desired image using mouse clicks, and dragging the image into either the structured description area or the bibliographic area of the screen. The caption or the bibliographic data from the selected image is then copied to form the new query, just as if the same information had been input directly by the user, and the user may make further additions, deletions, or modifications to this information as desired.
In one embodiment, the searching discussed above in connection with FIG. 10 is implemented by first building a B-tree of "ID lists", one for each concept in the database of captions. ID lists have an entry for each image object whose description contains a reference to the given concept. An entry consists of an image ID and a weight. The image ID provides a unique identifier of the image object and is a positive integer assigned at the time that the image object is indexed. The weight reflects the relevancy of the concept to the image object description and is a positive integer determined by the expansion process described above. A weight range of 0 to 100 is used in this embodiment, although it should be recognized that other weight ranges could be used. For instance, a weight range of 0 to 100,000 could be used to achieve greater ranking discrimination. ID list entries are sorted by image ID, from smallest to largest, within a given ID list.
To add an image description to an existing index, the image ID and a weight are inserted into the ID list of every concept that is in any way relevant to the description. For searching, the ID lists of every concept in the query are retrieved and combined according to the Boolean operations indicated by the query. Since ID lists contain IDs with weights in sorted order, the Boolean operations determine both the existence and relevancy at the same time and with great speed, using only a small number of processor instructions per concept-image pair.
Boolean operators implemented in this embodiment include OR, AND, NOT and "non-exclusive AND". The rank of an ORed image object is the maximum of its weight in the two operand lists, while it is the sum for AND image objects. NOT has no effect on weights. Non-exclusive AND affects the left hand operand only by incrementing the weights of any IDS that are in common with the right hand operand, but does not compute the intersection. Thus, finer control of relevancy ranking is achieved by augmenting image weights without performing a strict intersection of search terms.
In an extension of the embodiment described above, ID lists are generalized to handle relations between concepts in an image description. Arbitrarily complex relations between numerous concepts are representable in a single index database and image objects with similar relations can be found quickly and ranked. Each relation type consists of an arbitrary number of unique constituents or "roles". Some of such roles are required for the existence of a particular type of relation, while others are optional. The key used to store and retrieve the ID list of a constituent concept is based both on the concept and its role in the relation, rather than just the concept. Each different instance of the same relation type within an image description is assigned a unique "group number", stored along with the ID and weight in the ID list. ID lists for relations thus include the image ID, group number and weight. During retrieval, an AND operation is applied to the ID lists of the concepts that make up the required roles, while a non-exclusive AND operation is applied to the remaining ID lists. Within the AND, OR, NOT and non-exclusive AND of relation indexing, the image ID and group number together are considered as a unique identifier, so a given image ID may occur multiple times in a list with different and unique group numbers. With these ideas of roles, groups, and modified Boolean operations, an unlimited number of relation types can be saved and retrieved from the same database with all the benefits of ID list indexing discussed above. Also, the same role can appear in multiple relations and needs to be stored once, and new relations between existing roles can be implemented on an index without changing the index.
An extension to relation indexing is the use of compound relations--relations between relations and concepts. The required roles of a compound relation are those of the constituent relations as well as any new required roles introduced by the compound relation. Saving and retrieving of compound relations are performed as with other relations.
A further extension to custom indexing is an option of changing the order of concept expansion. Rather than expanding concepts before adding them to the index during upload processing, the concepts in the query are expanded. Since the implicit weight of non-expanded concepts is 100 (or whatever the maximum is), weights do not need to be stored with each ID list entry. An entry consists of an image ID for concept indexing, and an image ID and a group for relation indexing. During the retrieval process, concepts in the query are expanded and assigned weights. The ID lists corresponding to these expanded concepts are retrieved from the database, the assigned weights are applied to the entries of each ID list, and an exclusive OR operation is performed on the expanded concept ID lists and the query concept itself (which has a weight of 100). The result is then constructed as described above. Using this extension, storage requirements are reduced at the cost of increased processing. Furthermore, this extension facilitates control over the extent of expansion, or so-called "fuzziness" in the search, as the user may desire.
Referring now to FIG. 11, there are shown communication layers used in system 100. Two levels of communications are provided for image center 120. The first layer concerns communications between users, e.g., user workstation 130, and the image center 120. The second layer concerns communications between clients, e.g., user agent facilities within user workstation 130, and servers, e.g., browse processor 126.
In a preferred embodiment, a user workstation connects to image center 120 by use of a communications link 1130, e.g., a modem, using conventional protocols. An additional client 1120 following the xUPP protocol acts as a communications manager to route communications from user workstation 130 to an appropriate service, e.g., 1110, 1111. In one embodiment, a single client 1120 is used for multiple user workstations. In an alternate embodiment, a separate client 1120 is provided for each user workstation 130. TCP is used in a conventional manner for communication between the user agent of workstation 130 and xUPP processor 1120. Conventional communications applications provide intermediate layers of communication protocol.
Referring now to FIG. 12, there is shown a match list screen 1200 that is displayed to a user upon completing search engine processing as described in connection with FIG. 10. Screen 1200 displays the number of hits 1208 generated as a result of the search, provides a number of "select" buttons, e.g., 1202 by which the user can choose certain candidate matches for further examination, and provides a color coded "match" area 1204 for each hit that indicates the relative strength of the match for that hit. In a preferred embodiment, the more of the color blue that appears in the "match" area 1204, the stronger the hit. A "description" area 1206 presents the caption for each hit. A conventional scroll bar 1210 permits the user to view additional hits. A match list commands area 1212 provides buttons for the user to select all hits, indicates whether more hits than a preselected maximum number were found, allows the user to view those additional hits, and provides a "view" button to allow the user to enter "browsing" mode to browse the images of the hits that the user has selected. User interface selections in match list commands area 1212 also permit the user to alter the display to provide additional information about the matches, such as bibliographical information.
Referring now to FIG. 13, there is shown an image browser screen 1300 that is displayed to the user when the view button is selected from screen 1200. The browser displays "thumbnail" versions 1302, 1304, 1306, 1308 of the images the user selected in the match list screen 1200, as well as the first line of the caption (a caption "snippet") from each such image. The user may view the full caption for any picture and caption snippet, e.g., 1302, by placing a cursor over the snippet and clicking on a mouse button. A larger version of any picture may be displayed by placing a cursor over the picture portion of a picture and caption snippet, e.g., 1302, clicking a mouse button once, and then clicking on a "full-size" or "quarter-size" button in browse commands area 1312. Bibliographic information may similarly be obtained by clicking once on a picture and caption snippet, e.g., 1302, and then clicking on an "info" button in browse commands area 1312. Scroll bar 1310 allows the user to view additional images.
Referring now to FIG. 14, there is illustrated the info screen 1400 that is displayed if the user clicks on the "info" button in screen 1300. Info screen 1400 displays a small version of the selected picture 1402, the complete caption 1404 for the picture, and the complete bibliographic information for the picture 1406. Info screen commands area 1412 displays buttons by which the user may see the picture in quarter-size or full-size, and by which the user may obtain pricing information for the picture.
Referring now to FIG. 15 there is shown a lightbox screen 1500 that is displayed when the user selects a "lightbox" button from browse commands area 1312 of screen 1300. Lightbox screen 1500 allows a user to select an image from browse screen 1300 and save it for later examination in lightbox screen 1500. When lightbox screen 1500 is displayed, a user may double-click on a picture and caption snippet, e.g., 1502, 1504, to obtain information, provided by info screen 1400, related to the selected image. As with the other screens, lightbox screen 1500 provides a scroll bar 1510 and also provides user commands via lightbox commands area 1512. The available commands are export of a selected image to a hard disk file, pricing information for an image, a notepad area for user notes concerning an image, and a command to delete a selected picture and caption snippet, e.g., 1502, from the lightbox screen 1500.
Referring now also to FIG. 16, if the user selects the pricing button from lightbox commands area 1512 or info screen commands area 1412, pricing screen 1600 is displayed, enabling the user to purchase rights to, and obtain delivery of, selected images through purchase/delivery service 310 of FIG. 3 using order processor 128 of FIG. 1. Screen 1600 displays a small version of the picture 1602, a unique number by which the image is indexed in area 1606, the full caption 1604 of the image, and usage and pricing information 1608 relating to the image. A pricing screen commands area 1612 permits the user to order an image, attach messages to an order negotiation request, or cancel the current session. Usage and pricing information displays the prices and other terms under which the image may be licensed, based on conventional factors such as the size of the intended display of the image, the circulation of any newspaper or magazine in which the image is to be used, and so forth. Once the user specifies all of the requested information concerning the intended use of the image, the license fee for the image is either determined by application of the entered information to an agent-provided pricing table, or a message is displayed that the artist or agent has stipulated that the desired use calls for negotiation of a price. In the latter instance, the user may initiate the negotiation process and may, using a button on the pricing screen commands area, send a message along with the negotiation request.
If the image does not require further negotiation, the user may specify ordering information such as desired format of the image file and delivery information. The user may receive the image file electronically, or it may be sent in film or slide form from the stock agency. For electronic delivery, a conventional bulletin board service is employed to allow the user to obtain the full resolution image. A file corresponding to the full resolution image is transferred from the storage medium on which it was archived, and placed, using database processor 124 and order processor 128, onto the bulletin board for retrieval by the user. In a preferred embodiment, the user is notified before finalizing the order of the full scope of the license to use the desired image, and of other legal issues concerning use of the image, such as copyright considerations and rights of publicity that may be involved. Order processor 128 operates conventionally to prepare bills and other financial documents pertaining to licensing transactions completed over system 100.
Therefore, image archiving and retrieval is achieved by associating metadata with images, using natural language processing to search for images corresponding to a query, and providing ordering and delivery of selected full-resolution images.
The above description is included to illustrate the operation of the preferred embodiments and is not meant to limit the scope of the invention. The scope of the invention is to be limited only by the following claims. From the above discussion, many variations will be apparent to one skilled in the art that would yet be encompassed by the spirit and scope of the invention. For instance, it should be recognized that the term "image" or "picture" herein should be interpreted to mean not only "photograph", but any object capable of multimedia presentation, whether a photograph, graphic drawing, video clip, audio clip, motion picture, animation, or other object.
|Brevet cité||Date de dépôt||Date de publication||Déposant||Titre|
|US4695975 *||23 oct. 1984||22 sept. 1987||Profit Technology, Inc.||Multi-image communications system|
|US4829423 *||3 avr. 1987||9 mai 1989||Texas Instruments Incorporated||Menu-based natural language understanding system|
|US4833610 *||7 mars 1988||23 mai 1989||International Business Machines Corporation||Morphological/phonetic method for ranking word similarities|
|US4849898 *||18 mai 1988||18 juil. 1989||Management Information Technologies, Inc.||Method and apparatus to identify the relation of meaning between words in text expressions|
|US5109439 *||12 juin 1990||28 avr. 1992||Horst Froessl||Mass document storage and retrieval system|
|US5197005 *||1 mai 1989||23 mars 1993||Intelligent Business Systems||Database retrieval system having a natural language interface|
|US5237503 *||28 oct. 1991||17 août 1993||International Business Machines Corporation||Method and system for automatically disambiguating the synonymic links in a dictionary for a natural language processing system|
|US5263159 *||18 sept. 1990||16 nov. 1993||International Business Machines Corporation||Information retrieval based on rank-ordered cumulative query scores calculated from weights of all keywords in an inverted index file for minimizing access to a main database|
|US5265014 *||14 févr. 1992||23 nov. 1993||Hewlett-Packard Company||Multi-modal user interface|
|US5386556 *||23 déc. 1992||31 janv. 1995||International Business Machines Corporation||Natural language analyzing apparatus and method|
|EP0597630A1 *||4 nov. 1993||18 mai 1994||Conquest Software Inc.||Method for resolution of natural-language queries against full-text databases|
|Brevet citant||Date de dépôt||Date de publication||Déposant||Titre|
|US5659726 *||23 févr. 1995||19 août 1997||Sandford, Ii; Maxwell T.||Data embedding|
|US5666451 *||29 déc. 1995||9 sept. 1997||Daewoo Electronics Co., Ltd.||Video compact disc having caption data recorded thereon and reproducing method and apparatus thereof|
|US5706507 *||5 juil. 1995||6 janv. 1998||International Business Machines Corporation||System and method for controlling access to data located on a content server|
|US5708805 *||12 oct. 1993||13 janv. 1998||Matsushita Electric Industrial Co., Ltd.||Image retrieving apparatus using natural language|
|US5729741 *||10 avr. 1995||17 mars 1998||Golden Enterprises, Inc.||System for storage and retrieval of diverse types of information obtained from different media sources which includes video, audio, and text transcriptions|
|US5745754 *||7 juin 1995||28 avr. 1998||International Business Machines Corporation||Sub-agent for fulfilling requests of a web browser using an intelligent agent and providing a report|
|US5752244 *||15 juil. 1996||12 mai 1998||Andersen Consulting Llp||Computerized multimedia asset management system|
|US5760917 *||16 sept. 1996||2 juin 1998||Eastman Kodak Company||Image distribution method and system|
|US5778372 *||18 avr. 1996||7 juil. 1998||Microsoft Corporation||Remote retrieval and display management of electronic document with incorporated images|
|US5796945 *||7 juin 1995||18 août 1998||Tarabella; Robert M.||Idle time multimedia viewer method and apparatus for collecting and displaying information according to user defined indicia|
|US5802524 *||29 juil. 1996||1 sept. 1998||International Business Machines Corporation||Method and product for integrating an object-based search engine with a parametrically archived database|
|US5819289 *||13 mai 1997||6 oct. 1998||The Regents Of The University Of California||Data embedding employing degenerate clusters of data having differences less than noise value|
|US5822432 *||17 janv. 1996||13 oct. 1998||The Dice Company||Method for human-assisted random key generation and application for digital watermark system|
|US5825892 *||28 oct. 1996||20 oct. 1998||International Business Machines Corporation||Protecting images with an image watermark|
|US5832495 *||8 juil. 1996||3 nov. 1998||Survivors Of The Shoah Visual History Foundation||Method and apparatus for cataloguing multimedia data|
|US5852823 *||16 oct. 1996||22 déc. 1998||Microsoft||Image classification and retrieval system using a query-by-example paradigm|
|US5873076 *||15 sept. 1995||16 févr. 1999||Infonautics Corporation||Architecture for processing search queries, retrieving documents identified thereby, and method for using same|
|US5893101 *||28 mars 1997||6 avr. 1999||Systems Research & Applications Corporation||Protection of an electronically stored image in a first color space by the alteration of digital component in a second color space|
|US5895464 *||30 avr. 1997||20 avr. 1999||Eastman Kodak Company||Computer program product and a method for using natural language for the description, search and retrieval of multi-media objects|
|US5911131 *||20 déc. 1995||8 juin 1999||Vig; Tommy||Computer aided calculation, appraisal and valuation of works of art|
|US5926624 *||12 sept. 1996||20 juil. 1999||Audible, Inc.||Digital information library and delivery system with logic for generating files targeted to the playback device|
|US5929857 *||10 sept. 1997||27 juil. 1999||Oak Technology, Inc.||Method and apparatus for dynamically constructing a graphic user interface from a DVD data stream|
|US5930783 *||29 août 1997||27 juil. 1999||Nec Usa, Inc.||Semantic and cognition based image retrieval|
|US5930802 *||29 nov. 1996||27 juil. 1999||Daewoo Electronics Co., Ltd.||Method for automatically linking index data with image data in a search system|
|US5946113 *||29 mars 1996||31 août 1999||Silicon Graphics, Inc.||System and method for color space conversion|
|US5948054 *||27 févr. 1996||7 sept. 1999||Sun Microsystems, Inc.||Method and system for facilitating the exchange of information between human users in a networked computer system|
|US5970140 *||8 mai 1996||19 oct. 1999||The Regents Of The University Of California||Modular error embedding|
|US5978820 *||29 mars 1996||2 nov. 1999||Hitachi, Ltd.||Text summarizing method and system|
|US5983218 *||30 juin 1997||9 nov. 1999||Xerox Corporation||Multimedia database for use over networks|
|US5983229 *||5 juin 1997||9 nov. 1999||Eastman Kodak Company||Extension persistence mechanism for a digital image format|
|US6016520 *||14 juil. 1995||18 janv. 2000||Microsoft Corporation||Method of viewing at a client viewing station a multiple media title stored at a server and containing a plurality of topics utilizing anticipatory caching|
|US6021412 *||2 avr. 1996||1 févr. 2000||Microsoft Corporation||Method and system for automatically adding graphics to a document to illustrate concepts referred to therein|
|US6044375 *||30 avr. 1998||28 mars 2000||Hewlett-Packard Company||Automatic extraction of metadata using a neural network|
|US6055543 *||21 nov. 1997||25 avr. 2000||Verano||File wrapper containing cataloging information for content searching across multiple platforms|
|US6058398 *||24 mai 1999||2 mai 2000||Daewoo Electronics Co., Ltd.||Method for automatically linking index data with image data in a search system|
|US6104468 *||29 juin 1998||15 août 2000||Eastman Kodak Company||Image movement in a photographic laboratory|
|US6115717 *||30 juin 1997||5 sept. 2000||Eastman Kodak Company||System and method for open space metadata-based storage and retrieval of images in an image database|
|US6138162||11 févr. 1997||24 oct. 2000||Pointcast, Inc.||Method and apparatus for configuring a client to redirect requests to a caching proxy server based on a category ID with the request|
|US6147772 *||4 mai 1999||14 nov. 2000||Silicon Graphics, Inc.||System and method for color space conversion using an extended color space|
|US6154755 *||31 juil. 1996||28 nov. 2000||Eastman Kodak Company||Index imaging system|
|US6161108 *||9 janv. 1998||12 déc. 2000||Justsystem Corp.||Method and apparatus for managing images, a method and apparatus for retrieving images, and a computer-readable recording medium with a program for making a computer execute the methods stored therein|
|US6173311||13 févr. 1997||9 janv. 2001||Pointcast, Inc.||Apparatus, method and article of manufacture for servicing client requests on a network|
|US6212527||2 nov. 1998||3 avr. 2001||Survivors Of The Shoah Visual History Foundation||Method and apparatus for cataloguing multimedia data|
|US6233547||8 déc. 1998||15 mai 2001||Eastman Kodak Company||Computer program product for retrieving multi-media objects using a natural language having a pronoun|
|US6247031 *||7 juin 1995||12 juin 2001||Minolta Co., Ltd.||Image filing system for memorizing images read from a given document together with small characterizing image|
|US6286036||15 déc. 1999||4 sept. 2001||Digimarc Corporation||Audio- and graphics-based linking to internet|
|US6301581 *||1 août 1994||9 oct. 2001||Texas Instruments Incorporated||Method and system for managing access to a plurality of data objects|
|US6321231 *||11 août 1997||20 nov. 2001||Marshall, O'toole, Gerstein, Murray & Borun||Data management and order delivery system|
|US6324573||6 août 1998||27 nov. 2001||Digimarc Corporation||Linking of computers using information steganographically embedded in data objects|
|US6332031||14 juil. 2000||18 déc. 2001||Digimarc Corporation||Multiple watermarking techniques for documents and other data|
|US6332146||19 juil. 2000||18 déc. 2001||Marshall, O'toole, Gerstein, Murray & Borun||Method and apparatus for storing and printing digital images|
|US6366296 *||11 sept. 1998||2 avr. 2002||Xerox Corporation||Media browser using multimodal analysis|
|US6374260 *||28 févr. 2000||16 avr. 2002||Magnifi, Inc.||Method and apparatus for uploading, indexing, analyzing, and searching media content|
|US6405198 *||4 sept. 1998||11 juin 2002||International Business Machines Corporation||Complex data query support in a partitioned database system|
|US6408331||29 sept. 1999||18 juin 2002||Digimarc Corporation||Computer linking methods using encoded graphics|
|US6411725||20 juin 2000||25 juin 2002||Digimarc Corporation||Watermark enabled video objects|
|US6421070 *||1 oct. 1998||16 juil. 2002||Digimarc Corporation||Smart images and image bookmarking for an internet browser|
|US6442555 *||26 oct. 1999||27 août 2002||Hewlett-Packard Company||Automatic categorization of documents using document signatures|
|US6463432 *||2 août 1999||8 oct. 2002||Minolta Co., Ltd.||Apparatus for and method of retrieving images|
|US6490681||14 juil. 1998||3 déc. 2002||International Business Machines Corporation||Electronic watermarking system|
|US6507841 *||19 févr. 1999||14 janv. 2003||Hewlett-Packard Company||Methods of and apparatus for refining descriptors|
|US6519351||26 oct. 2001||11 févr. 2003||Hitachi, Ltd.||Method and apparatus for recording and reproducing electronic watermark information, and recording medium|
|US6522767||30 mars 1999||18 févr. 2003||Wistaria Trading, Inc.||Optimization methods for the insertion, protection, and detection of digital watermarks in digitized data|
|US6522770||1 août 2000||18 févr. 2003||Digimarc Corporation||Management of documents and other objects using optical devices|
|US6526158||3 sept. 1997||25 févr. 2003||David A. Goldberg||Method and system for obtaining person-specific images in a public venue|
|US6526171 *||30 juin 1999||25 févr. 2003||Hitachi, Ltd.||Image object managing method, an image processing apparatus using said method, and a recording media for programs achieving the same|
|US6535614||24 août 1998||18 mars 2003||Hitachi, Ltd.||Method and apparatus for recording and reproducing electronic watermark information, and recording medium|
|US6549911||16 févr. 2001||15 avr. 2003||Survivors Of The Shoah Visual History Foundation||Method and apparatus for cataloguing multimedia data|
|US6560651||19 janv. 1999||6 mai 2003||Audible, Inc.||Digital information library and delivery system with logic for generating files targeting a playback device|
|US6564225 *||14 juil. 2000||13 mai 2003||Time Warner Entertainment Company, L.P.||Method and apparatus for archiving in and retrieving images from a digital image library|
|US6567983||12 avr. 1999||20 mai 2003||Fuji Photo Film Co., Ltd.||Electronic album producing and viewing system and method|
|US6574350||3 févr. 2000||3 juin 2003||Digimarc Corporation||Digital watermarking employing both frail and robust watermarks|
|US6574638||12 sept. 2000||3 juin 2003||Survivors Of The Shoah Visual History Foundation||Method and apparatus for cataloguing multimedia data using surveying data|
|US6577746||28 déc. 1999||10 juin 2003||Digimarc Corporation||Watermark-based object linking and embedding|
|US6581071||12 sept. 2000||17 juin 2003||Survivors Of The Shoah Visual History Foundation||Surveying system and method|
|US6590996||19 avr. 2000||8 juil. 2003||Digimarc Corporation||Color adaptive watermarking|
|US6590998||1 août 2001||8 juil. 2003||Digimarc Corporation||Network linking method using information embedded in data objects that have inherent noise|
|US6608919||29 févr. 2000||19 août 2003||Digimarc Corporation||Method and apparatus for encoding paper with information|
|US6611607 *||15 mars 2000||26 août 2003||Digimarc Corporation||Integrating digital watermarks in multimedia content|
|US6625297||10 févr. 2000||23 sept. 2003||Digimarc Corporation||Self-orienting watermarks|
|US6636615||3 nov. 1999||21 oct. 2003||Digimarc Corporation||Methods and systems using multiple watermarks|
|US6647130||3 juil. 2002||11 nov. 2003||Digimarc Corporation||Printable interfaces and digital linking with embedded codes|
|US6681028||19 mai 1999||20 janv. 2004||Digimarc Corporation||Paper-based control of computer systems|
|US6690813 *||21 mai 2002||10 févr. 2004||Hitachi, Ltd.||Method and apparatus for recording and reproducing electronic watermark information, and recording medium|
|US6694042||8 avr. 2002||17 févr. 2004||Digimarc Corporation||Methods for determining contents of media|
|US6694043||8 avr. 2002||17 févr. 2004||Digimarc Corporation||Method of monitoring print data for text associated with a hyperlink|
|US6704739||4 janv. 1999||9 mars 2004||Adobe Systems Incorporated||Tagging data assets|
|US6721440||2 juil. 2001||13 avr. 2004||Digimarc Corporation||Low visibility watermarks using an out-of-phase color|
|US6725221||25 juin 2002||20 avr. 2004||Hitachi Ltd||Image data transfer method and system therefor|
|US6728390||7 déc. 2001||27 avr. 2004||Digimarc Corporation||Methods and systems using multiple watermarks|
|US6728700 *||3 mai 1999||27 avr. 2004||International Business Machines Corporation||Natural language help interface|
|US6744906||7 déc. 2001||1 juin 2004||Digimarc Corporation||Methods and systems using multiple watermarks|
|US6745186||17 août 2000||1 juin 2004||Eastman Kodak Company||Product and method for organizing and searching digital images|
|US6754377||6 juin 2002||22 juin 2004||Digimarc Corporation||Methods and systems for marking printed documents|
|US6788800||25 juil. 2000||7 sept. 2004||Digimarc Corporation||Authenticating objects using embedded data|
|US6799180||7 sept. 2000||28 sept. 2004||Sony United Kingdom Limited||Method of processing signals and apparatus for signal processing|
|US6804376 *||28 mars 2002||12 oct. 2004||Digimarc Corporation||Equipment employing watermark-based authentication function|
|US6804377||2 avr. 2002||12 oct. 2004||Digimarc Corporation||Detecting information hidden out-of-phase in color channels|
|US6804684 *||7 mai 2001||12 oct. 2004||Eastman Kodak Company||Method for associating semantic information with multiple images in an image database environment|
|US6807558||2 juin 1998||19 oct. 2004||Pointcast, Inc.||Utilization of information “push” technology|
|US6813618||18 août 2000||2 nov. 2004||Alexander C. Loui||System and method for acquisition of related graphical material in a digital graphics album|
|US6823075||2 févr. 2001||23 nov. 2004||Digimarc Corporation||Authentication watermarks for printed objects and related applications|
|US6829368||24 janv. 2001||7 déc. 2004||Digimarc Corporation||Establishing and interacting with on-line media collections using identifiers in media signals|
|US6901378 *||2 mars 2000||31 mai 2005||Corbis Corporation||Method and system for automatically displaying an image and a product in a page based on contextual interaction and metadata|
|US6904454 *||20 mars 2002||7 juin 2005||Nokia Corporation||Method and apparatus for content repository with versioning and data modeling|
|US6922489 *||29 oct. 1998||26 juil. 2005||Canon Kabushiki Kaisha||Image interpretation method and apparatus|
|US6938032 *||13 avr. 2000||30 août 2005||Conjoin, Inc.||Presentation builder|
|US6950989 *||20 déc. 2000||27 sept. 2005||Eastman Kodak Company||Timeline-based graphical user interface for efficient image database browsing and retrieval|
|US6965864 *||10 avr. 1995||15 nov. 2005||Texas Instruments Incorporated||Voice activated hypermedia systems using grammatical metadata|
|US6972757 *||3 janv. 2002||6 déc. 2005||President Of The University Of Tokyo||Pseudo 3-D space representation system, pseudo 3-D space constructing system, game system and electronic map providing system|
|US6975746 *||25 août 2003||13 déc. 2005||Digimarc Corporation||Integrating digital watermarks in multimedia content|
|US6976036 *||6 nov. 2001||13 déc. 2005||Science Applications International Corporation||Database management system|
|US7007166||7 avr. 2000||28 févr. 2006||Wistaria Trading, Inc.||Method and system for digital watermarking|
|US7007243||20 déc. 2000||28 févr. 2006||Eastman Kodak Company||Method and apparatus for producing digital images with embedded image capture location icons|
|US7010751||15 oct. 2001||7 mars 2006||University Of Maryland, College Park||Methods for the electronic annotation, retrieval, and use of electronic images|
|US7020609||16 mars 2001||28 mars 2006||Texas Instruments Incorporated||Voice activated apparatus for accessing information on the World Wide Web|
|US7020848 *||20 déc. 2000||28 mars 2006||Eastman Kodak Company||Comprehensive, multi-dimensional graphical user interface using picture metadata for navigating and retrieving pictures in a picture database|
|US7028050||10 mars 2000||11 avr. 2006||Canon Kabushiki Kaisha||Data display apparatus and data display method|
|US7028253||10 oct. 2000||11 avr. 2006||Eastman Kodak Company||Agent for integrated annotation and retrieval of images|
|US7050201||14 août 2003||23 mai 2006||Digimarc Corporation||Method and apparatus for encoding paper with information|
|US7051019 *||17 août 1999||23 mai 2006||Corbis Corporation||Method and system for obtaining images from a database having images that are relevant to indicated text|
|US7051086||9 mars 2001||23 mai 2006||Digimarc Corporation||Method of linking on-line data to printed documents|
|US7095871 *||5 avr. 2002||22 août 2006||Digimarc Corporation||Digital asset management and linking media signals with related data using watermarks|
|US7095874||18 févr. 2003||22 août 2006||Wistaria Trading, Inc.||Optimization methods for the insertion, protection, and detection of digital watermarks in digitized data|
|US7096425 *||2 déc. 1999||22 août 2006||Fujitsu Limited||Dictionary apparatus for preparing and displaying form with keyword entries from entered word string|
|US7099855 *||3 janv. 2001||29 août 2006||International Business Machines Corporation||System and method for electronic communication management|
|US7107451||22 févr. 2001||12 sept. 2006||Wistaria Trading, Inc.||Optimization methods for the insertion, protection, and detection of digital watermarks in digital data|
|US7107520 *||18 nov. 2002||12 sept. 2006||Hewlett-Packard Development Company, L.P.||Automated propagation of document metadata|
|US7111168||21 févr. 2001||19 sept. 2006||Digimarc Corporation||Digital watermarking systems|
|US7113921||8 déc. 2004||26 sept. 2006||Corbis Corporation||Method and system for automatically displaying an image and a product in a page based on contextual interaction and metadata|
|US7123295 *||22 août 2001||17 oct. 2006||Hewlett-Packard Development Company, L.P.||Memory management in an image capturing device|
|US7152162||30 déc. 2004||19 déc. 2006||Wistaria Trading, Inc.||Z-transform implementation of digital watermarks|
|US7171018||15 mai 2002||30 janv. 2007||Digimarc Corporation||Portable devices and methods employing digital watermarking|
|US7177798 *||21 mai 2001||13 févr. 2007||Rensselaer Polytechnic Institute||Natural language interface using constrained intermediate dictionary of results|
|US7181434 *||5 déc. 2003||20 févr. 2007||Industrial Technology Research Institute||Method for converting high level motion scripts to computer animations|
|US7197698 *||14 janv. 2004||27 mars 2007||Canon Kabushiki Kaisha||Information processing method and apparatus|
|US7197707 *||20 févr. 2001||27 mars 2007||Canon Kabushiki Kaisha||Automatically selecting fonts|
|US7266535||7 déc. 2005||4 sept. 2007||International Business Machines Corporation||System and method for electronic communication management|
|US7272593 *||26 janv. 1999||18 sept. 2007||International Business Machines Corporation||Method and apparatus for similarity retrieval from iterative refinement|
|US7272788 *||27 févr. 2001||18 sept. 2007||Fotomedia Technologies, Llc||Client-server system for merging of metadata with images|
|US7287029||25 sept. 2003||23 oct. 2007||Adobe Systems Incorporated||Tagging data assets|
|US7287222 *||27 janv. 2003||23 oct. 2007||Canon Kabushiki Kaisha||Information processing apparatus and method that determines effectiveness of metadata for editing information content|
|US7287275||17 avr. 2003||23 oct. 2007||Moskowitz Scott A||Methods, systems and devices for packet watermarking and efficient provisioning of bandwidth|
|US7343492||5 oct. 2005||11 mars 2008||Wistaria Trading, Inc.||Method and system for digital watermarking|
|US7346472||7 sept. 2000||18 mars 2008||Blue Spike, Inc.||Method and device for monitoring and analyzing signals|
|US7362775||2 juil. 1996||22 avr. 2008||Wistaria Trading, Inc.||Exchange mechanisms for digital information packages with bandwidth securitization, multichannel digital watermarks, and key management|
|US7366994||12 oct. 2005||29 avr. 2008||Eastman Kodak Company||Using digital objects organized according to histogram timeline|
|US7376641||2 févr. 2004||20 mai 2008||International Business Machines Corporation||Information retrieval from a collection of data|
|US7389230||22 avr. 2003||17 juin 2008||International Business Machines Corporation||System and method for classification of voice signals|
|US7391880||3 juil. 2003||24 juin 2008||Digimarc Corporation||Color adaptive watermarking|
|US7403938||20 sept. 2002||22 juil. 2008||Iac Search & Media, Inc.||Natural language query processing|
|US7409073||7 juil. 2006||5 août 2008||Wistaria Trading, Inc.||Optimization methods for the insertion, protection, and detection of digital watermarks in digitized data|
|US7418444||21 avr. 2002||26 août 2008||Corbis Corporation||Method and apparatus for digital media management, retrieval, and collaboration|
|US7424492||30 sept. 2005||9 sept. 2008||Science Applications International Corporation||Database management system|
|US7457962||2 août 2006||25 nov. 2008||Wistaria Trading, Inc|
|US7460726||29 mai 2007||2 déc. 2008||Digimarc Corporation||Integrating steganographic encoding in multimedia content|
|US7461099||26 sept. 2000||2 déc. 2008||6S, Limited||Method and system for archiving and retrieving items based on episodic memory of groups of people|
|US7475246||4 août 2000||6 janv. 2009||Blue Spike, Inc.||Secure personal content server|
|US7487155||6 déc. 2000||3 févr. 2009||Vps Llc||Method and apparatus for routing and distributing digital images|
|US7490092 *||12 févr. 2003||10 févr. 2009||Streamsage, Inc.||Method and system for indexing and searching timed media information based upon relevance intervals|
|US7499918 *||18 mai 2005||3 mars 2009||Sony Corporation||Information processing apparatus and method, program, and recording medium|
|US7523134 *||29 juil. 2005||21 avr. 2009||Lg Electronics, Inc.||System, method, and multi-level object data structure thereof for browsing multimedia data|
|US7530102||10 sept. 2007||5 mai 2009||Moskowitz Scott A||Methods, systems and devices for packet watermarking and efficient provisioning of bandwidth|
|US7532725||29 déc. 2006||12 mai 2009||Blue Spike, Inc.||Systems and methods for permitting open access to data objects and for securing data within the data objects|
|US7539325||1 juin 2004||26 mai 2009||Digimarc Corporation||Documents and methods involving multiple watermarks|
|US7542994 *||24 mars 2006||2 juin 2009||Scenera Technologies, Llc||Graphical user interface for rapid image categorization|
|US7552382 *||20 déc. 1999||23 juin 2009||Panasonic Corporation||Data processing device and method for selecting media segments on the basis of a score|
|US7559015 *||11 déc. 2003||7 juil. 2009||Panasonic Corporation||Data processing device and method for selecting media segments on the basis of a score|
|US7561723||5 févr. 2004||14 juil. 2009||Youfinder Intellectual Property Licensing Limited Liability Company||Obtaining person-specific images in a public venue|
|US7568100||23 juil. 1997||28 juil. 2009||Wistaria Trading, Inc.||Steganographic method and device|
|US7593961 *||21 avr. 2004||22 sept. 2009||Canon Kabushiki Kaisha||Information processing apparatus for retrieving image data similar to an entered image|
|US7602940||5 oct. 2006||13 oct. 2009||Digimarc Corporation||Steganographic data hiding using a device clock|
|US7602978||2 déc. 2008||13 oct. 2009||Digimarc Corporation||Deriving multiple identifiers from multimedia content|
|US7644057||5 mai 2004||5 janv. 2010||International Business Machines Corporation||System and method for electronic communication management|
|US7647502||15 nov. 2006||12 janv. 2010||Wistaria Trading, Inc.||Optimization methods for the insertion, protection, and detection of digital watermarks in digital data|
|US7647503||7 sept. 2007||12 janv. 2010||Wistaria Trading, Inc.||Optimization methods for the insertion, projection, and detection of digital watermarks in digital data|
|US7657573 *||31 mars 2003||2 févr. 2010||Invensys||Method and data structure for exchanging data|
|US7660700||26 déc. 2007||9 févr. 2010||Blue Spike, Inc.||Method and device for monitoring and analyzing signals|
|US7664263||25 juin 2003||16 févr. 2010||Moskowitz Scott A||Method for combining transfer functions with predetermined key creation|
|US7664264||12 sept. 2006||16 févr. 2010||Blue Spike, Inc.||Utilizing data reduction in steganographic and cryptographic systems|
|US7664958||31 août 2007||16 févr. 2010||Wistaria Trading, Inc.||Optimization methods for the insertion, protection and detection of digital watermarks in digital data|
|US7685426||2 févr. 2005||23 mars 2010||Digimarc Corporation||Managing and indexing content on a network with image bookmarks and digital watermarks|
|US7689598||15 févr. 2001||30 mars 2010||International Business Machines Corporation||Method and system for file system synchronization between a central site and a plurality of remote sites|
|US7693300||24 juin 2008||6 avr. 2010||Digimarc Corporation||Color image or video processing|
|US7694887||23 déc. 2004||13 avr. 2010||L-1 Secure Credentialing, Inc.||Optically variable personalized indicia for identification documents|
|US7698266 *||24 mars 2004||13 avr. 2010||Google Inc.||Meaning-based advertising and document relevance determination|
|US7702677||11 mars 2008||20 avr. 2010||International Business Machines Corporation||Information retrieval from a collection of data|
|US7702682 *||14 nov. 2005||20 avr. 2010||Incandescent, Inc.||System and method for creating and manipulating information containers with dynamic registers|
|US7707500 *||30 nov. 2005||27 avr. 2010||Yahoo! Inc.||User interface for media item portion search tool|
|US7712673||29 sept. 2004||11 mai 2010||L-L Secure Credentialing, Inc.||Identification document with three dimensional image of bearer|
|US7725454||20 juil. 2007||25 mai 2010||Microsoft Corporation||Indexing and searching of information including handler chaining|
|US7725465||18 avr. 2007||25 mai 2010||Oracle International Corporation||Document date as a ranking factor for crawling|
|US7728048||30 sept. 2003||1 juin 2010||L-1 Secure Credentialing, Inc.||Increasing thermal conductivity of host polymer used with laser engraving methods and compositions|
|US7730317||2 nov. 2006||1 juin 2010||Wistaria Trading, Inc.||Linear predictive coding implementation of digital watermarks|
|US7730426||7 juin 2006||1 juin 2010||Microsoft Corporation||Visual thesaurus as applied to media clip searching|
|US7738659||21 févr. 2006||15 juin 2010||Moskowitz Scott A||Multiple transform utilization and application for secure digital watermarking|
|US7744001||16 nov. 2004||29 juin 2010||L-1 Secure Credentialing, Inc.||Multiple image security features for identification documents and methods of making same|
|US7744002||11 mars 2005||29 juin 2010||L-1 Secure Credentialing, Inc.||Tamper evident adhesive and identification document including same|
|US7752159||23 août 2007||6 juil. 2010||International Business Machines Corporation||System and method for classifying text|
|US7756810||23 août 2007||13 juil. 2010||International Business Machines Corporation||Software tool for training and testing a knowledge base|
|US7761712||7 févr. 2005||20 juil. 2010||Wistaria Trading, Inc.||Steganographic method and device|
|US7765225||3 août 2004||27 juil. 2010||The Hong Kong Polytechnic University||Search system|
|US7765308||29 mai 2001||27 juil. 2010||Audible, Inc.||Apparatus and method for authoring and maintaining a library of content and targeting content to a playback device|
|US7770017||26 déc. 2007||3 août 2010||Wistaria Trading, Inc.||Method and system for digital watermarking|
|US7773770||22 avr. 2008||10 août 2010||Digimarc Corporation||Substituting or replacing components in media objects based on steganographic encoding|
|US7778438||8 janv. 2007||17 août 2010||Myport Technologies, Inc.||Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval|
|US7778440||27 févr. 2007||17 août 2010||Myport Technologies, Inc.||Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval|
|US7779261||3 janv. 2007||17 août 2010||Wistaria Trading, Inc.||Method and system for digital watermarking|
|US7789311||5 juin 2007||7 sept. 2010||L-1 Secure Credentialing, Inc.||Three dimensional data storage|
|US7793846||24 déc. 2002||14 sept. 2010||L-1 Secure Credentialing, Inc.||Systems, compositions, and methods for full color laser engraving of ID documents|
|US7797377||22 sept. 2006||14 sept. 2010||Corbis Corporation||Method and system for automatically displaying an image and a product in a page based on contextual interaction and metadata|
|US7798413||20 juin 2006||21 sept. 2010||L-1 Secure Credentialing, Inc.||Covert variable information on ID documents and methods of making same|
|US7804982||26 nov. 2003||28 sept. 2010||L-1 Secure Credentialing, Inc.||Systems and methods for managing and detecting fraud in image databases used with identification documents|
|US7813506||30 mars 2009||12 oct. 2010||Blue Spike, Inc||System and methods for permitting open access to data objects and for securing data within the data objects|
|US7818765||9 déc. 2008||19 oct. 2010||International Business Machines Corporation||System for object retransmission without a continuous network connection in a digital media distributor system|
|US7822197||7 sept. 2007||26 oct. 2010||Wistaria Trading, Inc.||Optimization methods for the insertion, protection, and detection of digital watermarks in digital data|
|US7824029||12 mai 2003||2 nov. 2010||L-1 Secure Credentialing, Inc.||Identification card printer-assembler for over the counter card issuing|
|US7827488||28 janv. 2005||2 nov. 2010||Sitrick David H||Image tracking and substitution system and methodology for audio-visual presentations|
|US7830915||23 janv. 2008||9 nov. 2010||Wistaria Trading, Inc.||Methods and systems for managing and exchanging digital information packages with bandwidth securitization instruments|
|US7844074||30 juin 2008||30 nov. 2010||Wistaria Trading, Inc.|
|US7844820 *||10 oct. 2005||30 nov. 2010||Yahoo! Inc.||Set of metadata for association with a composite media item and tool for creating such set of metadata|
|US7849065||20 juil. 2007||7 déc. 2010||Microsoft Corporation||Heterogeneous content indexing and searching|
|US7853544 *||23 nov. 2005||14 déc. 2010||Overtone, Inc.||Systems and methods for automatically categorizing unstructured text|
|US7870145 *||21 avr. 2008||11 janv. 2011||International Business Machines Corporation||Utilization of logical fields with conditional constraints in abstract queries|
|US7870393||21 août 2007||11 janv. 2011||Wistaria Trading, Inc.||Steganographic method and device|
|US7873682||21 janv. 2010||18 janv. 2011||Incandescent Inc.||System and method for creating and manipulating information containers with dynamic registers|
|US7877609||12 nov. 2009||25 janv. 2011||Wistaria Trading, Inc.|
|US7895288||25 juin 2001||22 févr. 2011||Audible, Inc.||Personalized time-shifted programming|
|US7904490||21 janv. 2009||8 mars 2011||Sony Corporation||Information processing apparatus and method, program, and recording medium|
|US7913275||1 déc. 2003||22 mars 2011||Comcast Ip Holdings I, Llc||Method and apparatus for switching targeted advertisements at a set top terminal|
|US7917497||18 avr. 2008||29 mars 2011||Iac Search & Media, Inc.||Natural language query processing|
|US7917643||12 nov. 2004||29 mars 2011||Audible, Inc.||Digital information library and delivery system|
|US7925650 *||27 juil. 2006||12 avr. 2011||Hewlett-Packard Development Company, L.P.||Image management methods, image management systems, and articles of manufacture|
|US7930545||15 nov. 2006||19 avr. 2011||Wistaria Trading, Inc.|
|US7933338 *||10 nov. 2005||26 avr. 2011||Google Inc.||Ranking video articles|
|US7933765||28 mars 2007||26 avr. 2011||Corbis Corporation||Cross-lingual information retrieval|
|US7941419||28 févr. 2007||10 mai 2011||Oracle International Corporation||Suggested content with attribute parameterization|
|US7949494||22 déc. 2009||24 mai 2011||Blue Spike, Inc.||Method and device for monitoring and analyzing signals|
|US7953270||7 avr. 2009||31 mai 2011||Digimarc Corporation||Methods and arrangements employing digital content items|
|US7953981||10 août 2009||31 mai 2011||Wistaria Trading, Inc.|
|US7979340||21 sept. 2006||12 juil. 2011||Overstock.Com, Inc.||System, program product, and methods for online image handling|
|US7979914||28 avr. 2009||12 juil. 2011||Audible, Inc.||Time-based digital content authorization|
|US7987245||26 nov. 2008||26 juil. 2011||Digimarc Corporation||Internet linking from audio|
|US7987371||9 juil. 2008||26 juil. 2011||Wistaria Trading, Inc.|
|US7991184||10 janv. 2007||2 août 2011||Digimarc Corporation||Apparatus to process images and video|
|US7991188||31 août 2007||2 août 2011||Wisteria Trading, Inc.|
|US7996392||27 juin 2007||9 août 2011||Oracle International Corporation||Changing ranking algorithms based on customer settings|
|US7996451 *||20 avr. 2009||9 août 2011||Lg Electronics, Inc.||System, method, and multi-level object data structure thereof for browsing multimedia data|
|US8005816||28 févr. 2007||23 août 2011||Oracle International Corporation||Auto generation of suggested links in a search system|
|US8027509||11 juin 2010||27 sept. 2011||Digimarc Corporation||Digital watermarking in data representing color channels|
|US8027982||28 févr. 2007||27 sept. 2011||Oracle International Corporation||Self-service sources for secure search|
|US8028249||8 sept. 2005||27 sept. 2011||Eastman Kodak Company||Method and system for browsing large digital multimedia object collections|
|US8031981 *||21 déc. 2007||4 oct. 2011||Daon Holdings Limited||Method and systems for generating a subset of biometric representations|
|US8046228||7 févr. 2006||25 oct. 2011||Texas Instruments Incorporated||Voice activated hypermedia systems using grammatical metadata|
|US8046841||21 août 2007||25 oct. 2011||Wistaria Trading, Inc.||Steganographic method and device|
|US8068638||17 août 2010||29 nov. 2011||Myport Technologies, Inc.||Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval|
|US8073193||15 sept. 2009||6 déc. 2011||Digimarc Corporation||Methods and systems for steganographic processing|
|US8073828||14 juin 2007||6 déc. 2011||Curbis Corporation||Licensed rights clearance and tracking for digital assets|
|US8078618||30 janv. 2006||13 déc. 2011||Eastman Kodak Company||Automatic multimode system for organizing and retrieving content data files|
|US8094949||18 mai 2000||10 janv. 2012||Digimarc Corporation||Music methods and systems|
|US8098882 *||28 mars 2008||17 janv. 2012||Digimarc Corporation||Perceptability model applied to watermark signals|
|US8099086||21 juin 2006||17 janv. 2012||Ektimisi Semiotics Holdings, Llc||System and method for providing a descriptor for a location to a recipient|
|US8103542||25 oct. 2000||24 janv. 2012||Digimarc Corporation||Digitally marked objects and promotional methods|
|US8104079||23 mars 2009||24 janv. 2012||Moskowitz Scott A||Methods, systems and devices for packet watermarking and efficient provisioning of bandwidth|
|US8107674||5 janv. 2010||31 janv. 2012||Digimarc Corporation||Synchronizing rendering of multimedia content|
|US8117206||7 janv. 2009||14 févr. 2012||Streamsage, Inc.||Method and system for indexing and searching timed media information based upon relevance intervals|
|US8121342||24 avr. 2007||21 févr. 2012||Digimarc Corporation||Associating metadata with media signals, and searching for media signals using metadata|
|US8121343||10 oct. 2010||21 févr. 2012||Wistaria Trading, Inc|
|US8135169||16 août 2010||13 mars 2012||Myport Technologies, Inc.||Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval|
|US8144368||26 nov. 2003||27 mars 2012||Digimarc Coporation||Automated methods for distinguishing copies from original printed objects|
|US8145034 *||7 févr. 2006||27 mars 2012||Sony Corporation||Contents replay apparatus and contents replay method|
|US8155378||6 avr. 2010||10 avr. 2012||Digimarc Corporation||Color image or video processing|
|US8160249||22 déc. 2009||17 avr. 2012||Blue Spike, Inc.||Utilizing data reduction in steganographic and cryptographic system|
|US8161063 *||11 sept. 2009||17 avr. 2012||Eastman Kodak Company||Multimedia object retrieval from natural language queries|
|US8161286||21 juin 2010||17 avr. 2012||Wistaria Trading, Inc.||Method and system for digital watermarking|
|US8165342||6 avr. 2010||24 avr. 2012||Digimarc Corporation||Color image or video processing|
|US8171561||9 oct. 2008||1 mai 2012||Blue Spike, Inc.||Secure personal content server|
|US8175330||18 août 2011||8 mai 2012||Wistaria Trading, Inc.|
|US8175977||28 déc. 1998||8 mai 2012||Audible||License management for digital content|
|US8185543 *||10 nov. 2005||22 mai 2012||Google Inc.||Video image-based querying for video content|
|US8189685 *||31 mars 2011||29 mai 2012||Google Inc.||Ranking video articles|
|US8190713||21 juil. 2011||29 mai 2012||Digimarc Corporation||Controlling a device based upon steganographically encoded data|
|US8214175||26 févr. 2011||3 juil. 2012||Blue Spike, Inc.||Method and device for monitoring and analyzing signals|
|US8214394||3 juil. 2012||Oracle International Corporation||Propagating user identities in a secure federated search system|
|US8214804||14 janv. 2008||3 juil. 2012||Overstock.Com, Inc.||System and method for assigning computer users to test groups|
|US8219494||16 août 2007||10 juil. 2012||Corbis Corporation||End-to-end licensing of digital media assets|
|US8224705||10 sept. 2007||17 juil. 2012||Moskowitz Scott A||Methods, systems and devices for packet watermarking and efficient provisioning of bandwidth|
|US8225099||14 avr. 2010||17 juil. 2012||Wistaria Trading, Inc.||Linear predictive coding implementation of digital watermarks|
|US8238553||30 mars 2009||7 août 2012||Wistaria Trading, Inc||Steganographic method and device|
|US8239414||18 mai 2011||7 août 2012||Oracle International Corporation||Re-ranking search results from an enterprise system|
|US8245259||16 août 2010||14 août 2012||Comcast Ip Holdings I, Llc||Video and digital multimedia aggregator|
|US8260631||10 nov. 2006||4 sept. 2012||General Electric Company||Visual filtering to create logical associations in timeline based metaphors|
|US8265276||22 déc. 2009||11 sept. 2012||Moskowitz Scott A||Method for combining transfer functions and predetermined key creation|
|US8265278||21 sept. 2010||11 sept. 2012||Blue Spike, Inc.||System and methods for permitting open access to data objects and for securing data within the data objects|
|US8271795||11 sept. 2006||18 sept. 2012||Blue Spike, Inc.||Security based on subliminal and supraliminal channels for data objects|
|US8281140||23 nov. 2009||2 oct. 2012||Wistaria Trading, Inc|
|US8290768||27 mars 2002||16 oct. 2012||International Business Machines Corporation||System and method for determining a set of attributes based on content of communications|
|US8300274||23 sept. 2008||30 oct. 2012||Digimarc Corporation||Process for marking substrates with information using a texture pattern and related substrates|
|US8306284||12 juil. 2006||6 nov. 2012||Hysterical Sunset Limited||Manually-assisted automated indexing of images using facial recognition|
|US8307213||21 juin 2010||6 nov. 2012||Wistaria Trading, Inc.||Method and system for digital watermarking|
|US8316007||28 juin 2007||20 nov. 2012||Oracle International Corporation||Automatically finding acronyms and synonyms in a corpus|
|US8326662||18 juin 2009||4 déc. 2012||Overstock.Com, Inc.||Positioning E-commerce product related to graphical imputed consumer demand|
|US8332281||2 sept. 2010||11 déc. 2012||Image Holdings||Method of displaying, managing and selling images in an event photography environment|
|US8332430||28 févr. 2007||11 déc. 2012||Oracle International Corporation||Secure search performance improvement|
|US8332478 *||11 sept. 2001||11 déc. 2012||Digimarc Corporation||Context sensitive connected content|
|US8341195||4 oct. 2007||25 déc. 2012||Corbis Corporation||Platform for managing media assets for multi-model licensing over multi-level pricing and asset grouping|
|US8352475||4 avr. 2011||8 janv. 2013||Oracle International Corporation||Suggested content with attribute parameterization|
|US8364673||15 déc. 2010||29 janv. 2013||The Trustees Of Columbia University In The City Of New York||System and method for dynamically and interactively searching media data|
|US8370269||20 juil. 2004||5 févr. 2013||Overstock.Com, Inc.||System and methods for electronic commerce using personal and business networks|
|US8370376||17 janv. 2012||5 févr. 2013||Eastman Kodak Company||Multimedia object retrieval from natural language queries|
|US8370869||6 juin 2006||5 févr. 2013||The Trustees Of Columbia University In The City Of New York||Video description system and method|
|US8392268||16 sept. 2010||5 mars 2013||Image Holdings||Method and system of displaying, managing and selling images in an event photography environment|
|US8392532||28 mai 2010||5 mars 2013||Summit 6 Llc||Media acquisition, processing and distribution system for the internet|
|US8406481||23 févr. 2006||26 mars 2013||Hysterical Sunset Limited||Automated indexing for distributing event photography|
|US8407213||31 août 2006||26 mars 2013||Ektimisi Semiotics Holdings, Llc||System and method for identifying a location of interest to be named by a user|
|US8412717||27 juin 2011||2 avr. 2013||Oracle International Corporation||Changing ranking algorithms based on customer settings|
|US8423555||9 juil. 2010||16 avr. 2013||Comcast Cable Communications, Llc||Automatic segmentation of video|
|US8429205 *||4 août 2005||23 avr. 2013||Digimarc Corporation||Associating data with media signals in media signal systems through auxiliary data steganographically embedded in the media signals|
|US8433712||28 févr. 2007||30 avr. 2013||Oracle International Corporation||Link analysis for enterprise environment|
|US8452691||12 juil. 2011||28 mai 2013||Overstock.com||System, program product, and methods for online image handling|
|US8467525||8 juin 2010||18 juin 2013||Wistaria Trading, Inc.||Steganographic method and device|
|US8473746||14 oct. 2011||25 juin 2013||Scott A. Moskowitz||Methods, systems and devices for packet watermarking and efficient provisioning of bandwidth|
|US8478732||2 mai 2000||2 juil. 2013||International Business Machines Corporation||Database aliasing in information access system|
|US8488682||19 déc. 2007||16 juil. 2013||The Trustees Of Columbia University In The City Of New York||System and method for extracting text captions from video and generating video summaries|
|US8495002||29 avr. 2004||23 juil. 2013||International Business Machines Corporation||Software tool for training and testing a knowledge base|
|US8505108 *||1 nov. 2002||6 août 2013||Digimarc Corporation||Authentication using a digital watermark|
|US8509477||10 mars 2012||13 août 2013||Myport Technologies, Inc.||Method for multi-media capture, transmission, conversion, metatags creation, storage and search retrieval|
|US8510676 *||23 mai 2003||13 août 2013||Thomson Licensing||Method and device for creating semantic browsing options|
|US8521850||21 juil. 2011||27 août 2013||Digimarc Corporation||Content containing a steganographically encoded process identifier|
|US8526611||19 mars 2012||3 sept. 2013||Blue Spike, Inc.||Utilizing data reduction in steganographic and cryptographic systems|
|US8527520||11 janv. 2012||3 sept. 2013||Streamsage, Inc.||Method and system for indexing and searching timed media information based upon relevant intervals|
|US8528103 *||19 mars 2010||3 sept. 2013||Digimarc Corporation||System for managing display and retrieval of image content on a network with image identification and linking to network content|
|US8533223||12 mai 2009||10 sept. 2013||Comcast Interactive Media, LLC.||Disambiguation and tagging of entities|
|US8538011||29 août 2006||17 sept. 2013||Blue Spike, Inc.||Systems, methods and devices for trusted transactions|
|US8542831||4 mai 2010||24 sept. 2013||Scott A. Moskowitz||Multiple transform utilization and application for secure digital watermarking|
|US8549305||27 oct. 2010||1 oct. 2013||Wistaria Trading, Inc.||Steganographic method and device|
|US8554765||13 mars 2013||8 oct. 2013||Ektimisi Semiotics Holdings, Llc||System and method for identifying a location of interest to be named by a user|
|US8572272||30 sept. 2010||29 oct. 2013||Audible, Inc.||Personalized time-shifted programming|
|US8595255||30 mai 2012||26 nov. 2013||Oracle International Corporation||Propagating user identities in a secure federated search system|
|US8601028||28 juin 2012||3 déc. 2013||Oracle International Corporation||Crawling secure data sources|
|US8612515 *||29 avr. 2011||17 déc. 2013||Summit 6 Llc||System, method and apparatus for media submission|
|US8612765||25 mars 2012||17 déc. 2013||Blue Spike, Llc||Security based on subliminal and supraliminal channels for data objects|
|US8626756||17 oct. 2007||7 janv. 2014||Adobe Systems Incorporated||Tagging data assets|
|US8626794||2 juil. 2012||7 janv. 2014||Oracle International Corporation||Indexing secure enterprise documents using generic references|
|US8671069||8 août 2011||11 mars 2014||The Trustees Of Columbia University, In The City Of New York||Rapid image annotation via brain state decoding and visual pattern mining|
|US8676632||16 juil. 2009||18 mars 2014||Overstock.Com, Inc.||Pricing and forecasting|
|US8676904||2 oct. 2008||18 mars 2014||Apple Inc.||Electronic devices with voice command and contextual data processing capabilities|
|US8687841||29 nov. 2011||1 avr. 2014||Myport Technologies, Inc.||Apparatus and method for embedding searchable information into a file, encryption, transmission, storage and retrieval|
|US8701022 *||4 nov. 2008||15 avr. 2014||6S Limited||Method and system for archiving and retrieving items based on episodic memory of groups of people|
|US8706570||17 juil. 2012||22 avr. 2014||Scott A. Moskowitz||Methods, systems and devices for packet watermarking and efficient provisioning of bandwidth|
|US8706735 *||31 juil. 2013||22 avr. 2014||Streamsage, Inc.||Method and system for indexing and searching timed media information based upon relevance intervals|
|US8707451||28 févr. 2007||22 avr. 2014||Oracle International Corporation||Search hit URL modification for secure application integration|
|US8712728||13 mars 2013||29 avr. 2014||Blue Spike Llc||Method and device for monitoring and analyzing signals|
|US8713016||24 déc. 2008||29 avr. 2014||Comcast Interactive Media, Llc||Method and apparatus for organizing segments of media assets and determining relevance of segments to a query|
|US8713119||13 sept. 2012||29 avr. 2014||Apple Inc.||Electronic devices with voice command and contextual data processing capabilities|
|US8719075||23 août 2005||6 mai 2014||Overstock.Com, Inc.||System, program product, and methods for online image handling|
|US8725770||14 nov. 2012||13 mai 2014||Oracle International Corporation||Secure search performance improvement|
|US8731339 *||20 janv. 2012||20 mai 2014||Elwha Llc||Autogenerating video from text|
|US8737969||14 déc. 2011||27 mai 2014||Scenera Mobile Technologies, Llc||System and method for providing a descriptor for a location to a recipient|
|US8739295||7 mars 2012||27 mai 2014||Blue Spike, Inc.||Secure personal content server|
|US8745478 *||7 juil. 2008||3 juin 2014||Xerox Corporation||System and method for generating inspiration boards|
|US8750892||21 juin 2006||10 juin 2014||Scenera Mobile Technologies, Llc||System and method for naming a location based on user-specific information|
|US8762469||5 sept. 2012||24 juin 2014||Apple Inc.||Electronic devices with voice command and contextual data processing capabilities|
|US8767962||11 août 2012||1 juil. 2014||Blue Spike, Inc.||System and methods for permitting open access to data objects and for securing data within the data objects|
|US8774216||28 sept. 2010||8 juil. 2014||Wistaria Trading, Inc.||Exchange mechanisms for digital information packages with bandwidth securitization, multichannel digital watermarks, and key management|
|US8781121||13 mars 2013||15 juil. 2014||Blue Spike, Inc.||Utilizing data reduction in steganographic and cryptographic systems|
|US8789201||12 mars 2013||22 juil. 2014||Blue Spike, Inc.||Secure personal content server|
|US8792675||17 avr. 2012||29 juil. 2014||Digimarc Corporation||Color image or video processing|
|US8798268||11 mars 2013||5 août 2014||Blue Spike, Inc.|
|US8799278 *||1 oct. 2012||5 août 2014||DISCERN, Inc.||Data augmentation based on second-phase metadata|
|US8831275||11 mars 2013||9 sept. 2014||Hysterical Sunset Limited||Automated indexing for distributing event photography|
|US8849058||23 août 2010||30 sept. 2014||The Trustees Of Columbia University In The City Of New York||Systems and methods for image archaeology|
|US8868540 *||28 févr. 2007||21 oct. 2014||Oracle International Corporation||Method for suggesting web links and alternate terms for matching search queries|
|US8868585||24 févr. 2012||21 oct. 2014||Sony Corporation||Contents replay apparatus and contents replay method|
|US8875249||28 févr. 2007||28 oct. 2014||Oracle International Corporation||Minimum lifespan credentials for crawling data repositories|
|US8930719||24 juil. 2012||6 janv. 2015||Scott A. Moskowitz||Data protection method and device|
|US8935244||30 sept. 2013||13 janv. 2015||Scenera Mobile Technologies, Llc||System and method for identifying a location of interest to be named by a user|
|US8983119||13 août 2013||17 mars 2015||Myport Technologies, Inc.||Method for voice command activation, multi-media capture, transmission, speech conversion, metatags creation, storage and search retrieval|
|US8996376||5 avr. 2008||31 mars 2015||Apple Inc.||Intelligent text-to-speech conversion|
|US9002746||7 mai 2012||7 avr. 2015||Audible, Inc.||License management for digital content|
|US9021602||11 mars 2013||28 avr. 2015||Scott A. Moskowitz||Data protection method and device|
|US9036950||25 avr. 2014||19 mai 2015||Elwha Llc||Autogenerating video from text|
|US9047642||15 nov. 2011||2 juin 2015||Overstock.Com, Inc.||Social choice engine|
|US9053089||2 oct. 2007||9 juin 2015||Apple Inc.||Part-of-speech tagging using latent analogy|
|US9055109||22 mai 2014||9 juin 2015||Scenera Mobile Technologies, Llc||System and method for providing a descriptor for a location to a recipient|
|US9060175||28 août 2007||16 juin 2015||The Trustees Of Columbia University In The City Of New York||System and method for motion estimation and mode decision for low-complexity H.264 decoder|
|US9066113||13 mars 2000||23 juin 2015||International Business Machines Corporation||Method for ensuring reliable playout in a DMD system|
|US9070151||12 mars 2013||30 juin 2015||Blue Spike, Inc.||Systems, methods and devices for trusted transactions|
|US9070193||7 févr. 2014||30 juin 2015||Myport Technologies, Inc.||Apparatus and method to embed searchable information into a file, encryption, transmission, storage and retrieval|
|US9075783||22 juil. 2013||7 juil. 2015||Apple Inc.||Electronic device with text error correction based on voice recognition data|
|US9078014||23 déc. 2011||7 juil. 2015||Comcast Ip Holdings I, Llc||Method and apparatus for targeting of interactive virtual objects|
|US9081816||23 oct. 2013||14 juil. 2015||Oracle International Corporation||Propagating user identities in a secure federated search system|
|US9104842||24 août 2007||11 août 2015||Scott A. Moskowitz||Data protection method and device|
|US20010021937 *||20 févr. 2001||13 sept. 2001||Lorenzo Cicchitelli||Automatically selecting fonts|
|US20010029580 *||22 févr. 2001||11 oct. 2001||Moskowitz Scott A.|
|US20010034603 *||16 mars 2001||25 oct. 2001||Thrift Philip R.||Voice activated apparatus for accessing information on the World Wide Web|
|US20010034845 *||14 févr. 2001||25 oct. 2001||Brunt George B.||Secure web-based document control process and system|
|US20010037313 *||21 févr. 2001||1 nov. 2001||Neil Lofgren||Digital watermarking systems|
|US20020059069 *||21 mai 2001||16 mai 2002||Cheng Hsu||Natural language interface|
|US20020075322 *||20 déc. 2000||20 juin 2002||Eastman Kodak Company||Timeline-based graphical user interface for efficient image database browsing and retrieval|
|US20020078146 *||28 août 2001||20 juin 2002||Rhoads Geoffrey B.||Internet linking from audio and image content|
|US20020081024 *||26 déc. 2001||27 juin 2002||Sung Hee Park||Apparatus and method for retrieving color and shape of image based on natural language|
|US20020133272 *||11 janv. 2002||19 sept. 2002||Kazutoshi Ishioka||Information registration method and system|
|US20020136430 *||6 mars 2002||26 sept. 2002||Digimarc Corporation||Network linking method using information embedded in data objects that have inherent noise|
|US20020145633 *||24 avr. 2002||10 oct. 2002||Nikon Corporation||Information processing device, method and program|
|US20020147578 *||13 sept. 2001||10 oct. 2002||Lingomotors, Inc.||Method and system for query reformulation for searching of information|
|US20040086119 *||25 juin 2003||6 mai 2004||Moskowitz Scott A.||Method for combining transfer functions with predetermined key creation|
|US20040098362 *||18 nov. 2002||20 mai 2004||Ullas Gargi||Automated propagation of document metadata|
|US20040111742 *||1 déc. 2003||10 juin 2004||Hendricks John S.||Method and apparatus for switching targeted advertisements at a set top terminal|
|US20040125983 *||3 juil. 2003||1 juil. 2004||Reed Alastair M.||Color adaptive watermarking|
|US20040131225 *||14 août 2003||8 juil. 2004||Alattar Adnan M.||Method and apparatus for encoding paper with information|
|US20040133569 *||11 déc. 2003||8 juil. 2004||Matsushita Electric Industrial Co., Ltd.||Data processing device, data processing method and storage medium, and program for causing computer to execute the data processing method|
|US20040148564 *||14 janv. 2004||29 juil. 2004||Canon Kabushiki Kaisha||Information processing method and apparatus|
|US20040167905 *||21 févr. 2003||26 août 2004||Eakin William Joseph||Content management portal and method for managing digital assets|
|US20040171371 *||19 avr. 2002||2 sept. 2004||Glenn Paul||Automatic camera image transmittal system|
|US20040198858 *||30 sept. 2003||7 oct. 2004||Brian Labrec||Increasing thermal conductivity of host polymer used with laser engraving methods and compositions|
|US20040199867 *||16 déc. 2003||7 oct. 2004||Cci Europe A.S.||Content management system for managing publishing content objects|
|US20040201737 *||22 août 2001||14 oct. 2004||Baron John M.||Memory management in an image capturing device|
|US20040215659 *||1 août 2002||28 oct. 2004||Singfield Christian Robert Mau||Network image server|
|US20040220898 *||21 avr. 2004||4 nov. 2004||Canon Kabushiki Kaisha||Information processing apparatus, method, storage medium and program|
|US20040225653 *||29 avr. 2004||11 nov. 2004||Yoram Nelken||Software tool for training and testing a knowledge base|
|US20040243540 *||22 mars 2004||2 déc. 2004||Moskowitz Scott A.||Method and device for monitoring and analyzing signals|
|US20040246255 *||5 déc. 2003||9 déc. 2004||Tsang-Gang Lin||Method for converting high level motion scripts to computer animations|
|US20040254904 *||5 mai 2004||16 déc. 2004||Yoram Nelken||System and method for electronic communication management|
|US20040263911 *||26 nov. 2003||30 déc. 2004||Rodriguez Tony F.||Automated methods for distinguishing copies from original printed objects|
|US20050010602 *||3 août 2004||13 janv. 2005||Loui Alexander C.||System and method for acquisition of related graphical material in a digital graphics album|
|US20050018057 *||25 juil. 2003||27 janv. 2005||Bronstein Kenneth H.||Image capture device loaded with image metadata|
|US20050058320 *||1 juin 2004||17 mars 2005||Rhoads Geoffrey B.||Identification document including multiple watermarks|
|US20050102201 *||8 déc. 2004||12 mai 2005||Corbis Corporation|
|US20050105107 *||17 nov. 2003||19 mai 2005||Schneider David A.||Image printing system and method|
|US20050135615 *||30 déc. 2004||23 juin 2005||Moskowitz Scott A.||Z-transform implementation of digital watermarks|
|US20050161512 *||23 déc. 2004||28 juil. 2005||Jones Robert L.||Optically variable personalized indicia for identification documents|
|US20050187913 *||5 mai 2004||25 août 2005||Yoram Nelken||Web-based customer service interface|
|US20050216443 *||12 févr. 2003||29 sept. 2005||Streamsage, Inc.||Method and system for indexing and searching timed media information based upon relevance intervals|
|US20050216850 *||2 févr. 2005||29 sept. 2005||Ramos Daniel O||Managing and indexing content on a network with image bookmarks and digital watermarks|
|US20050242194 *||11 mars 2005||3 nov. 2005||Jones Robert L||Tamper evident adhesive and identification document including same|
|US20050246336 *||23 mai 2003||3 nov. 2005||Jurgen Stauder||Method and device for creating semantic browsing options|
|US20050262069 *||29 juil. 2005||24 nov. 2005||Lee Jin S||System, method, and multi-level object data structure thereof for browsing multimedia data|
|US20050273378 *||20 juil. 2004||8 déc. 2005||Overstock.Com, Inc.||System and methods for electronic commerce using personal and business networks|
|US20090183091 *||16 juil. 2009||6S Limited||Method and system for archiving and retrieving items based on episodic memory of groups of people|
|US20100005378 *||7 janv. 2010||Xerox Corporation||System and method for generating inspiration boards|
|US20100097479 *||19 nov. 2009||22 avr. 2010||Nikon Corporation||Electronic camera comprising means for navigating and printing image data|
|US20100107125 *||24 oct. 2008||29 avr. 2010||Microsoft Corporation||Light Box for Organizing Digital Images|
|US20110066630 *||11 sept. 2009||17 mars 2011||Marcello Balduccini||Multimedia object retrieval from natural language queries|
|US20110161067 *||30 juin 2011||Dynavox Systems, Llc||System and method of using pos tagging for symbol assignment|
|US20110161068 *||29 déc. 2009||30 juin 2011||Dynavox Systems, Llc||System and method of using a sense model for symbol assignment|
|US20110208811 *||25 août 2011||Wood Lisa T||System and Method for Media Submission|
|US20110258556 *||16 avr. 2010||20 oct. 2011||Microsoft Corporation||Social home page|
|US20120177304 *||12 juil. 2012||Raytheon Company||System for image intelligence exploitation and creation|
|US20130086466 *||4 avr. 2013||Digimarc Corporation||Content sensitive connected content|
|US20130318121 *||31 juil. 2013||28 nov. 2013||Streamsage, Inc.||Method and System for Indexing and Searching Timed Media Information Based Upon Relevance Intervals|
|US20130346068 *||13 mars 2013||26 déc. 2013||Apple Inc.||Voice-Based Image Tagging and Searching|
|US20150052136 *||19 août 2013||19 févr. 2015||Qin Zhang||Image Categorization Database and Related Applications|
|USRE44222||4 juin 2012||14 mai 2013||Scott Moskowitz||Methods, systems and devices for packet watermarking and efficient provisioning of bandwidth|
|USRE44307||4 juin 2012||18 juin 2013||Scott Moskowitz||Methods, systems and devices for packet watermarking and efficient provisioning of bandwidth|
|CN1306441C *||13 avr. 2000||21 mars 2007||佳能株式会社||Data processing method and apparatus|
|EP0949805A2 *||12 avr. 1999||13 oct. 1999||Fuji Photo Film Co., Ltd.||Electronic album producing and viewing system and method|
|EP1182859A2 *||1 août 2001||27 févr. 2002||Eastman Kodak Company||A product and method for organizing and searching digital images|
|EP1197879A2 *||28 sept. 2001||17 avr. 2002||Eastman Kodak Company||An agent for integrated annotation and retrieval of images|
|EP1223519A2 *||15 janv. 2002||17 juil. 2002||Yamaha Hatsudoki Kabushiki Kaisha||Information registration system and information registration support system|
|EP1249002A1 *||11 janv. 2001||16 oct. 2002||Digimarc Corporation||Authenticating metadata and embedding metadata in watermarks of media signals|
|EP1303127A1 *||30 sept. 2002||16 avr. 2003||Eastman Kodak Company||Hybrid cameras that download electronic images with reduced metadata and methods|
|EP1549041A2 *||12 avr. 1999||29 juin 2005||Fuji Photo Film Co., Ltd.||Electronic album producing and viewing system and method|
|EP1591954A1 *||5 févr. 2004||2 nov. 2005||Seiko Epson Corporation||Image processing device|
|WO1996026494A1 *||22 févr. 1996||29 août 1996||Theodore G Handel||Data embedding|
|WO1997010554A1 *||13 sept. 1996||20 mars 1997||Infonautics Corp||Architecture for processing search queries, retrieving documents identified thereby, and method for using same|
|WO1997015018A1 *||26 sept. 1996||24 avr. 1997||Bell Communications Res||Method and system for providing uniform access to heterogeneous information|
|WO1997037281A1 *||28 mars 1997||9 oct. 1997||Silicon Graphics Inc||System and method for color space conversion|
|WO1998002864A1 *||2 juil. 1997||22 janv. 1998||Dice Company||Optimization methods for the insertion, protection and detection of digital watermarks in digitized data|
|WO1998010358A1 *||3 sept. 1997||12 mars 1998||David A Goldberg||Method and system for obtaining person-specific images in a public venue|
|WO1998011492A1 *||12 sept. 1997||19 mars 1998||Edward J Delp Iii||Authentication of signals using watermarks|
|WO1998052119A1 *||16 mai 1997||19 nov. 1998||Chang Shih Fu||Method and system for image retrieval|
|WO1999036876A2 *||20 janv. 1999||22 juil. 1999||Digimarc Corp||Multiple watermarking techniques|
|WO1999045483A1 *||4 mars 1999||10 sept. 1999||Chang Shih Fu||Method and system for generating semantic visual templates for image and video retrieval|
|WO2001013287A1 *||13 juin 2000||22 févr. 2001||Cci Europ As||A content management computer system for managing publishing content objects|
|WO2001026002A1 *||3 oct. 2000||12 avr. 2001||Biolicense Com||Method and system for provision of information on technology|
|WO2001054394A2 *||19 janv. 2001||26 juil. 2001||Andrew J Neilson||Digitally archiving with metadata analog records captured by camera at optimized resolution|
|WO2001057783A1 *||1 févr. 2001||9 août 2001||Digimarc Corp||Integrating digital watermarks in multimedia content|
|WO2002073358A2 *||11 mars 2002||19 sept. 2002||Smart Mediary Systems Llc||Many-to-many mediated commercial electronic publishing|
|WO2010081225A1 *||13 janv. 2010||22 juil. 2010||Xtranormal Technology Inc.||Digital content creation system|
|WO2011082056A1 *||22 déc. 2010||7 juil. 2011||Dynavox Systems Llc||System and method of using pos tagging for symbol assignment|
|WO2014004536A2 *||25 juin 2013||3 janv. 2014||Apple Inc.||Voice-based image tagging and searching|
|Classification aux États-Unis||382/305, 707/E17.021, 707/E17.026, 707/E17.028, 707/E17.029, 707/915, 707/999.104, 707/769|
|Classification internationale||G06Q30/04, H04N1/44, H04N1/00, H04N1/32, G06T1/00, G06T11/00, G06F17/30|
|Classification coopérative||Y10S707/99945, Y10S707/966, Y10S707/915, H04N1/32309, H04N1/32208, H04N1/00872, H04N1/00864, G06T11/00, H04N2201/327, G06F17/3025, H04N1/32251, H04N2201/3273, G06F17/30817, G06F17/30781, G06F17/30265, G06Q30/04, H04N2201/3233, H04N1/32144, G06F17/30274, G06T1/0021|
|Classification européenne||G06Q30/04, G06T1/00, G06F17/30V, H04N1/32C19B3G, H04N1/00P3M3, H04N1/32C19B3B, G06F17/30V2, H04N1/32C19B7, H04N1/00P3M, G06F17/30M2, H04N1/32C19, G06F17/30M1C, G06F17/30M7, G06T11/00|
|28 oct. 1994||AS||Assignment|
Owner name: SYSTEMS RESEARCH & APPLICATIONS CORPORATION, VIRGI
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BALOGH, ARISTOTLE;BLEJER, HATTE;BRIGGS, ROBERT;AND OTHERS;REEL/FRAME:007186/0894;SIGNING DATES FROM 19940810 TO 19940928
|29 août 1997||AS||Assignment|
Owner name: EASTMAN KODAK COMPANY (ONE HALF INTEREST), NEW YO
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PICTURE NETWORK INTERNATIONAL, INC.;REEL/FRAME:008677/0574
Effective date: 19970730
Owner name: EASTMAN KODAK COMPANY, NEW YORK
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SYSTEMS RESEARCH AND APPLICATIONS CORPORATION;REEL/FRAME:008677/0569
Effective date: 19970722
Owner name: PICTURE NETWORK INTERNATIONAL, LTD., VIRGINIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SYSTEMS RESEARCH AND APPLICATIONS CORPORATION;REEL/FRAME:008677/0572
Effective date: 19970519
|2 août 1999||FPAY||Fee payment|
Year of fee payment: 4
|27 juin 2003||FPAY||Fee payment|
Year of fee payment: 8
|21 juin 2007||FPAY||Fee payment|
Year of fee payment: 12
|21 févr. 2012||AS||Assignment|
Owner name: CITICORP NORTH AMERICA, INC., AS AGENT, NEW YORK
Free format text: SECURITY INTEREST;ASSIGNORS:EASTMAN KODAK COMPANY;PAKON, INC.;REEL/FRAME:028201/0420
Effective date: 20120215
|1 févr. 2013||AS||Assignment|
Owner name: KODAK AVIATION LEASING LLC, NEW YORK
Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001
Effective date: 20130201
Owner name: KODAK REALTY, INC., NEW YORK
Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001
Effective date: 20130201
Owner name: NPEC INC., NEW YORK
Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001
Effective date: 20130201
Owner name: KODAK PORTUGUESA LIMITED, NEW YORK
Effective date: 20130201
Owner name: LASER-PACIFIC MEDIA CORPORATION, NEW YORK
Effective date: 20130201
Owner name: PAKON, INC., INDIANA
Effective date: 20130201
Owner name: CREO MANUFACTURING AMERICA LLC, WYOMING
Effective date: 20130201
Owner name: FPC INC., CALIFORNIA
Effective date: 20130201
Owner name: EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC.,
Effective date: 20130201
Owner name: KODAK PHILIPPINES, LTD., NEW YORK
Effective date: 20130201
Owner name: QUALEX INC., NORTH CAROLINA
Effective date: 20130201
Owner name: KODAK IMAGING NETWORK, INC., CALIFORNIA
Effective date: 20130201
Owner name: EASTMAN KODAK COMPANY, NEW YORK
Effective date: 20130201
Owner name: KODAK AMERICAS, LTD., NEW YORK
Effective date: 20130201
Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK
Effective date: 20130201
Owner name: KODAK (NEAR EAST), INC., NEW YORK
Effective date: 20130201
|8 mars 2013||AS||Assignment|
Owner name: APPLE INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EASTMAN KODAK COMPANY;REEL/FRAME:029939/0508
Effective date: 20130211