CA2146050C - Method and apparatus for compressing a sequence of information-bearing frames having at least two media components - Google Patents
Method and apparatus for compressing a sequence of information-bearing frames having at least two media components Download PDFInfo
- Publication number
- CA2146050C CA2146050C CA002146050A CA2146050A CA2146050C CA 2146050 C CA2146050 C CA 2146050C CA 002146050 A CA002146050 A CA 002146050A CA 2146050 A CA2146050 A CA 2146050A CA 2146050 C CA2146050 C CA 2146050C
- Authority
- CA
- Canada
- Prior art keywords
- frames
- component
- information
- representative
- segment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/025—Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame
- H04N7/035—Circuits for the digital non-picture data signal, e.g. for slicing of the data signal, for regeneration of the data-clock signal, for error detection or correction of the data signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/142—Detection of scene cut or scene change
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/73—Querying
- G06F16/738—Presentation of query results
- G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/7844—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using original textual content or text extracted from visual content or transcript of audio data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/41—Bandwidth or redundancy reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/179—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scene or a shot
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/87—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving scene cut or scene change detection in combination with video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
Abstract
An apparatus and method for compressing a sequence of frames having at least first and second information-bearing media components selects a plurality of representative frames from among the sequence of frames. The representative frames represent information contained in the first information-bearing media component. A
correspondence is then formed between each of the representative frames and one of a plurality of segments of the second information-bearing media component. The representative frames, the plurality of segments of the second information-bearing media component and the correspondence between them are recorded for subsequent retrieval. If the first information-bearing media component is a video component composed of a plurality of scenes, a representative frame may be selected from each scene. Additionally, if the second information-bearing media component is a closed-caption component, a printed rendition of the representative frames and the closed-caption component may be provided. The printed rendition constitutes a pictorial transcript in which each representative frame is printed with a caption containing the closed-caption text associated therewith.
correspondence is then formed between each of the representative frames and one of a plurality of segments of the second information-bearing media component. The representative frames, the plurality of segments of the second information-bearing media component and the correspondence between them are recorded for subsequent retrieval. If the first information-bearing media component is a video component composed of a plurality of scenes, a representative frame may be selected from each scene. Additionally, if the second information-bearing media component is a closed-caption component, a printed rendition of the representative frames and the closed-caption component may be provided. The printed rendition constitutes a pictorial transcript in which each representative frame is printed with a caption containing the closed-caption text associated therewith.
Description
z146o~0 METHOD AND APPARATUS FOR COMPRESSING A SEQUENCE
OF INFORMATION-BEARING FRAMES HAVING AT LEAST TWO
MEDIA COMPONENTS
TECHNICAL FIELD
This invention relates generally to a method of compressing a sequence of information-bearing frames, and more particularly to a method of compressing a sequence of information-bearing frames having at least two media components such as a video program.
BACKGROUND
Multimedia sources of information such as video programs are one form of multimedia data composed of at least two distinct media components. For example, a video program is composed of a full motion video component and an audio component. A number of methods are known for reducing the large storage and transmission requirements of the video component of video programs. For example, certain compression methods (such as JPEG) take advantage of spatial redundancies that exist within an individual video frame to reduce the number of bytes required to represent the frame. Additional compression may be achieved by taking advantage of the temporal redundancy that exists between consecutive frames, which is the basis 2o for known compression methods such as MPEG. These known compression methods generate a fixed number of frames per unit time to preserve the motion information contained in the video program.
In contrast to the compression methods mentioned above, other methods compress video programs by selecting certain frames from the entire sequence of frames to serve as representative frames. For example, a single frame may be used to represent the visual information contained in any given 21~fi050 scene of the video program. A scene may be defined as a segment of the video program over which the visual contents do not change significantly.
Thus, a frame selected from the scene may be used to represent the entire scene without losing a substantially large amount of information. A series of such representative frames from all the scenes in the video program provides a reasonably accurate representation of the entire video program with an acceptable degree of information loss. These compression methods in effect perform a content-based sampling of the video program. Unlike the temporal or spatial compression methods discussed above in which the frames are uniformly spaced in time, a content-based sampling method performs a temporally non-uniform sampling of the video program to generate a set of representative frames. For example, a single representative frame may represent a long segment of the video program (e.g., a long scene in which a person makes a speech without substantially changing position for an is extended period) or a very short segment of the video program (e.g., a scene displayed in the video program for only a few seconds).
Methods for automatically generating representative images from video programs are known. These methods may detect the boundaries between consecutive shots and may additionally detect scene changes that 20 occur within the individual shots.
.. 21~so5o Content-based sampling methods are typically employed for indexing purposes because the representative frames generated by such methods can efficiently convey the visual information contained in a video program. However, these methods fail to convey all the useful information contained in a multimedia format such as video because they only compress one media component , namely, in the case of video, the video component, while excluding the remaining media component (e.g., audio) or components.
SUMMARY
The present invention provides an apparatus and method for compressing a sequence of frames having at least first and second information-bearing media components. The sequence of frames may constitute, for example, a video program in which the first information-bearing component is a video component and the second information-bearing component is a closed-caption component. In accordance with the invention, t5 a plurality of representative frames are selected from among the sequence of frames. The representative frames represent information contained in the first information-bearing media component. A correspondence is then formed between each of the representative frames and one of a plurality of segments of the second information-bearing media component. The 20 representative frames, the plurality of segments of the second information-bearing media component and the correspondence between them are recorded for subsequent retrieval.
In one embodiment of the invention, the representative frames are selected by sampling the sequence of frames in a content-based manner.
25 For example, if the first information-bearing media component is a video ~mso~o component composed of a plurality of scenes, a representative frame may be selected from each scene. Additionally, if the second information-bearing media component is a closed-caption component, a printed rendition of the representative frames and the closed-caption component may be provided.
The printed rendition constitutes a pictorial transcript in which each representative frame is printed with a caption containing the closed-caption text associated therewith. One advantage provided by this embodiment of the invention is that while the information embodied in the original format (e.g., a video program) typically requires additional equipment (e.g., a video to cassette recorder and monitor) to be understood, the information embodied in the printed pictorial transcript is self-contained and can be understood directly without requiring additional processing or equipment.
In an alternative embodiment of the invention, a method is provided for displaying a compressed rendition of a sequence of frames having at t5 least first and second information-bearing media components. In accordance with the method, a plurality of representative frames are received which represent information contained in the first information-bearing media component.
Additionally, a signal is received that has information that forms a correspondence between each of the representative frames and a segment of the second information-20 bearing media component. Finally, the representative frames and the segment of the second information-bearing media component are displayed in a manner determined by the correspondence therebetween.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram of one example of an apparatus for 25 compressing multimedia data in accordance with the present invention.
FIG. 2 shows an example of a correspondence table for locating representative frames and closed-caption components of a closed-caption video program.
FIG. 3 is an example of one page of a printed pictorial transcript generated from a television news program in accordance with method of the present invention.
DETAILED DESCRIPTION
Certain video programs such as television broadcasts often include a closed-caption component as part of each frame of video. When to decoded, the closed-caption component of each frame contains up to two alphanumeric characters or control characters. The sequence of these characters form words and sentences over several or more frames. This text is typically recovered by a dedicated closed-caption decoder and superimposed on the frames displayed on a video screen. The text contains dialog or other is information that corresponds to the audio portion of the program. Details regarding the addition of closed-caption information to a video source are disclosed, for example, in Report No. E-7709-C by the Public Broadcasting Service entitled "Television Captioning For the Deaf: Signal and Display Specifications," by John Lentz et al., May, 1980.
2o The present invention will be described in terms of a method for compressing a closed-caption video program in which a representative frame from each scene in the program is combined with the text generated by decoding the closed-caption component of the video program. As used herein the term video is not limited to any particular video standard but rather refers 25 to any sequence of frames having at least two information-bearing media components, one of which is a visual information component. The frames may be recorded in any format, including film, conventional video, or various ~mso~o electronic forms such as a computer memory. The term frame refers to the atomic elements of recorded information for all the media components employed in connection with a particular format.
While the present invention will be described in terms of a method of compressing a video program having a closed-caption component, it will be understood by one of ordinary skill in the art that this method is equally applicable to any source of multimedia information having at least two media components. For example, the method may be employed to compress a video program having a video component and an audio to component. The audio component may include speech and other auditory information such as music, for example. If desired, the audio component may undergo a speech-to-text conversion process so that a pictorial transcript as described below may be generated.
FIG. 1 shows a block diagram of an apparatus 2 for compressing ~5 multimedia data in accordance with the present invention. For purposes of illustration the apparatus 2 will be described as receiving a video input from a video input source 1 such as a video tuner connected to an antenna or cable television, a video-cassette recorder, or any other source capable of providing video and closed-caption information. The apparatus 2 is composed of a 2o scene change detector 4, a closed-caption decoder 5 and a digital computer 8.
The scene change detector 4 operates on the video signal received from the input source 1 to generate a representative frame for each scene in the video signal. Scene change detectors that select representative frames are known and examples of such are provided in the above-mentioned references that are 25 incorporated by reference. The representative frames each contain visual information representing the visual information content of an entire scene.
The scene change detector 4 may include an image digitizer for digitizing the input if an analog input source is employed rather than a digital input source.
The representative frames extracted by the scene change detector 4 are transmitted to the digital computer 8. The closed-caption decoder 5, which also receives the video signal from the input source 1, extracts the closed-caption characters from the video signal and transmits them to the digital computer 8 in decoded form. The digital computer 8 stores the representative frames and the closed-caption information in a retrievable format in, for example, the main memory 9 or the hard disk 10. As described in more detail below, the digital computer 8 also establishes a correspondence between each to representative frame and a segment of the closed-caption information by constructing a correspondence table. The representative frames and closed-caption component may be subsequently retrieved and directed to a printer 12 or a display 13, or alternatively, transmitted over a communications network 14.
~s A content-based compression method that generates a single representative frame for each of the N scenes in a video program will retain N
representative frames I1 through IN. Examples of such compression methods are disclosed in the above-mentioned references that are incorporated by reference. Since each representative frame represents the visual information 2o contained in a single scene, each representative frame has associated with it a time interval equal to the length of the scene from which the frame is selected.
For example, the time interval associated with representative frame Ii begins with the detection of the ith scene boundary and ends one frame prior to the detection of the (i+1)th scene boundary. The series of consecutive frames 2s constituting the scene from which the representative frame Ii is selected is denoted VSi. Accordingly, the set of N representative frames I1 through IN
divide the video program into N non-overlapping visual segments VS1 214fifl50 through VSN and each representative frame Ii is associated with visual segment VSi.
Since each frame of the video program is associated with a portion of the closed-caption component, each of the series of frames s constituting visual segment VSi is associated with a closed-caption segment denoted TSi. Accordingly, when the method of this invention divides the video program into N visual segments VS1 through VSN each being characterized by a single representative frame, it will also divide the closed-caption component into N segments. The closed-caption component may be to divided into segments, for example, by time-stamping the closed-caption component as it is received by the computer 8 each time a new visual segment is detected by the scene change detector 4. The N closed-caption segments TSi correspond in a one-to one-manner with the N visual segments VSi. This correspondence between the representative frames of each visual segment VSi ~ s and the N closed-caption segments TSi may be established by a correspondence table such as shown in FIG. 2.
The correspondence table 21 employs a frame memory 22 and a text memory 23 which are located in the digital computer 8. The frame memory 22 stores the representative frames I1 through IN produced by the 2o scene change detector 4 and the text memory 23 stores the closed-caption segments TS1 through TSN. The correspondence table 21 has at least two columns and N rows for the N representative frames. The first column 26 of the table contains information that points to frames I1 through IN. This information may be in the form of a pointer (denoted in FIG. 2 as frame 2s pointers PI1 through PIN) that points to the location of the representative frames stored in memory 22. For example, pointer PI1 points to representative frame I1 located in row 1. This information is sufficient to determine the beginning and end locations of the frames in the memory 22 if the frames are of fixed size. In the event the frames are of variable size, the end of frame Ii can be determined with pointer PI~i+1), assuming the frames are stored in sequential order in consecutive memory locations. The second column 27 of the correspondence table contains information that points to the closed-caption segments TS1 through TSN. Similar to the first column of the table, information pertaining to frame Ii is contained in row i of the second column 27. This information also may be in the form of a pointer, referred to as closed-caption pointer PTi, which points to the location of closed-caption segment TSi. The end of the closed-caption segment TSi associated with frame Ii can be located with pointer PT~i+1). FIG. 2 shows two additional pointers that may be employed, an image end pointer 26, and text end pointer 27, which indicate the end of the Nth representative frame and Nth closed-caption segment, respectively.
~s The organization of the correspondence table is not limited to the example described above. One of ordinary skill in the art will recognize that the correspondence table may be implemented in any desired manner to ensure that each representative frame is properly correlated with its associated closed-caption segment so that both components are readily 2o retrievable. For example, the correspondence table may contain additional columns for storing information such as the size of the representative frames and the closed-caption segments, the frame numbers that indicate the beginning and end of each visual segment, the length of each scene, or the number of characters in the closed-caption segments. Alternatively, each 2s representative frame and the closed-caption segments associated therewith may be stored as individual files. In this arrangement the entries in the 214-6050 to columns of the correspondence table will identify the location or name of each file.
Once the representative frames and closed-caption segments constituting the compressed video program have been extracted from the s original video program and the correspondence table prepared, the data may be recorded in any convenient manner for subsequent retrieval. Thereafter the data may be printed, displayed or transmitted in any desired format. For example, the data may be printed, displayed, or transmitted in the form of a pictorial transcript in which a series of representative frames are each to provided with captions of the closed-caption text. An example of a pictorial transcript format is shown in FIG. 3 for a portion of television news program.
The transcript may be printed with a commercial text processing package that is capable of conveniently incorporating pictures into text.
Prior to printing the pictorial transcript, it may be necessary to ~5 remove non-printable control characters contained in the closed-caption signal which are used to control display functions. These characters control such features as the color of the displayed characters, the font, and the location of the text line on the display screen, for example. In addition to being non-printable, the control characters may adversely effect the proper division of 2o the closed-caption component based on individual scenes in the manner described above. In particular, the control characters may cause the text contained in the closed-caption component to be divided in the middle of a sentence. This improper division of the closed-caption component may occur for other reasons as well, including improper synchronization between the 25 video component and the closed-caption component, for example. Improper synchronization may occur because of a delay in the detection of a scene boundary or a delay in transmitting the closed-caption component to the z~4so5u digital computer. Regardless of the reason for the improper division, it may be desirable to process the raw text to remove the control characters and shift the boundary between adjacent closed-caption segments so that word fragments are merged into complete words and sentence fragments are merged into complete sentences. Word fragments may be readily identified by locating characters that fall on opposite sides of a closed-caption pointer which are not separated by an appropriate character such as space. These characters then may be joined to form complete words. Similarly, sentences fragments may be identified by locating words on opposite sides of a closed-caption pointer which are not separated by a character such as a question mark, exclamation mark, or a period. These fragments are then merged into a single sentence. The closed-caption pointer in then adjusted accordingly to include complete words and sentences in the text which are associated with a single representative image.
t5 Rather than removing the control characters, the control characters may be replaced with another character or characters that can be properly interpreted in subsequent processing stages such as the text processing stage. For example, a control character that is used to change the font or the color in the closed-caption display window may be replaced with 2o the corresponding font change command used in the text processing package that is employed.
The characters transmitted in the closed-caption component of a video program are typically all transmitted in the upper case. Accordingly, in addition to removing or replacing control characters prior to printing the 25 pictorial transcript, it may desirable to first process the raw text extracted from the closed-caption component to convert some of the upper case characters to lower case in a manner consistent with ordinary printed text.
This processing may be accomplished in a number of ways. For example, the upper case characters may first all be converted to lower case characters. The first character following a punctuation character such as a period or question mark is then capitalized. Finally, many proper nouns that require capitalization may be located in an electronically stored dictionary. The text in the example of a pictorial transcript shown in FIG. 3 has been partially processed in this manner. The characters were all converted from upper case to lower case and the first character following a period capitalized. As is apparent from the figure, proper nouns have not been capitalized.
OF INFORMATION-BEARING FRAMES HAVING AT LEAST TWO
MEDIA COMPONENTS
TECHNICAL FIELD
This invention relates generally to a method of compressing a sequence of information-bearing frames, and more particularly to a method of compressing a sequence of information-bearing frames having at least two media components such as a video program.
BACKGROUND
Multimedia sources of information such as video programs are one form of multimedia data composed of at least two distinct media components. For example, a video program is composed of a full motion video component and an audio component. A number of methods are known for reducing the large storage and transmission requirements of the video component of video programs. For example, certain compression methods (such as JPEG) take advantage of spatial redundancies that exist within an individual video frame to reduce the number of bytes required to represent the frame. Additional compression may be achieved by taking advantage of the temporal redundancy that exists between consecutive frames, which is the basis 2o for known compression methods such as MPEG. These known compression methods generate a fixed number of frames per unit time to preserve the motion information contained in the video program.
In contrast to the compression methods mentioned above, other methods compress video programs by selecting certain frames from the entire sequence of frames to serve as representative frames. For example, a single frame may be used to represent the visual information contained in any given 21~fi050 scene of the video program. A scene may be defined as a segment of the video program over which the visual contents do not change significantly.
Thus, a frame selected from the scene may be used to represent the entire scene without losing a substantially large amount of information. A series of such representative frames from all the scenes in the video program provides a reasonably accurate representation of the entire video program with an acceptable degree of information loss. These compression methods in effect perform a content-based sampling of the video program. Unlike the temporal or spatial compression methods discussed above in which the frames are uniformly spaced in time, a content-based sampling method performs a temporally non-uniform sampling of the video program to generate a set of representative frames. For example, a single representative frame may represent a long segment of the video program (e.g., a long scene in which a person makes a speech without substantially changing position for an is extended period) or a very short segment of the video program (e.g., a scene displayed in the video program for only a few seconds).
Methods for automatically generating representative images from video programs are known. These methods may detect the boundaries between consecutive shots and may additionally detect scene changes that 20 occur within the individual shots.
.. 21~so5o Content-based sampling methods are typically employed for indexing purposes because the representative frames generated by such methods can efficiently convey the visual information contained in a video program. However, these methods fail to convey all the useful information contained in a multimedia format such as video because they only compress one media component , namely, in the case of video, the video component, while excluding the remaining media component (e.g., audio) or components.
SUMMARY
The present invention provides an apparatus and method for compressing a sequence of frames having at least first and second information-bearing media components. The sequence of frames may constitute, for example, a video program in which the first information-bearing component is a video component and the second information-bearing component is a closed-caption component. In accordance with the invention, t5 a plurality of representative frames are selected from among the sequence of frames. The representative frames represent information contained in the first information-bearing media component. A correspondence is then formed between each of the representative frames and one of a plurality of segments of the second information-bearing media component. The 20 representative frames, the plurality of segments of the second information-bearing media component and the correspondence between them are recorded for subsequent retrieval.
In one embodiment of the invention, the representative frames are selected by sampling the sequence of frames in a content-based manner.
25 For example, if the first information-bearing media component is a video ~mso~o component composed of a plurality of scenes, a representative frame may be selected from each scene. Additionally, if the second information-bearing media component is a closed-caption component, a printed rendition of the representative frames and the closed-caption component may be provided.
The printed rendition constitutes a pictorial transcript in which each representative frame is printed with a caption containing the closed-caption text associated therewith. One advantage provided by this embodiment of the invention is that while the information embodied in the original format (e.g., a video program) typically requires additional equipment (e.g., a video to cassette recorder and monitor) to be understood, the information embodied in the printed pictorial transcript is self-contained and can be understood directly without requiring additional processing or equipment.
In an alternative embodiment of the invention, a method is provided for displaying a compressed rendition of a sequence of frames having at t5 least first and second information-bearing media components. In accordance with the method, a plurality of representative frames are received which represent information contained in the first information-bearing media component.
Additionally, a signal is received that has information that forms a correspondence between each of the representative frames and a segment of the second information-20 bearing media component. Finally, the representative frames and the segment of the second information-bearing media component are displayed in a manner determined by the correspondence therebetween.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram of one example of an apparatus for 25 compressing multimedia data in accordance with the present invention.
FIG. 2 shows an example of a correspondence table for locating representative frames and closed-caption components of a closed-caption video program.
FIG. 3 is an example of one page of a printed pictorial transcript generated from a television news program in accordance with method of the present invention.
DETAILED DESCRIPTION
Certain video programs such as television broadcasts often include a closed-caption component as part of each frame of video. When to decoded, the closed-caption component of each frame contains up to two alphanumeric characters or control characters. The sequence of these characters form words and sentences over several or more frames. This text is typically recovered by a dedicated closed-caption decoder and superimposed on the frames displayed on a video screen. The text contains dialog or other is information that corresponds to the audio portion of the program. Details regarding the addition of closed-caption information to a video source are disclosed, for example, in Report No. E-7709-C by the Public Broadcasting Service entitled "Television Captioning For the Deaf: Signal and Display Specifications," by John Lentz et al., May, 1980.
2o The present invention will be described in terms of a method for compressing a closed-caption video program in which a representative frame from each scene in the program is combined with the text generated by decoding the closed-caption component of the video program. As used herein the term video is not limited to any particular video standard but rather refers 25 to any sequence of frames having at least two information-bearing media components, one of which is a visual information component. The frames may be recorded in any format, including film, conventional video, or various ~mso~o electronic forms such as a computer memory. The term frame refers to the atomic elements of recorded information for all the media components employed in connection with a particular format.
While the present invention will be described in terms of a method of compressing a video program having a closed-caption component, it will be understood by one of ordinary skill in the art that this method is equally applicable to any source of multimedia information having at least two media components. For example, the method may be employed to compress a video program having a video component and an audio to component. The audio component may include speech and other auditory information such as music, for example. If desired, the audio component may undergo a speech-to-text conversion process so that a pictorial transcript as described below may be generated.
FIG. 1 shows a block diagram of an apparatus 2 for compressing ~5 multimedia data in accordance with the present invention. For purposes of illustration the apparatus 2 will be described as receiving a video input from a video input source 1 such as a video tuner connected to an antenna or cable television, a video-cassette recorder, or any other source capable of providing video and closed-caption information. The apparatus 2 is composed of a 2o scene change detector 4, a closed-caption decoder 5 and a digital computer 8.
The scene change detector 4 operates on the video signal received from the input source 1 to generate a representative frame for each scene in the video signal. Scene change detectors that select representative frames are known and examples of such are provided in the above-mentioned references that are 25 incorporated by reference. The representative frames each contain visual information representing the visual information content of an entire scene.
The scene change detector 4 may include an image digitizer for digitizing the input if an analog input source is employed rather than a digital input source.
The representative frames extracted by the scene change detector 4 are transmitted to the digital computer 8. The closed-caption decoder 5, which also receives the video signal from the input source 1, extracts the closed-caption characters from the video signal and transmits them to the digital computer 8 in decoded form. The digital computer 8 stores the representative frames and the closed-caption information in a retrievable format in, for example, the main memory 9 or the hard disk 10. As described in more detail below, the digital computer 8 also establishes a correspondence between each to representative frame and a segment of the closed-caption information by constructing a correspondence table. The representative frames and closed-caption component may be subsequently retrieved and directed to a printer 12 or a display 13, or alternatively, transmitted over a communications network 14.
~s A content-based compression method that generates a single representative frame for each of the N scenes in a video program will retain N
representative frames I1 through IN. Examples of such compression methods are disclosed in the above-mentioned references that are incorporated by reference. Since each representative frame represents the visual information 2o contained in a single scene, each representative frame has associated with it a time interval equal to the length of the scene from which the frame is selected.
For example, the time interval associated with representative frame Ii begins with the detection of the ith scene boundary and ends one frame prior to the detection of the (i+1)th scene boundary. The series of consecutive frames 2s constituting the scene from which the representative frame Ii is selected is denoted VSi. Accordingly, the set of N representative frames I1 through IN
divide the video program into N non-overlapping visual segments VS1 214fifl50 through VSN and each representative frame Ii is associated with visual segment VSi.
Since each frame of the video program is associated with a portion of the closed-caption component, each of the series of frames s constituting visual segment VSi is associated with a closed-caption segment denoted TSi. Accordingly, when the method of this invention divides the video program into N visual segments VS1 through VSN each being characterized by a single representative frame, it will also divide the closed-caption component into N segments. The closed-caption component may be to divided into segments, for example, by time-stamping the closed-caption component as it is received by the computer 8 each time a new visual segment is detected by the scene change detector 4. The N closed-caption segments TSi correspond in a one-to one-manner with the N visual segments VSi. This correspondence between the representative frames of each visual segment VSi ~ s and the N closed-caption segments TSi may be established by a correspondence table such as shown in FIG. 2.
The correspondence table 21 employs a frame memory 22 and a text memory 23 which are located in the digital computer 8. The frame memory 22 stores the representative frames I1 through IN produced by the 2o scene change detector 4 and the text memory 23 stores the closed-caption segments TS1 through TSN. The correspondence table 21 has at least two columns and N rows for the N representative frames. The first column 26 of the table contains information that points to frames I1 through IN. This information may be in the form of a pointer (denoted in FIG. 2 as frame 2s pointers PI1 through PIN) that points to the location of the representative frames stored in memory 22. For example, pointer PI1 points to representative frame I1 located in row 1. This information is sufficient to determine the beginning and end locations of the frames in the memory 22 if the frames are of fixed size. In the event the frames are of variable size, the end of frame Ii can be determined with pointer PI~i+1), assuming the frames are stored in sequential order in consecutive memory locations. The second column 27 of the correspondence table contains information that points to the closed-caption segments TS1 through TSN. Similar to the first column of the table, information pertaining to frame Ii is contained in row i of the second column 27. This information also may be in the form of a pointer, referred to as closed-caption pointer PTi, which points to the location of closed-caption segment TSi. The end of the closed-caption segment TSi associated with frame Ii can be located with pointer PT~i+1). FIG. 2 shows two additional pointers that may be employed, an image end pointer 26, and text end pointer 27, which indicate the end of the Nth representative frame and Nth closed-caption segment, respectively.
~s The organization of the correspondence table is not limited to the example described above. One of ordinary skill in the art will recognize that the correspondence table may be implemented in any desired manner to ensure that each representative frame is properly correlated with its associated closed-caption segment so that both components are readily 2o retrievable. For example, the correspondence table may contain additional columns for storing information such as the size of the representative frames and the closed-caption segments, the frame numbers that indicate the beginning and end of each visual segment, the length of each scene, or the number of characters in the closed-caption segments. Alternatively, each 2s representative frame and the closed-caption segments associated therewith may be stored as individual files. In this arrangement the entries in the 214-6050 to columns of the correspondence table will identify the location or name of each file.
Once the representative frames and closed-caption segments constituting the compressed video program have been extracted from the s original video program and the correspondence table prepared, the data may be recorded in any convenient manner for subsequent retrieval. Thereafter the data may be printed, displayed or transmitted in any desired format. For example, the data may be printed, displayed, or transmitted in the form of a pictorial transcript in which a series of representative frames are each to provided with captions of the closed-caption text. An example of a pictorial transcript format is shown in FIG. 3 for a portion of television news program.
The transcript may be printed with a commercial text processing package that is capable of conveniently incorporating pictures into text.
Prior to printing the pictorial transcript, it may be necessary to ~5 remove non-printable control characters contained in the closed-caption signal which are used to control display functions. These characters control such features as the color of the displayed characters, the font, and the location of the text line on the display screen, for example. In addition to being non-printable, the control characters may adversely effect the proper division of 2o the closed-caption component based on individual scenes in the manner described above. In particular, the control characters may cause the text contained in the closed-caption component to be divided in the middle of a sentence. This improper division of the closed-caption component may occur for other reasons as well, including improper synchronization between the 25 video component and the closed-caption component, for example. Improper synchronization may occur because of a delay in the detection of a scene boundary or a delay in transmitting the closed-caption component to the z~4so5u digital computer. Regardless of the reason for the improper division, it may be desirable to process the raw text to remove the control characters and shift the boundary between adjacent closed-caption segments so that word fragments are merged into complete words and sentence fragments are merged into complete sentences. Word fragments may be readily identified by locating characters that fall on opposite sides of a closed-caption pointer which are not separated by an appropriate character such as space. These characters then may be joined to form complete words. Similarly, sentences fragments may be identified by locating words on opposite sides of a closed-caption pointer which are not separated by a character such as a question mark, exclamation mark, or a period. These fragments are then merged into a single sentence. The closed-caption pointer in then adjusted accordingly to include complete words and sentences in the text which are associated with a single representative image.
t5 Rather than removing the control characters, the control characters may be replaced with another character or characters that can be properly interpreted in subsequent processing stages such as the text processing stage. For example, a control character that is used to change the font or the color in the closed-caption display window may be replaced with 2o the corresponding font change command used in the text processing package that is employed.
The characters transmitted in the closed-caption component of a video program are typically all transmitted in the upper case. Accordingly, in addition to removing or replacing control characters prior to printing the 25 pictorial transcript, it may desirable to first process the raw text extracted from the closed-caption component to convert some of the upper case characters to lower case in a manner consistent with ordinary printed text.
This processing may be accomplished in a number of ways. For example, the upper case characters may first all be converted to lower case characters. The first character following a punctuation character such as a period or question mark is then capitalized. Finally, many proper nouns that require capitalization may be located in an electronically stored dictionary. The text in the example of a pictorial transcript shown in FIG. 3 has been partially processed in this manner. The characters were all converted from upper case to lower case and the first character following a period capitalized. As is apparent from the figure, proper nouns have not been capitalized.
Claims (25)
1. A method of compressing a sequence of frames having at least first and second information-bearing media components, said method comprising the steps of:
selecting a plurality of representative frames representing information contained in the first information-bearing media component;
forming a correspondence between each of the representative frames and a segment of the second information-bearing media component; and recording said representative frames, said segment of the second information-bearing media component and the correspondence therebetween.
selecting a plurality of representative frames representing information contained in the first information-bearing media component;
forming a correspondence between each of the representative frames and a segment of the second information-bearing media component; and recording said representative frames, said segment of the second information-bearing media component and the correspondence therebetween.
2. The method of claim 1 wherein the step of selecting representative frames comprises the step of performing a content-based sampling of the sequence of frames to select the representative frames.
3. The method of claim 2 wherein the first information-bearing media component is a video component.
4. The method of claim 3 wherein the video component includes a series of scenes and the step of performing a content-based sampling to select the representative frames comprises the step of selecting a representative frame from each scene.
5. The method of claim 3 wherein the second information-bearing media component is a closed-caption component.
6. A method of compressing a sequence of visual information-bearing frames having a closed-caption component representing textual information associated therewith, said method comprising the steps of:
dividing the sequence of frames and closed-caption component into a plurality of segments;
retaining a representative frame from each segment;
retaining the closed-caption component of each segment; and recording the representative frame and the closed-caption component for each segment.
dividing the sequence of frames and closed-caption component into a plurality of segments;
retaining a representative frame from each segment;
retaining the closed-caption component of each segment; and recording the representative frame and the closed-caption component for each segment.
7. The method of claim 6 wherein the step of dividing the sequence of frames comprises the step of performing a content-based sampling of the sequence of frames to select the representative frames.
8. The method of claim 6 wherein each segment constitutes a single scene.
9. The method of claim 7 wherein each segment constitutes a single scene.
10. The method of claim 9 further comprising the step of decoding the closed-caption component.
11. The method of claim 10 further comprising the steps of generating and recording a correspondence table for locating the segment of the closed-caption component associated with each representative frame.
12. The method of claim 11 further comprising the step of generating a printed rendition of the representative frames and closed-caption component for each scene to provide a printed pictorial transcript.
13. The method of claim 11 further comprising the step of displaying the representative frame and closed-caption component for each scene to provide a pictorial transcript.
14. A method of compressing a sequence of visual information-bearing frames having an audio component associated therewith, said method comprising the steps of:
dividing the sequence of frames and associated audio component into a plurality of segments;
retaining a representative frame from each segment;
retaining the audio component of each segment; and recording each representative frame and the audio component segment associated therewith.
dividing the sequence of frames and associated audio component into a plurality of segments;
retaining a representative frame from each segment;
retaining the audio component of each segment; and recording each representative frame and the audio component segment associated therewith.
15. The method of claim 14 wherein the step of dividing the sequence of frames comprises the step of performing a content-based sampling of the sequence of frames to select the representative frames.
16. The method of claim 14 wherein each segment constitutes a single scene.
17. The method of claim 15 wherein each segment constitutes a single scene.
18. The method of claim 17 further comprising the steps of generating and recording a correspondence table for locating the audio component segment associated with each representative frame.
19. The method of claim 18 wherein the audio component includes a speech component and further comprising the step of converting the speech component to a text component.
20. The method of claim 19 further comprising the step of generating a printed rendition of the representative frame and the text component for each scene to provide a printed pictorial transcript.
21. An apparatus for compressing a sequence of frames having at least first and second information-bearing media components, comprising:
means for selecting a plurality of representative frames representing information contained in the first information-bearing media component;
means for forming a correspondence between each of the representative frames and one of a plurality of segments of the second information-bearing media component; and means for recording said representative frames, said plurality of segments of the second information-bearing media component and the correspondence therebetween.
means for selecting a plurality of representative frames representing information contained in the first information-bearing media component;
means for forming a correspondence between each of the representative frames and one of a plurality of segments of the second information-bearing media component; and means for recording said representative frames, said plurality of segments of the second information-bearing media component and the correspondence therebetween.
22. The apparatus of claim 21 wherein the selecting means comprises means for performing a content-based sampling of the sequence of frames to select the representative frames.
23. The apparatus of claim 22 wherein the selecting means comprises a scene change detector.
24. The apparatus of claim 22 further comprising means for decoding the second information-bearing component.
25. A method of displaying a compressed rendition of a sequence of frames having at least first and second information-bearing media components, said method comprising the steps of:
receiving a plurality of representative frames representing information contained in the first information-bearing media component;
receiving a signal having information that forms a correspondence between each of the representative frames and a segment of the second information-bearing media component; and displaying said representative frames and said segment of the second information-bearing media component in a manner determined by said correspondence therebetween.
receiving a plurality of representative frames representing information contained in the first information-bearing media component;
receiving a signal having information that forms a correspondence between each of the representative frames and a segment of the second information-bearing media component; and displaying said representative frames and said segment of the second information-bearing media component in a manner determined by said correspondence therebetween.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/252,861 US6271892B1 (en) | 1994-06-02 | 1994-06-02 | Method and apparatus for compressing a sequence of information-bearing frames having at least two media |
| US252,861 | 1994-06-02 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2146050A1 CA2146050A1 (en) | 1995-12-03 |
| CA2146050C true CA2146050C (en) | 2000-10-24 |
Family
ID=22957862
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002146050A Expired - Fee Related CA2146050C (en) | 1994-06-02 | 1995-03-31 | Method and apparatus for compressing a sequence of information-bearing frames having at least two media components |
Country Status (8)
| Country | Link |
|---|---|
| US (1) | US6271892B1 (en) |
| EP (1) | EP0685823B1 (en) |
| JP (1) | JP3025176B2 (en) |
| KR (1) | KR100340373B1 (en) |
| CA (1) | CA2146050C (en) |
| DE (1) | DE69520171T2 (en) |
| HK (1) | HK1004496A1 (en) |
| SG (1) | SG63521A1 (en) |
Families Citing this family (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2311678B (en) * | 1996-03-27 | 2000-06-28 | Sony Uk Ltd | Script editor |
| US6169789B1 (en) * | 1996-12-16 | 2001-01-02 | Sanjay K. Rao | Intelligent keyboard system |
| US6209028B1 (en) | 1997-03-21 | 2001-03-27 | Walker Digital, Llc | System and method for supplying supplemental audio information for broadcast television programs |
| US6473778B1 (en) * | 1998-12-24 | 2002-10-29 | At&T Corporation | Generating hypermedia documents from transcriptions of television programs using parallel text alignment |
| US6647535B1 (en) * | 1999-03-18 | 2003-11-11 | Xerox Corporation | Methods and systems for real-time storyboarding with a web page and graphical user interface for automatic video parsing and browsing |
| KR100634671B1 (en) * | 1999-08-13 | 2006-10-13 | 주식회사 케이티 | High accurate and real time gradual scene change detector and method |
| US7412643B1 (en) * | 1999-11-23 | 2008-08-12 | International Business Machines Corporation | Method and apparatus for linking representation and realization data |
| US7050109B2 (en) * | 2001-03-02 | 2006-05-23 | General Instrument Corporation | Methods and apparatus for the provision of user selected advanced close captions |
| US8479238B2 (en) | 2001-05-14 | 2013-07-02 | At&T Intellectual Property Ii, L.P. | Method for content-based non-linear control of multimedia playback |
| US7496676B2 (en) * | 2003-02-19 | 2009-02-24 | Maui X-Stream, Inc. | Methods, data structures, and systems for processing media data streams |
| US6938047B2 (en) * | 2003-02-19 | 2005-08-30 | Maui X-Stream, Inc. | Methods, data structures, and systems for processing media data streams |
| US6874160B1 (en) * | 2003-05-01 | 2005-03-29 | Nvidia Corporation | Digital video recorder and method of operating the same |
| US7664292B2 (en) * | 2003-12-03 | 2010-02-16 | Safehouse International, Inc. | Monitoring an output from a camera |
| US7447331B2 (en) * | 2004-02-24 | 2008-11-04 | International Business Machines Corporation | System and method for generating a viewable video index for low bandwidth applications |
| WO2007053112A1 (en) * | 2005-11-07 | 2007-05-10 | Agency For Science, Technology And Research | Repeat clip identification in video data |
| JP5444611B2 (en) * | 2007-12-18 | 2014-03-19 | ソニー株式会社 | Signal processing apparatus, signal processing method, and program |
| US8497939B2 (en) * | 2008-12-08 | 2013-07-30 | Home Box Office, Inc. | Method and process for text-based assistive program descriptions for television |
| US20100188573A1 (en) * | 2009-01-29 | 2010-07-29 | Usva Kuusiholma | Media metadata transportation |
| US20110125758A1 (en) * | 2009-11-23 | 2011-05-26 | At&T Intellectual Property I, L.P. | Collaborative Automated Structured Tagging |
| JP2015026913A (en) * | 2013-07-24 | 2015-02-05 | シャープ株式会社 | Printing data generation apparatus, image formation apparatus, printing data generation method, program, and recording medium |
| KR101924634B1 (en) * | 2017-06-07 | 2018-12-04 | 네이버 주식회사 | Content providing server, content providing terminal and content providing method |
Family Cites Families (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS60143330A (en) | 1983-12-29 | 1985-07-29 | Matsushita Electric Ind Co Ltd | Photographic device |
| US4823184A (en) | 1984-04-09 | 1989-04-18 | Corporate Communications Consultants, Inc. | Color correction system and method with scene-change detection |
| KR920008063B1 (en) | 1988-11-22 | 1992-09-22 | 마쯔시다덴기산교 가부시기가이샤 | Television signal receive apparatus |
| JPH02177684A (en) * | 1988-12-27 | 1990-07-10 | Matsushita Electric Ind Co Ltd | Inter-frame encoder for television signal |
| JP2977829B2 (en) | 1989-01-11 | 1999-11-15 | 株式会社東芝 | Moving picture reproducing apparatus and moving picture reproducing method |
| US5134472A (en) | 1989-02-08 | 1992-07-28 | Kabushiki Kaisha Toshiba | Moving object detection apparatus and method |
| DE69032361T2 (en) * | 1989-03-16 | 1998-10-29 | Fujitsu Ltd | VIDEO / AUDIO MULTIPLEX TRANSMISSION SYSTEM |
| GB2231745B (en) | 1989-04-27 | 1993-07-07 | Sony Corp | Motion dependent video signal processing |
| JP2861249B2 (en) | 1989-05-11 | 1999-02-24 | 日本電気株式会社 | Image change detection method and image change detection device |
| JPH0335676A (en) * | 1989-07-03 | 1991-02-15 | Hitachi Ltd | Moving image encoding system and moving image encoder using the same |
| US5099322A (en) | 1990-02-27 | 1992-03-24 | Texas Instruments Incorporated | Scene change detection system and method |
| JP2711172B2 (en) | 1990-06-15 | 1998-02-10 | アイワ株式会社 | Digital signal recording / reproducing method |
| US5172281A (en) * | 1990-12-17 | 1992-12-15 | Ardis Patrick M | Video transcript retriever |
| US5192964A (en) | 1991-03-04 | 1993-03-09 | Ricoh Company, Ltd. | Camera having blurring movement correction mechanism |
| JP2677312B2 (en) | 1991-03-11 | 1997-11-17 | 工業技術院長 | Camera work detection method |
| JP3103897B2 (en) | 1991-03-19 | 2000-10-30 | ソニー株式会社 | Camera shake correction device and camera shake correction method |
| AU657510B2 (en) * | 1991-05-24 | 1995-03-16 | Apple Inc. | Improved image encoding/decoding method and apparatus |
| US5265180A (en) | 1991-06-13 | 1993-11-23 | Intel Corporation | Method of encoding a sequence of images of a digital motion video signal |
| US5235419A (en) | 1991-10-24 | 1993-08-10 | General Instrument Corporation | Adaptive motion compensation using a plurality of motion compensators |
| JPH0756652B2 (en) * | 1992-03-24 | 1995-06-14 | インターナショナル・ビジネス・マシーンズ・コーポレイション | Search for video frame sequence |
| GB2280778B (en) * | 1992-04-10 | 1996-12-04 | Avid Technology Inc | Digital audio workstation providing digital storage and display of video information |
| US5471576A (en) * | 1992-11-16 | 1995-11-28 | International Business Machines Corporation | Audio/video synchronization for application programs |
| US5440336A (en) * | 1993-07-23 | 1995-08-08 | Electronic Data Systems Corporation | System and method for storing and forwarding audio and/or visual information on demand |
| US5481296A (en) * | 1993-08-06 | 1996-01-02 | International Business Machines Corporation | Apparatus and method for selectively viewing video information |
| US6055025A (en) | 1993-12-21 | 2000-04-25 | Lucent Technologies, Inc. | Method and apparatus for detecting abrupt and gradual scene changes in image sequences |
| US6211912B1 (en) | 1994-02-04 | 2001-04-03 | Lucent Technologies Inc. | Method for detecting camera-motion induced scene changes |
-
1994
- 1994-06-02 US US08/252,861 patent/US6271892B1/en not_active Expired - Lifetime
-
1995
- 1995-03-31 CA CA002146050A patent/CA2146050C/en not_active Expired - Fee Related
- 1995-05-24 DE DE69520171T patent/DE69520171T2/en not_active Expired - Lifetime
- 1995-05-24 EP EP95303498A patent/EP0685823B1/en not_active Expired - Lifetime
- 1995-05-25 JP JP7149746A patent/JP3025176B2/en not_active Expired - Lifetime
- 1995-05-26 SG SG1995000530A patent/SG63521A1/en unknown
- 1995-06-02 KR KR1019950014550A patent/KR100340373B1/en not_active IP Right Cessation
-
1998
- 1998-05-05 HK HK98103835A patent/HK1004496A1/en not_active IP Right Cessation
Also Published As
| Publication number | Publication date |
|---|---|
| HK1004496A1 (en) | 1998-11-27 |
| JPH0851369A (en) | 1996-02-20 |
| SG63521A1 (en) | 1999-03-30 |
| DE69520171D1 (en) | 2001-04-05 |
| EP0685823A3 (en) | 1996-05-01 |
| EP0685823B1 (en) | 2001-02-28 |
| KR960003446A (en) | 1996-01-26 |
| CA2146050A1 (en) | 1995-12-03 |
| DE69520171T2 (en) | 2001-07-19 |
| KR100340373B1 (en) | 2002-11-30 |
| JP3025176B2 (en) | 2000-03-27 |
| US6271892B1 (en) | 2001-08-07 |
| EP0685823A2 (en) | 1995-12-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2146050C (en) | Method and apparatus for compressing a sequence of information-bearing frames having at least two media components | |
| US5519443A (en) | Method and apparatus for providing dual language captioning of a television program | |
| Shahraray et al. | Automatic generation of pictorial transcripts of video programs | |
| KR100596149B1 (en) | Apparatus for reformatting auxiliary information included in a television signal | |
| US6952236B2 (en) | System and method for conversion of text embedded in a video stream | |
| USRE45316E1 (en) | Method for automatically providing a compressed rendition of a video program in a format suitable for electronic searching and retrieval | |
| US8732783B2 (en) | Apparatus and method for providing additional information using extension subtitles file | |
| EP1301043B1 (en) | Subtitle encoding/decoding | |
| US20030065503A1 (en) | Multi-lingual transcription system | |
| Shahraray et al. | Automated authoring of hypermedia documents of video programs | |
| WO1997002700A2 (en) | Transmission of graphic images | |
| EP1672919B1 (en) | Apparatus for processing texts in digital broadcast receiver and method thereof | |
| US6829429B1 (en) | Video recording device for recording video signal including character information | |
| WO2005062610A1 (en) | Method and circuit for creating a multimedia summary of a stream of audiovisual data | |
| KR100393980B1 (en) | Method for processing hangul caption | |
| KR100404322B1 (en) | A Method of Summarizing News Video Based on Multimodal Features | |
| JP2000350117A (en) | Method for converting presentation form of caption text and method for providing timing information to caption | |
| JP2000253312A (en) | Method and system for producing program with subtitle | |
| KR100202223B1 (en) | Words caption input apparatus | |
| Laverty et al. | Extraction of Teletext Subtitles from Broadcast Television for Archival and Analysis | |
| Gibbon | David & Shahraray Behzad | |
| MXPA99005599A (en) | Method and apparatus for reformatting auxiliary information included in a television signal | |
| JPH06268914A (en) | Closed caption signal receiver |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |