CA2066702A1 - Method for decoding television signals - Google Patents

Method for decoding television signals

Info

Publication number
CA2066702A1
CA2066702A1 CA002066702A CA2066702A CA2066702A1 CA 2066702 A1 CA2066702 A1 CA 2066702A1 CA 002066702 A CA002066702 A CA 002066702A CA 2066702 A CA2066702 A CA 2066702A CA 2066702 A1 CA2066702 A1 CA 2066702A1
Authority
CA
Canada
Prior art keywords
fields
lines
ntsc
chrominance
separating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002066702A
Other languages
French (fr)
Inventor
Peter A. Monta
Jae S. Lim
Kenneth A. Parulski
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Massachusetts Institute of Technology
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2066702A1 publication Critical patent/CA2066702A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/77Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase
    • H04N9/78Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase for separating the brightness signal or the chrominance signal from the colour television signal, e.g. using comb filter
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0112Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards corresponding to a cinematograph film standard
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/11Scanning of colour motion picture films, e.g. for telecine

Abstract

A method for decoding National Television System Committee (NTSC) signals which exploits redundancies in film-to-NTSC transcoding, known as "3-2 pull-down". The decoding method estimates luma (Y) and chroma (C). The "3-2 pull-down" structure assigns three NTSC
fields to one frame of a film frame pair, and two NTSC fields to the other film frame. Luma and chroma in different film frames are separated using different methods, and the separated signals are better than the separated signals achieved using conventional one dimensional and two dimensional NTSC decoding methods. The new method for separating luma and chroma from composite NTSC
signals can be combined with an interlace-to-progressive method (22), which converts the decoded 3-2 NTSC signals (20) to two film frames, and an upconversion procedure (24), to yield improved image quality.

Description

20667~2 .. . . .

METHOD FOR DECODING TELEVISION SIGNALS
sackaround of the Invention This invention relates to decoding of television signals, and particularly to separation of chrominance and luminance in such decoding.
Separation of chrominance (chroma) and luminance tluma) in conventional television transmissions (e.g., NTSC, PAL, SECAM) is not an easy task because the two signals share spectrum. Typically, the separation is performed using one or two-dimensional bandpass filtering.
When film material, which is recorded at 24 frames/second, is converted for television transmission, which uses different rates (e.g., 30 frames/second, or 60 fields/second, for NTSC), it is conventional to generate successive fields of the television signal from the same frame of the film material. In the case of NTSC
transmission, the conventional conversion technique is known as "3-2 pull-down"; each pair of film frames is transformed to five NTSC fields; three NTSC fields are generated from one film frame, and two from the other.
Summarv of the Invention The invention takes advantage of the inherent redundancy in television transmissions encoded using such film-to-television conversion techniques, to provide improved separation of chrominance and luminance.
Separation of a desired component (e.g., chroma) is performed by arithmetically combining fields based on the same film frame in such a manner as to cancel or reduce contributions from the other component (e.g., luma), thereby leaving predominantly the desired component. A
second arithmetic combination can be used to separate the other component.

' 2 0 ~ 6~ 0 2 PCT/US91/02937 -~

~ 2 -In preferred embodiments, the technique is used with NTSC transmissions in which film has been encoded using the 3-2 pull-down technique. For the case of three successive NTSC fields being based on one film frame, chrominance is generated for lines of the first and third fields by forming the difference between corresponding lines from the first and third fields, and for the second field by interpolation from the chrominance generated for nearby lines in the first and third fields. Similarly, the luminance component for lines of the first and third fields is formed by summing signals from the first and third fields, and for lines of the second field by adding to those lines the chrominance interpolated for the lines. For the two-field case, the chrominance component is approximated for lines of both fields as the difference between signals for nearby lines in different fields, and the luminance component is appro~imated by removing from any given line the approximated chrominance component.
The invention improves the ~uality of NTSC
television images without increasing the amount of information to be transmitted or recorded. Fewer cross-luma and cross-chroma effects are produced than with conventional one dimensional or two dimensional NTSC
decoding.
Other features and advantages of the invention will be apparent from the following description of the preferred embodiments, and from the claims.
Descri~tion of the Preferred Embodiment Fig. l is a block diagram of a conventional NTSC
encoder.
Fig. 2 is a one dimensional spectrum of the NTSC
composite signal.
Fig. 3 is a block diagram of a conventional NTSC
decoder.

.. , , - : ...................... . .
., - ' ~ `' ' .. , :

20667~2 - W092/02102 PCT/US9l/02937 Fig. 4 is a block diagram of a conventional one dimensional luma (Y) and chroma (C) separation scheme.
Fig. 4A is the frequency response of a one dimensional notch filter used to recover luma.
Fig. 4B is the frequency response of a one dimensional bandpass filter used to recover chroma.
Fig. 4C is the two dimensional spatial frequency response of the bandpass filter used in Fig. 4B for recovering chroma.
Fig. 5 is a block diagram of a conventional two dimensional luma (Y) and chroma (C) separation scheme using a horizontal bandpass filter followed by a 2-tap vertical "comb filter".
Fig. 5A is the two dimensional spatial frequency response of the cascaded filter used in Fig. 5 for recovering chroma.
Fig. 6 is a block diagram of the preferred embodiment of the invention;
Fig. 7 is a diagrammatic representation of five NTSC fields corresponding to a pair of film frames in a "3-2 pull-down" NTSC signal.
Fig. 8 shows the method used in the invention to separate luma and chroma for the three NTSC fields of a "3-2 pull-down" pair.
Fig. 9 shows the method used in the invention to separate luma and chroma for the two NTSC fields of a "3-2 pull-down" pair.
Fig. 10 shows a vertical chroma filter for improving picture quality in the two-field case. -Before describing the preferred embodiment, it is instructive to review conventional methods for encoding and decoding NTSC signals, and for converting 24 frames/sec film to NTSC. A conventional NTSC encoder is shown in Fig. 1. A nonlinearity ("gamma correction") is applied to the Red/Green/Blue (RGB) signal (e.g., from a , . . . ~ :

W O 92/02102 P~r/US91/02937 - ~

camera, film scanner, etc.) to approximately linearize the light sensor. The signal is mapped to the YIQ color space with the Y component representing luminance ("luma") and the I and Q components, known as color-difference signals, representing chrominance ("chroma").The color-difference signals I and Q are band limited;
the I signal is lowpass-filtered to 1.3 MHz, and the Q
signal to 0.6 MHz. The two color-difference signals are then quadrature modulated on a "color subcarrier". The luminance is added to the resulting chrominance signal, and the composite signal is lowpass-filtered to 4.2 MHz.
Fig. 2 shows a one dimensional (lD) spectrum of the NTSC composite signal. I and Q are shifted in frequency by the modulation, and part of the I sideband is removed by the final filter.
As shown in Fig. 3, an NTSC signal is decoded by first separating luminance and chrominance, then demodulating the chrominance into baseband I and Q
signals. The color subcarrier is recovered from the composite signal by a phase-locked loop. The YIQ signal is then transformed to RGB (the color picture is reproduced by combining correct proportions of red, green and blue) and displayed.
Separation of the luminance and chrominance signals is not an easy task because the two signals share spectrum, thus making the process of adding the two signals irreversible. The simplest and the least expensive separation algorithm is purely one-dimensional.
Luma is recovered using the simple notch filter shown in Fig. 4A to remove the chroma. Chroma is recovered using the bandpass filter shown in Fig. 4B. Both filters are centered around the color subcarrier. Fig. 4C shows the two dimensional spatial frequency response of the band-pass filter of Fig. 4B. One dimensional filtering , . . . ,. ~
.
: . : , ' 20g67~2 - W092/02l02 PCT/US91/02937 J

produces cross-effects that are manifested as "crawling dots" and "rainbow" artiracts.
An improved, yet still conventional, separation algorithm uses a separable bandpass filter to recover the chrominance signal. As shown in Fig. 5, a horizontal bandpass filter is followed by a two-tap vertical "comb filter". Fig. 5A shows the resulting two dimensional spatial frequency response of this cascade of filters.
The two dimensional filtering results in a better chrominance signal with fewer cross effects.
Film is commonly converted for NTSC video transmission by a procedure known as "3-2 pull-down."
Film standards specify a frame rate of 24 Hz, whereas NTSC requires 30 frames per second, with each frame divided into two interlaced fields to produce 60 fields per second. Thus, to convert film to NTSC requires a frame rate conversion. Each pair of film frames is transformed to five NTSC fields; three NTSC fields are generated from one parity (e.g., even) film frames, and two NTSC fields from the other parity (e.g., odd) film frames.
A segment of the resulting NTSC transmission, with film frames and NTSC fields identified, is shown in Fig.
7. The fields are shown in "end view", with each solid dot representing a full line of the NTSC field. The first field, numbered 0 in Fig. 7, contains every other line of the image; the second field (numbered 1), which is interlaced with the first, contains the remaining lines. The phase of the color subcarrier is also shown in Fig. 7 (O radians is denoted by "~", and ~ radians by "-"). Because the color subcarrier is an odd multiple of half the line rate, the phase of the color subcarrier reverses between lines in a field. And, because of the number of lines in a field, the phase also reverses from one NTSC frame to the next, as shown.

- ~ ' ' .: ~ .; . ,~ , : . .:

. ~ :
WO92/02102 2 0 6 6 7 0 2 PCT/~S91/02937 -The procedures used for ~he separation are shown in Figs. 8 and 9. ~urning first to Fig. 8, luma (Y) for lines of fields o and 2 can be recovered perfectly by summing corresponding lines a, b in the two fields and dividing the sum by two. Chroma (C) for fields 0 and 2 can similarly be recovered perfectly by forming the difference between corresponding lines a, b and dividing by two. Chroma (C) for lines of field 1 is approximated by interpolating between the chroma computed for nearest neighbors in fields 0 and 2; thus, the chroma for line d in field 1 is assumed to be the average of the chroma values C1 through C4. The luma for line d of field 2 is approximated by subtracting out the approximate chroma value; because of the change in polarity of chroma, that step is accomplished by adding the approximate chroma value to line d.
The procedures for handling the two-field case are shown in Fig. 9. Chroma (C) for lines a, b is approximated by forming the difference between nearest lines a, b in fields 3 and 4, and then dividing the difference by two. Another possibility would be using lines a and d (essentially the conventional 2D separation scheme), but this would produce less resolution and more cross-luma than using samples a and b, since samples a and b are closer vertically than samples a and d, and thus are likely to have closer luma values. Luma (Y) is approximated by subtracting out the chroma approximation.

Because the two-field case produces images with identical chroma in adjacent lines (lines from adjacent fields being interlaced in the displayed image) it is preferable to apply some vertical chroma filtering. This will reduce chroma bandwidth but improve overall picture quality, by reducing such artifacts as jaggedness of - , . :, . . . . , , ~", . ~

- W O 92/02102 ~,;, ,.`. . PC~r~U~91/02937 diagonal edges. A suitable vertical ~ilter is shown in Fig. 10.
In those cases where approximations of chroma and luma are calculated, there will be, of course, some cross-luma, but it will be smaller than the cross-luma resulting from the conventional 2-dimensional (2D) filtering shown in Fig. 5. Further reductions in cross-luma can be achieved with adaptive filters. For the next pair of film frames (not shown), the fields reverse parity, and similar procedures apply.
Horizontal bandpass filtering similar to that used in conventional NTSC chroma separation should be used in conjunction with the invention, to further reduce cross-luma and cross-chroma. Such filtering should be used in both the three-field and two-field cases to reduce luma-chroma separation error resulting from channel noise.
Such filtering has the further benefit in the two-field case, of reducing the separation error inherent in the ~ -approximate rules used in the separation.
Combining this newly developed NTSC decoding procedure with the interlace-to-progressive procedures disclosed in pending U.S. Application Serial No.
07/471,S32 (filed January 29, 1990, entitled Adaptive Modulation Demodulation Video Signal Processing), and - -with an upconversion scheme, will yield very good quality pictures for screen display. As shown in Fig. 6, NTSC
decoder 20 (which embodies the chroma separation rules of the invention) is connected to progressive scan converter 22, the output of which is supplied to upconverter 24. -Other embodiments are within the following claims. -For example, it may be preferable in some circumstances to use the two-field rules for the three-field case, so that the same chroma separation rules are used for all frames. This will degrade chroma separation in the three-field case, but is one way of eliminating the - . . . ~, . . .
- : . ,. . :
. : : -WO92/02102 2 0 6 6 7 0 2 PCT/US91/02937 ~

"flicker" that may result from constantly switching between decoding rules.
What is claimed is:

,~:
, ' :: : :

:': :

Claims (16)

Claims
1. A method for separating the luminance and chrominance components of a television signal in which material having a frame rate other than that of the standard rate of the television signal has been converted to the standard rate of the television signal by generating successive fields of the television signal from the same frame of the material, said method comprising separating one of the components by forming a first arithmetic combination of lines from two or more of said successive fields in such a manner as to cancel or reduce contributions from the other of the components, thereby leaving predominantly the desired component.
2. The method of claim 1 wherein the component separated is chrominance.
3. The method of claim 2 further comprising the step of separating the luminance component by forming a second arithmetic combination of lines from two or more of said successive fields in such a manner as to cancel or reduce contributions from the chrominance component, thereby leaving predominantly the luminance component.
4. The method of claim 3 wherein said material is film recorded at 24 frames/second, said television signal conforms to the NTSC standard of 60 fields/second, and the conversion is done by the 3-2 pull-down method, so that for every pair of adjoining film frames, one frame provides image lines for three successive NTSC fields, and the other frame provides image lines for two successive NTSC fields.
5. The method of claim 4 wherein said step of separating the chrominance component comprises, for the case of three successive NTSC fields being based on one film frame, generating the chrominance for lines of the first and third fields by forming the difference between corresponding lines from the first and third fields.
6. The method of claim 5 wherein said step of separating the chrominance component comprises, for the case of three successive NTSC fields being based on one film frame, generating the chrominance component for lines of the second field by interpolation from the chrominance generated for nearby lines in the first and third fields.
7. The method of claim 4 wherein said step of separating the luminance component comprises, for the case of three successive NTSC fields being based on one film frame, generating the luminance component for lines of the first and third fields by summing signals from the first and third fields.
8. The method of claim 5 wherein said step of separating the luminance component comprises, for the case of three successive NTSC fields being based on one film frame, generating the luminance component for lines of the first and third fields by summing signals from the first and third fields.
9. The method of claim 8 wherein said step of separating the luminance component comprises, for the case of three successive NTSC fields being based on one film frame, generating the luminance component for lines of the second field by adding to those lines the chrominance interpolated for the lines.
10. The method of claim 4 wherein said step of separating the chrominance component comprises, for the case of two successive NTSC fields being based on one film frame, approximating the chrominance component for lines of both fields as the difference between signals for nearby lines in different fields.
11. The method of claim 10 wherein said step of separating the luminance component comprises, for the case of two successive NTSC fields being based on one film frame, approximating the luminance component for lines of both fields by removing from any given line the approximated chrominance component.
12. The method of claim 5 wherein the difference is divided by two to provide the chrominance component.
13. The method of claim 7 wherein the sum is divided by two to provide the luminance component.
14. The method of claim 8 wherein the sum is divided by two to provide the luminance component.
15. The method of claim 4 wherein said step of separating the chrominance component comprises, for both the two and three-field cases, approximating the chrominance component for lines of all fields as the difference between signals for nearby lines in different fields, so that the same separation rule is used for both the two and three-field cases.
16. The method of claim 15 wherein said step of separating the luminance component comprises, for both the two and three-field cases, approximating the luminance component for lines of all fields by removing from any given line the approximated chrominance component, so that the same separation rule is used for both the two and three-field cases.
CA002066702A 1990-07-26 1991-04-29 Method for decoding television signals Abandoned CA2066702A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US558,607 1990-07-26
US07/558,607 US5161006A (en) 1990-07-26 1990-07-26 Method for separating chrominance and luminance components of a television signal

Publications (1)

Publication Number Publication Date
CA2066702A1 true CA2066702A1 (en) 1992-01-27

Family

ID=24230213

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002066702A Abandoned CA2066702A1 (en) 1990-07-26 1991-04-29 Method for decoding television signals

Country Status (5)

Country Link
US (1) US5161006A (en)
JP (1) JP2863632B2 (en)
AU (1) AU7795691A (en)
CA (1) CA2066702A1 (en)
WO (1) WO1992002102A1 (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9214214D0 (en) * 1992-07-03 1992-08-12 Snell & Wilcox Ltd Video signal processing
US8102419B1 (en) * 1993-05-24 2012-01-24 Deluxe Media Services Llc Method and apparatus for improved scanning of film
US5345407A (en) * 1993-08-23 1994-09-06 Motorola, Inc. Digital multiband filter and method thereof
US6175389B1 (en) * 1999-02-04 2001-01-16 Conexant Systems, Inc. Comb filtered signal separation
US6751256B1 (en) 2000-11-15 2004-06-15 The Regents Of The University Of California Transmission of digital images within the NTSC analog format
US7006147B2 (en) * 2000-12-22 2006-02-28 Thomson Lincensing Method and system for MPEG chroma de-interlacing
US20040155983A1 (en) * 2003-02-10 2004-08-12 Topper Robert J. Reduced artifact luminance/chrominance (Y/C) separator for use in an NTSC decoder
US20040179141A1 (en) * 2003-03-10 2004-09-16 Topper Robert J. Method, apparatus, and system for reducing cross-color distortion in a composite video signal decoder
US7453525B2 (en) * 2005-05-24 2008-11-18 Texas Instruments Incorporated Motion detector for a video display system
US7355655B2 (en) * 2005-05-24 2008-04-08 Texas Instruments Incorporated Systems and methods for separating luma and chroma information in a composite video signal
US10869011B1 (en) 2019-09-30 2020-12-15 Sony Corporation Blind legacy video artifact reduction

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US459289A (en) * 1891-09-08 Driving mechanism for planters
US421152A (en) * 1890-02-11 zellers
JPS58117788A (en) * 1982-01-06 1983-07-13 Hitachi Ltd Color television signal processing circuit
JPS60204182A (en) * 1984-03-28 1985-10-15 Sony Corp Editing system of video signal
US4641188A (en) * 1985-07-31 1987-02-03 Rca Corporation Progressive scan display system employing line and frame memories
US4979036A (en) * 1988-05-31 1990-12-18 U.S. Philips Corporation Television motion detection arrangement
US4881125A (en) * 1988-10-14 1989-11-14 General Instrument Corporation Progressive scan display of video derived from film
US4876596A (en) * 1988-10-25 1989-10-24 Faroudja Y C Film-to-video converter with scan line doubling

Also Published As

Publication number Publication date
JPH05502775A (en) 1993-05-13
AU7795691A (en) 1992-02-18
JP2863632B2 (en) 1999-03-03
US5161006A (en) 1992-11-03
WO1992002102A1 (en) 1992-02-06

Similar Documents

Publication Publication Date Title
KR910000548B1 (en) Progressive scan television system employing vertical detail
US4701783A (en) Technique for encoding and decoding video with improved separation of chrominance and luminance
CA1305783C (en) Progressive scan television system with sum and difference components
US4530004A (en) Color television signal processing circuit
JPS6390987A (en) Moving detecting circuit
JPS62276983A (en) Sequential scanning
US5161006A (en) Method for separating chrominance and luminance components of a television signal
US4742386A (en) Method and apparatus for encoding component digital video signals so as to compress the bandwidth thereof, and for decoding the same
JPH08506699A (en) Device for combining and separating components of video signal
US5229847A (en) Television signal processing system including modulated auxiliary carrier
WO1992007444A1 (en) Side panel signal processor for a widescreen television system
US5103296A (en) Color television system having adaptive filters in the transmitter encoder and in the receiver decoder
GB2262859A (en) Letterbox television signal with chrominance helper signal
JPH02108390A (en) Luminance signal and chrominance signal separating circuit for pal color television signal
JPH07162810A (en) Mode converting device for television signal
EP0447214A2 (en) Compatible television system with companded auxiliary signal
US4616251A (en) Progressive scan television system employing a comb filter
JP2566026B2 (en) Television signal transmission system
CA1229160A (en) Field comb for luminance separation of ntsc signals
JP2508509B2 (en) Digital color-video signal interpolation circuit
JP2612892B2 (en) Image transmission system
JP2566027B2 (en) Television signal receiver
JPS58177078A (en) Television signal processing circuit
JP2928561B2 (en) Method and apparatus for forming television signal
Haskell et al. Video Basics

Legal Events

Date Code Title Description
FZDE Discontinued