US20060291750A1 - Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution) - Google Patents

Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution) Download PDF

Info

Publication number
US20060291750A1
US20060291750A1 US11/301,817 US30181705A US2006291750A1 US 20060291750 A1 US20060291750 A1 US 20060291750A1 US 30181705 A US30181705 A US 30181705A US 2006291750 A1 US2006291750 A1 US 2006291750A1
Authority
US
United States
Prior art keywords
resolution
super
video
image
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/301,817
Inventor
Peyman Milanfar
Sina Farsiu
Michael Elad
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US11/301,817 priority Critical patent/US20060291750A1/en
Priority to US11/584,400 priority patent/US7379612B2/en
Publication of US20060291750A1 publication Critical patent/US20060291750A1/en
Assigned to NATIONAL SCIENCE FOUNDATION reassignment NATIONAL SCIENCE FOUNDATION CONFIRMATORY LICENSE (SEE DOCUMENT FOR DETAILS). Assignors: UNIVERSITY OF CALIFORNIA
Assigned to NATIONAL SCIENCE FOUNDATION reassignment NATIONAL SCIENCE FOUNDATION CONFIRMATORY LICENSE (SEE DOCUMENT FOR DETAILS). Assignors: UNIVERSITY OF CALIFORNIA
Abandoned legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image
    • G06T3/40—Scaling the whole image or part thereof
    • G06T3/4053—Super resolution, i.e. output image resolution higher than sensor resolution
    • G06T3/4076—Super resolution, i.e. output image resolution higher than sensor resolution by iteratively correcting the provisional high resolution image using the original low-resolution image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition

Definitions

  • This invention relates generally to a class of digital image processing techniques known as digital image reconstruction. More particularly, it relates to methods for computing a temporal sequence of resolution-enhanced images from an original sequence of lower-resolution images.
  • Super-resolution image reconstruction is a kind of digial image processing that increases the resolvable detail in images.
  • the earliest techniques for super-resolution generated a still image of a scene from a collection of similar lower-resolution images of the same scene. For example, several frames of low-resolution video may be combined using super-resolution techniques to produce a single still image whose resolution is significantly higher than that of any single frame of the original video. Because each low-resolution frame is slightly different and contributes some unique information that is absent from the other frames, the reconstructed still image has more information, i.e., higher resolution, than that of any one of the originals alone.
  • Super-resolution techniques have many applications in diverse areas such as medical imaging, remote sensing, surveillance, still photography, and motion pictures.
  • the details of how to reconstruct the best high-resolution image from multiple low-resolution images is a complicated problem that has been an active topic of research for many years, and many different techniques have been proposed.
  • One reason the super-resolution reconstruction problem is so challenging is because the reconstruction process is, in mathematical terms, an under-constrained inverse problem.
  • the known low-resolution images are represented as resulting from a transformation of the unknown high-resolution image by effects of image warping due to motion, optical blurring, sampling, and noise.
  • the model is inverted, the original set of low-resolution images does not, in general, determine a single high-resolution image as a unique solution.
  • constraints that are selected to produce optimal results for a restricted class of image data may produce significantly degraded results for images that deviate even slightly from the restricted class.
  • super-resolution techniques should be computationally efficient and produce desired improvements in image quality that are robust to variations in the properties of input image data.
  • the present invention provides a dynamic super-resolution technique that is computationally efficient.
  • a recursive computation takes as input a previously computed super-resolved image, combines this super-resolved image with a next low-resolution input frame in a sequence, and produces a new super-resolved image.
  • a sequence of super-resolved images is produced.
  • the technique uses a computationally simple and effective method based on adaptive filtering for computing a high resolution image and updating this high resolution image over time to produce an enhanced sequence of images.
  • the method may be implemented as a general super-resolution software tool capable of handing a wide variety of input image data.

Abstract

In one aspect, the present invention provides a dynamic super-resolution technique that is computationally efficient. A recursive computation takes as input a previously computed super-resolved image derived from a sequence of low-resolution input frames. Combining this super-resolved image with a later low-resolution input frame in the sequence, the technique produces a new super-resolved image. By recursive application, a sequence of super-resolved images is produced. In a preferred embodiment, the technique uses a computationally simple and effective method based on adaptive filtering for computing a high resolution image and updating this high resolution image over time to produce an enhanced sequence of images. The method may be implemented as a general super-resolution software tool capable of handing a wide variety of input image data.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims priority from U.S. provisional patent application Ser. No. 60/637058 filed 12/16/2004, which is incorporated herein by reference.
    • STATEMENT OF GOVERNMENT SPONSORED SUPPORT
  • This invention was supported in part by the National Science Foundation under grant CCR-9984246 and by the U.S. Air Force under contract F49620-03-01-0387. The U.S. Government may have certain rights in the invention.
    • FIELD OF THE INVENTION
  • This invention relates generally to a class of digital image processing techniques known as digital image reconstruction. More particularly, it relates to methods for computing a temporal sequence of resolution-enhanced images from an original sequence of lower-resolution images.
    • BACKGROUND OF THE INVENTION
  • Super-resolution image reconstruction is a kind of digial image processing that increases the resolvable detail in images. The earliest techniques for super-resolution generated a still image of a scene from a collection of similar lower-resolution images of the same scene. For example, several frames of low-resolution video may be combined using super-resolution techniques to produce a single still image whose resolution is significantly higher than that of any single frame of the original video. Because each low-resolution frame is slightly different and contributes some unique information that is absent from the other frames, the reconstructed still image has more information, i.e., higher resolution, than that of any one of the originals alone. Super-resolution techniques have many applications in diverse areas such as medical imaging, remote sensing, surveillance, still photography, and motion pictures.
  • The details of how to reconstruct the best high-resolution image from multiple low-resolution images is a complicated problem that has been an active topic of research for many years, and many different techniques have been proposed. One reason the super-resolution reconstruction problem is so challenging is because the reconstruction process is, in mathematical terms, an under-constrained inverse problem. In the mathematical formulation of the problem, the known low-resolution images are represented as resulting from a transformation of the unknown high-resolution image by effects of image warping due to motion, optical blurring, sampling, and noise. When the model is inverted, the original set of low-resolution images does not, in general, determine a single high-resolution image as a unique solution. Moreover, in cases where a unique solution is determined, it is not stable, i.e., small noise perturbations in the images can result in large differences in the super-resolved image. To address these problems, super-resolution techniques require the introduction of additional assumptions (e.g., assumptions about the nature of the noise, blur, or spatial movement present in the original images). Part of the challenge rests in selecting constraints that sufficiently restrict the solution space without an unacceptable increase in the computational complexity. Another challenge is to select constraints that properly restrict the solution space to good high-resolution images for a wide variety of input image data. For example, constraints that are selected to produce optimal results for a restricted class of image data (e.g., images limited to pure translational movement between frames and common space-invariant blur) may produce significantly degraded results for images that deviate even slightly from the restricted class. In summary, super-resolution techniques should be computationally efficient and produce desired improvements in image quality that are robust to variations in the properties of input image data.
  • More recently, researchers have started to investigate dynamic super-resolution techniques, i.e., the use of super-resolution to produce not just a single still image, but a temporal sequence of resolution-enhanced video frames. While it may appear that this problem is a simple extension of the static SR situation, the memory and computational requirements for the dynamic case are so taxing as to preclude its application without highly efficient algorithms. While it may be obvious to repeatedly apply still image super-resolution techniques to produce a sequence of super-resolved frames, this approach is computationally inefficient. It thus remains a challenge to design a dynamic super-resolution technique that is computationally efficient.
    • SUMMARY OF THE INVENTION
  • In one aspect, the present invention provides a dynamic super-resolution technique that is computationally efficient. A recursive computation takes as input a previously computed super-resolved image, combines this super-resolved image with a next low-resolution input frame in a sequence, and produces a new super-resolved image. By recursive application, a sequence of super-resolved images is produced. In a preferred embodiment, the technique uses a computationally simple and effective method based on adaptive filtering for computing a high resolution image and updating this high resolution image over time to produce an enhanced sequence of images. The method may be implemented as a general super-resolution software tool capable of handing a wide variety of input image data.
    • DETAILED DESCRIPTION
  • Descriptions and figures of various embodiments of the present invention are disclosed in the following appendices:
      • Appendix A: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Dynamic Demosaicing and Color Super-Resolution of Video Sequences,” Proceedings, 2004 SPIE Conf. on Image Reconstruction from Incomplete Data, August 2004, Denver, Colo., 10 pages.
      • Appendix B: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Dynamic Super-Resolution,” 10 pages.
      • Appendix C: Sina Farsiu, Michael Elad, Peyman Milanfar “Dynamic Super-Resolution,” 5 pages.
      • Appendix D: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Dynamic Demosaicing and Color Super-Resolution of Video Sequences,” 8 pages.
      • Appendix E: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Fast Dynamic Super-Resolution” Abstract, 1 page.
      • Appendix F: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Advances and Challenges in Super-Resolution” International Journal of Imaging Systems and Technology, V. 14, No 2, pp. 47-57, August 2004.
  • As one of ordinary skill in the art will appreciate, various changes, substitutions, and alterations could be made or otherwise implemented without departing from the principles of the present invention. Accordingly, the examples and drawings disclosed herein including the appendix are for purposes of illustrating the preferred embodiments of the present invention and are not to be construed as limiting the invention.

Claims (1)

1. A computer-implemented method for dynamic super-resolution, the method comprising:
computing an initial super-resolved image from at least one low-resolution image; and
computing a next super-resolved image in a super-resolved image sequence from information in a previous super-resolved image in the super-resolved image sequence and a next low-resolution image in a low-resolution image sequence.
US11/301,817 2004-12-16 2005-12-12 Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution) Abandoned US20060291750A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US11/301,817 US20060291750A1 (en) 2004-12-16 2005-12-12 Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution)
US11/584,400 US7379612B2 (en) 2004-12-16 2006-10-19 Dynamic reconstruction of high-resolution video from color-filtered low-resolution video-to-video super-resolution

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US63705804P 2004-12-16 2004-12-16
US11/301,817 US20060291750A1 (en) 2004-12-16 2005-12-12 Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution)

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US11/584,400 Continuation US7379612B2 (en) 2004-12-16 2006-10-19 Dynamic reconstruction of high-resolution video from color-filtered low-resolution video-to-video super-resolution

Publications (1)

Publication Number Publication Date
US20060291750A1 true US20060291750A1 (en) 2006-12-28

Family

ID=37567430

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/301,817 Abandoned US20060291750A1 (en) 2004-12-16 2005-12-12 Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution)
US11/584,400 Active 2026-12-28 US7379612B2 (en) 2004-12-16 2006-10-19 Dynamic reconstruction of high-resolution video from color-filtered low-resolution video-to-video super-resolution

Family Applications After (1)

Application Number Title Priority Date Filing Date
US11/584,400 Active 2026-12-28 US7379612B2 (en) 2004-12-16 2006-10-19 Dynamic reconstruction of high-resolution video from color-filtered low-resolution video-to-video super-resolution

Country Status (1)

Country Link
US (2) US20060291750A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101794440A (en) * 2010-03-12 2010-08-04 东南大学 Weighted adaptive super-resolution reconstructing method for image sequence
US20110182528A1 (en) * 2008-07-25 2011-07-28 Eads Deutschland Gmbh Method and device for generating images having a reduced error rate, high resolution and improved contrast
US8750647B2 (en) 2011-02-03 2014-06-10 Massachusetts Institute Of Technology Kinetic super-resolution imaging
CN104867107A (en) * 2015-06-04 2015-08-26 清华大学深圳研究生院 Image super-resolution method
CN110084752A (en) * 2019-05-06 2019-08-02 电子科技大学 A kind of Image Super-resolution Reconstruction method based on edge direction and K mean cluster
CN111489292A (en) * 2020-03-04 2020-08-04 北京思朗科技有限责任公司 Super-resolution reconstruction method and device for video stream
CN111915492A (en) * 2020-08-19 2020-11-10 四川省人工智能研究院(宜宾) Multi-branch video super-resolution method and system based on dynamic reconstruction
WO2022242448A1 (en) * 2021-05-20 2022-11-24 腾讯科技（深圳）有限公司 Image processing method and apparatus, and computer device, program and storage medium

Families Citing this family (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004088992A1 (en) * 2003-03-28 2004-10-14 Olympus Corporation Image processing device and image processing program
DE60317053T2 (en) * 2003-07-04 2008-08-07 Mitsubishi Denki K.K. Method and device for displaying a group of pictures
JP4461937B2 (en) * 2003-09-30 2010-05-12 セイコーエプソン株式会社 Generation of high-resolution images based on multiple low-resolution images
US7412107B2 (en) * 2004-12-17 2008-08-12 The Regents Of The University Of California, Santa Cruz System and method for robust multi-frame demosaicing and color super-resolution
US8666196B2 (en) * 2005-01-19 2014-03-04 The United States Of America As Represented By The Secretary Of The Army System and method for super-resolution imaging from a sequence of color filter array (CFA) low-resolution images
CN101371569B (en) * 2006-01-17 2011-07-27 皇家飞利浦电子股份有限公司 Detection of the presence of television signals embedded in noise using cyclostationary toolbox
US7860333B2 (en) 2007-01-09 2010-12-28 University Of Utah Research Foundation Systems and methods for deblurring data corrupted by shift variant blurring
JP4839448B2 (en) * 2007-03-19 2011-12-21 国立大学法人東京工業大学 Image quality improvement processing method and image quality improvement processing program for multiple areas
JP4776587B2 (en) * 2007-06-13 2011-09-21 国立大学法人北海道大学 Image processing device, driving support device
US8290212B2 (en) * 2007-07-17 2012-10-16 Lockheed Martin Corporation Super-resolving moving vehicles in an unregistered set of video frames
WO2009034688A1 (en) * 2007-09-10 2009-03-19 Nikon Corporation Image processing method and program
US8212837B1 (en) 2007-10-02 2012-07-03 Grandeye, Ltd. Color processing pipelines generating a lower color bit-depth image compared to an unprocessed image from a wide-angle camera
US20090110285A1 (en) * 2007-10-26 2009-04-30 Technion Research And Development Foundation Ltd Apparatus and method for improving image resolution using fuzzy motion estimation
TWI381719B (en) * 2008-02-18 2013-01-01 Univ Nat Taiwan Full-frame video stabilization with a polyline-fitted camcorder path
US8306121B2 (en) * 2008-03-17 2012-11-06 Ati Technologies Ulc Method and apparatus for super-resolution of images
US7941004B2 (en) * 2008-04-30 2011-05-10 Nec Laboratories America, Inc. Super resolution using gaussian regression
TWI396142B (en) * 2008-09-11 2013-05-11 Nat Univ Tsing Hua Method of 3d image reconstitution with complementary fusion
US8165394B2 (en) * 2008-09-18 2012-04-24 Microsoft Corporation Reconstruction of image in a Bayer pattern
US20100086048A1 (en) * 2008-10-03 2010-04-08 Faisal Ishtiaq System and Method for Video Image Processing
US9064476B2 (en) * 2008-10-04 2015-06-23 Microsoft Technology Licensing, Llc Image super-resolution using gradient profile prior
KR101659427B1 (en) * 2009-02-06 2016-09-23 가부시키가이샤 한도오따이 에네루기 켄큐쇼 Method for driving display device
US8218068B2 (en) * 2009-04-01 2012-07-10 Omnivision Technologies, Inc. Exposing pixel groups in producing digital images
US8520736B2 (en) * 2009-04-14 2013-08-27 Fastvdo, Llc Real-time superresolution and video transmission
EP2302588B1 (en) * 2009-08-21 2012-02-29 Telefonaktiebolaget L M Ericsson (Publ) Method and apparatus for estimation of interframe motion fields
US8487929B2 (en) * 2009-09-09 2013-07-16 Advanced Micro Devices, Inc. Resolution enhancement of video stream based on spatial and temporal correlation
US8558899B2 (en) * 2009-11-16 2013-10-15 The Aerospace Corporation System and method for super-resolution digital time delay and integrate (TDI) image processing
TWI399703B (en) * 2009-12-02 2013-06-21 Micro Star Int Co Ltd Forward and backward resizing method
US8884989B2 (en) * 2009-12-23 2014-11-11 Indian Institute Of Technology Bombay System and method for fusing images
JP2011180798A (en) * 2010-03-01 2011-09-15 Sony Corp Image processing apparatus, image processing method, and program
JP2012004908A (en) * 2010-06-17 2012-01-05 Sony Corp Image processing device, image processing method and program
RU2431889C1 (en) * 2010-08-06 2011-10-20 Дмитрий Валерьевич Шмунк Image super-resolution method and nonlinear digital filter for realising said method
US9137503B2 (en) * 2010-11-03 2015-09-15 Sony Corporation Lens and color filter arrangement, super-resolution camera system and method
JP5653184B2 (en) * 2010-11-11 2015-01-14 三菱電機株式会社 Image processing apparatus and method
US8368774B2 (en) * 2010-11-22 2013-02-05 The Aerospace Corporation Imaging geometries for scanning optical detectors with overlapping fields of regard and methods for providing and utilizing same
CN102073993B (en) * 2010-12-29 2012-08-22 清华大学 Camera self-calibration-based jittering video deblurring method and device
US8768069B2 (en) 2011-02-24 2014-07-01 Sony Corporation Image enhancement apparatus and method
JP2012186593A (en) * 2011-03-04 2012-09-27 Sony Corp Image processing system, image processing method, and program
DE202012013411U1 (en) 2011-04-25 2016-11-15 Terra Bella Technologies Inc. Systems for overhead image and video display
US9292905B2 (en) * 2011-06-24 2016-03-22 Thomson Licensing Method and device for processing of an image by regularization of total variation
US8718407B2 (en) * 2011-11-18 2014-05-06 Stmicroelectronics (Canada), Inc. High-quality single-frame superresolution training and reconstruction engine
US20130177242A1 (en) * 2012-01-10 2013-07-11 James E. Adams, Jr. Super-resolution image using selected edge pixels
CN103152540B (en) * 2013-03-11 2016-01-20 深圳创维－Rgb电子有限公司 Resolution conversion method and device, ultra-high-definition television
US20150363912A1 (en) * 2014-06-12 2015-12-17 Samsung Electronics Co., Ltd. Rgbw demosaic method by combining rgb chrominance with w luminance
US10230925B2 (en) 2014-06-13 2019-03-12 Urthecast Corp. Systems and methods for processing and providing terrestrial and/or space-based earth observation video
US10410398B2 (en) * 2015-02-20 2019-09-10 Qualcomm Incorporated Systems and methods for reducing memory bandwidth using low quality tiles
US10871561B2 (en) 2015-03-25 2020-12-22 Urthecast Corp. Apparatus and methods for synthetic aperture radar with digital beamforming
CN108432049B (en) 2015-06-16 2020-12-29 阿卜杜拉阿齐兹国王科技城 Efficient planar phased array antenna assembly
WO2017091747A1 (en) 2015-11-25 2017-06-01 Urthecast Corp. Synthetic aperture radar imaging apparatus and methods
CA3064735C (en) 2017-05-23 2022-06-21 Urthecast Corp. Synthetic aperture radar imaging apparatus and methods
EP3646054A4 (en) 2017-05-23 2020-10-28 King Abdulaziz City for Science and Technology Synthetic aperture radar imaging apparatus and methods for moving targets
US10337923B2 (en) * 2017-09-13 2019-07-02 Qualcomm Incorporated Directional interpolation and cross-band filtering for hyperspectral imaging
WO2019226194A2 (en) 2017-11-22 2019-11-28 Urthecast Corp. Synthetic aperture radar apparatus and methods
CN108830790B (en) * 2018-05-16 2022-09-13 宁波大学 Rapid video super-resolution reconstruction method based on simplified convolutional neural network
CN108961186B (en) * 2018-06-29 2022-02-15 福建帝视信息科技有限公司 Old film repairing and reproducing method based on deep learning
US11720999B2 (en) * 2019-10-11 2023-08-08 Kayrros Method, device and non-transitory computer-readable storage medium for increasing the resolution and dynamic range of a sequence of respective top view images of a same terrestrial location
US11544815B2 (en) 2019-11-18 2023-01-03 Advanced Micro Devices, Inc. Gaming super resolution
US11240465B2 (en) 2020-02-21 2022-02-01 Alibaba Group Holding Limited System and method to use decoder information in video super resolution

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6411333B1 (en) * 1999-04-02 2002-06-25 Teralogic, Inc. Format conversion using patch-based filtering
US6434280B1 (en) * 1997-11-10 2002-08-13 Gentech Corporation System and method for generating super-resolution-enhanced mosaic images
US6650335B2 (en) * 2001-02-22 2003-11-18 Mitsubishi Electric Research Laboratories, Inc. Method for extracting static and dynamic super-resolution textures form a sequence of images
US6766067B2 (en) * 2001-04-20 2004-07-20 Mitsubishi Electric Research Laboratories, Inc. One-pass super-resolution images
US7085323B2 (en) * 2002-04-03 2006-08-01 Stmicroelectronics, Inc. Enhanced resolution video construction method and apparatus
US7218796B2 (en) * 2003-04-30 2007-05-15 Microsoft Corporation Patch-based video super-resolution

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5691777A (en) * 1988-10-17 1997-11-25 Kassatly; Lord Samuel Anthony Method and apparatus for simultaneous compression of video, audio and data signals
US6400996B1 (en) * 1999-02-01 2002-06-04 Steven M. Hoffberg Adaptive pattern recognition based control system and method
US5995457A (en) * 1993-12-22 1999-11-30 Jamail; Randall H. Method of masking data on digital video disks (DVD)
US6542925B2 (en) * 1995-05-30 2003-04-01 Roy-G-Biv Corporation Generation and distribution of motion commands over a distributed network
US6381179B1 (en) * 2000-02-24 2002-04-30 Advanced Micro Devices, Inc. Using a negative gate erase to increase the cycling endurance of a non-volatile memory cell with an oxide-nitride-oxide (ONO) structure

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6434280B1 (en) * 1997-11-10 2002-08-13 Gentech Corporation System and method for generating super-resolution-enhanced mosaic images
US6411333B1 (en) * 1999-04-02 2002-06-25 Teralogic, Inc. Format conversion using patch-based filtering
US6650335B2 (en) * 2001-02-22 2003-11-18 Mitsubishi Electric Research Laboratories, Inc. Method for extracting static and dynamic super-resolution textures form a sequence of images
US6766067B2 (en) * 2001-04-20 2004-07-20 Mitsubishi Electric Research Laboratories, Inc. One-pass super-resolution images
US7085323B2 (en) * 2002-04-03 2006-08-01 Stmicroelectronics, Inc. Enhanced resolution video construction method and apparatus
US7218796B2 (en) * 2003-04-30 2007-05-15 Microsoft Corporation Patch-based video super-resolution

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110182528A1 (en) * 2008-07-25 2011-07-28 Eads Deutschland Gmbh Method and device for generating images having a reduced error rate, high resolution and improved contrast
US8849059B2 (en) * 2008-07-25 2014-09-30 Eads Deutschland Gmbh Method and device for generating images having a reduced error rate, high resolution and improved contrast
CN101794440A (en) * 2010-03-12 2010-08-04 东南大学 Weighted adaptive super-resolution reconstructing method for image sequence
US8750647B2 (en) 2011-02-03 2014-06-10 Massachusetts Institute Of Technology Kinetic super-resolution imaging
CN104867107A (en) * 2015-06-04 2015-08-26 清华大学深圳研究生院 Image super-resolution method
CN110084752A (en) * 2019-05-06 2019-08-02 电子科技大学 A kind of Image Super-resolution Reconstruction method based on edge direction and K mean cluster
CN111489292A (en) * 2020-03-04 2020-08-04 北京思朗科技有限责任公司 Super-resolution reconstruction method and device for video stream
CN111915492A (en) * 2020-08-19 2020-11-10 四川省人工智能研究院(宜宾) Multi-branch video super-resolution method and system based on dynamic reconstruction
WO2022242448A1 (en) * 2021-05-20 2022-11-24 腾讯科技（深圳）有限公司 Image processing method and apparatus, and computer device, program and storage medium

Also Published As

Publication number Publication date
US7379612B2 (en) 2008-05-27
US20070071362A1 (en) 2007-03-29

Similar Documents

Publication Publication Date Title
US20060291750A1 (en) Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution)
US7412107B2 (en) System and method for robust multi-frame demosaicing and color super-resolution
US20060291751A1 (en) Robust reconstruction of high resolution grayscale images from a sequence of low-resolution frames (robust gray super-resolution)
Gunturk et al. Super-resolution reconstruction of compressed video using transform-domain statistics
EP2489007B1 (en) Image deblurring using a spatial image prior
Rav-Acha et al. Two motion-blurred images are better than one
Hardie et al. Joint MAP registration and high-resolution image estimation using a sequence of undersampled images
US7616826B2 (en) Removing camera shake from a single photograph using statistics of a natural image
US8233541B2 (en) Recursive image quality enhancement on super resolution video
EP1492051A2 (en) Method of restoring and reconstructing super-resolution image from low-resolution compressed image
US20110090378A1 (en) Image deblurring using panchromatic pixels
US8126281B2 (en) Image processing apparatus, method, and computer-readable medium for generating motion compensation images
Gunturk et al. Multiframe resolution-enhancement methods for compressed video
Patanavijit Super-resolution reconstruction and its future research direction
Tom et al. Reconstruction of a high resolution image from multiple low resolution images
Zhang et al. Bracketing is All You Need: Unifying Image Restoration and Enhancement Tasks with Multi-Exposure Images
Schuler et al. Increasing spatial resolution through temporal super-sampling of digital video
Hardie et al. High-resolution image reconstruction from a sequence of rotated and translated infrared images
Shao et al. Partition-based interpolation for color filter array demosaicking and super-resolution reconstruction
Güngör et al. A transform learning based deconvolution technique with super-resolution and microscanning applications
Salem et al. Non-parametric super-resolution using a bi-sensor camera
Li et al. Reconstruction of bionic compound eye images based on superresolution algorithm
Li et al. Wavelet domain superresolution reconstruction of infrared image sequences
KR20050090920A (en) Method for producing enhanced-resolution image by use of a plurality of low-resolution images
Gunturk et al. Gray-scale resolution enhancement

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: NATIONAL SCIENCE FOUNDATION, VIRGINIA

Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF CALIFORNIA;REEL/FRAME:025762/0295

Effective date: 20080724

AS Assignment

Owner name: NATIONAL SCIENCE FOUNDATION, VIRGINIA

Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF CALIFORNIA;REEL/FRAME:025561/0750

Effective date: 20080724