US20060291750A1 - Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution) - Google Patents
Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution) Download PDFInfo
- Publication number
- US20060291750A1 US20060291750A1 US11/301,817 US30181705A US2006291750A1 US 20060291750 A1 US20060291750 A1 US 20060291750A1 US 30181705 A US30181705 A US 30181705A US 2006291750 A1 US2006291750 A1 US 2006291750A1
- Authority
- US
- United States
- Prior art keywords
- resolution
- super
- video
- image
- sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4053—Super resolution, i.e. output image resolution higher than sensor resolution
- G06T3/4076—Super resolution, i.e. output image resolution higher than sensor resolution by iteratively correcting the provisional high resolution image using the original low-resolution image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
Definitions
- This invention relates generally to a class of digital image processing techniques known as digital image reconstruction. More particularly, it relates to methods for computing a temporal sequence of resolution-enhanced images from an original sequence of lower-resolution images.
- Super-resolution image reconstruction is a kind of digial image processing that increases the resolvable detail in images.
- the earliest techniques for super-resolution generated a still image of a scene from a collection of similar lower-resolution images of the same scene. For example, several frames of low-resolution video may be combined using super-resolution techniques to produce a single still image whose resolution is significantly higher than that of any single frame of the original video. Because each low-resolution frame is slightly different and contributes some unique information that is absent from the other frames, the reconstructed still image has more information, i.e., higher resolution, than that of any one of the originals alone.
- Super-resolution techniques have many applications in diverse areas such as medical imaging, remote sensing, surveillance, still photography, and motion pictures.
- the details of how to reconstruct the best high-resolution image from multiple low-resolution images is a complicated problem that has been an active topic of research for many years, and many different techniques have been proposed.
- One reason the super-resolution reconstruction problem is so challenging is because the reconstruction process is, in mathematical terms, an under-constrained inverse problem.
- the known low-resolution images are represented as resulting from a transformation of the unknown high-resolution image by effects of image warping due to motion, optical blurring, sampling, and noise.
- the model is inverted, the original set of low-resolution images does not, in general, determine a single high-resolution image as a unique solution.
- constraints that are selected to produce optimal results for a restricted class of image data may produce significantly degraded results for images that deviate even slightly from the restricted class.
- super-resolution techniques should be computationally efficient and produce desired improvements in image quality that are robust to variations in the properties of input image data.
- the present invention provides a dynamic super-resolution technique that is computationally efficient.
- a recursive computation takes as input a previously computed super-resolved image, combines this super-resolved image with a next low-resolution input frame in a sequence, and produces a new super-resolved image.
- a sequence of super-resolved images is produced.
- the technique uses a computationally simple and effective method based on adaptive filtering for computing a high resolution image and updating this high resolution image over time to produce an enhanced sequence of images.
- the method may be implemented as a general super-resolution software tool capable of handing a wide variety of input image data.
Abstract
In one aspect, the present invention provides a dynamic super-resolution technique that is computationally efficient. A recursive computation takes as input a previously computed super-resolved image derived from a sequence of low-resolution input frames. Combining this super-resolved image with a later low-resolution input frame in the sequence, the technique produces a new super-resolved image. By recursive application, a sequence of super-resolved images is produced. In a preferred embodiment, the technique uses a computationally simple and effective method based on adaptive filtering for computing a high resolution image and updating this high resolution image over time to produce an enhanced sequence of images. The method may be implemented as a general super-resolution software tool capable of handing a wide variety of input image data.
Description
- This application claims priority from U.S. provisional patent application Ser. No. 60/637058 filed 12/16/2004, which is incorporated herein by reference.
- This invention was supported in part by the National Science Foundation under grant CCR-9984246 and by the U.S. Air Force under contract F49620-03-01-0387. The U.S. Government may have certain rights in the invention.
- This invention relates generally to a class of digital image processing techniques known as digital image reconstruction. More particularly, it relates to methods for computing a temporal sequence of resolution-enhanced images from an original sequence of lower-resolution images.
- Super-resolution image reconstruction is a kind of digial image processing that increases the resolvable detail in images. The earliest techniques for super-resolution generated a still image of a scene from a collection of similar lower-resolution images of the same scene. For example, several frames of low-resolution video may be combined using super-resolution techniques to produce a single still image whose resolution is significantly higher than that of any single frame of the original video. Because each low-resolution frame is slightly different and contributes some unique information that is absent from the other frames, the reconstructed still image has more information, i.e., higher resolution, than that of any one of the originals alone. Super-resolution techniques have many applications in diverse areas such as medical imaging, remote sensing, surveillance, still photography, and motion pictures.
- The details of how to reconstruct the best high-resolution image from multiple low-resolution images is a complicated problem that has been an active topic of research for many years, and many different techniques have been proposed. One reason the super-resolution reconstruction problem is so challenging is because the reconstruction process is, in mathematical terms, an under-constrained inverse problem. In the mathematical formulation of the problem, the known low-resolution images are represented as resulting from a transformation of the unknown high-resolution image by effects of image warping due to motion, optical blurring, sampling, and noise. When the model is inverted, the original set of low-resolution images does not, in general, determine a single high-resolution image as a unique solution. Moreover, in cases where a unique solution is determined, it is not stable, i.e., small noise perturbations in the images can result in large differences in the super-resolved image. To address these problems, super-resolution techniques require the introduction of additional assumptions (e.g., assumptions about the nature of the noise, blur, or spatial movement present in the original images). Part of the challenge rests in selecting constraints that sufficiently restrict the solution space without an unacceptable increase in the computational complexity. Another challenge is to select constraints that properly restrict the solution space to good high-resolution images for a wide variety of input image data. For example, constraints that are selected to produce optimal results for a restricted class of image data (e.g., images limited to pure translational movement between frames and common space-invariant blur) may produce significantly degraded results for images that deviate even slightly from the restricted class. In summary, super-resolution techniques should be computationally efficient and produce desired improvements in image quality that are robust to variations in the properties of input image data.
- More recently, researchers have started to investigate dynamic super-resolution techniques, i.e., the use of super-resolution to produce not just a single still image, but a temporal sequence of resolution-enhanced video frames. While it may appear that this problem is a simple extension of the static SR situation, the memory and computational requirements for the dynamic case are so taxing as to preclude its application without highly efficient algorithms. While it may be obvious to repeatedly apply still image super-resolution techniques to produce a sequence of super-resolved frames, this approach is computationally inefficient. It thus remains a challenge to design a dynamic super-resolution technique that is computationally efficient.
- In one aspect, the present invention provides a dynamic super-resolution technique that is computationally efficient. A recursive computation takes as input a previously computed super-resolved image, combines this super-resolved image with a next low-resolution input frame in a sequence, and produces a new super-resolved image. By recursive application, a sequence of super-resolved images is produced. In a preferred embodiment, the technique uses a computationally simple and effective method based on adaptive filtering for computing a high resolution image and updating this high resolution image over time to produce an enhanced sequence of images. The method may be implemented as a general super-resolution software tool capable of handing a wide variety of input image data.
- Descriptions and figures of various embodiments of the present invention are disclosed in the following appendices:
-
- Appendix A: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Dynamic Demosaicing and Color Super-Resolution of Video Sequences,” Proceedings, 2004 SPIE Conf. on Image Reconstruction from Incomplete Data, August 2004, Denver, Colo., 10 pages.
- Appendix B: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Dynamic Super-Resolution,” 10 pages.
- Appendix C: Sina Farsiu, Michael Elad, Peyman Milanfar “Dynamic Super-Resolution,” 5 pages.
- Appendix D: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Dynamic Demosaicing and Color Super-Resolution of Video Sequences,” 8 pages.
- Appendix E: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Fast Dynamic Super-Resolution” Abstract, 1 page.
- Appendix F: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Advances and Challenges in Super-Resolution” International Journal of Imaging Systems and Technology, V. 14, No 2, pp. 47-57, August 2004.
- As one of ordinary skill in the art will appreciate, various changes, substitutions, and alterations could be made or otherwise implemented without departing from the principles of the present invention. Accordingly, the examples and drawings disclosed herein including the appendix are for purposes of illustrating the preferred embodiments of the present invention and are not to be construed as limiting the invention.
Claims (1)
1. A computer-implemented method for dynamic super-resolution, the method comprising:
computing an initial super-resolved image from at least one low-resolution image; and
computing a next super-resolved image in a super-resolved image sequence from information in a previous super-resolved image in the super-resolved image sequence and a next low-resolution image in a low-resolution image sequence.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/301,817 US20060291750A1 (en) | 2004-12-16 | 2005-12-12 | Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution) |
US11/584,400 US7379612B2 (en) | 2004-12-16 | 2006-10-19 | Dynamic reconstruction of high-resolution video from color-filtered low-resolution video-to-video super-resolution |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US63705804P | 2004-12-16 | 2004-12-16 | |
US11/301,817 US20060291750A1 (en) | 2004-12-16 | 2005-12-12 | Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution) |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/584,400 Continuation US7379612B2 (en) | 2004-12-16 | 2006-10-19 | Dynamic reconstruction of high-resolution video from color-filtered low-resolution video-to-video super-resolution |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060291750A1 true US20060291750A1 (en) | 2006-12-28 |
Family
ID=37567430
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/301,817 Abandoned US20060291750A1 (en) | 2004-12-16 | 2005-12-12 | Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution) |
US11/584,400 Active 2026-12-28 US7379612B2 (en) | 2004-12-16 | 2006-10-19 | Dynamic reconstruction of high-resolution video from color-filtered low-resolution video-to-video super-resolution |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/584,400 Active 2026-12-28 US7379612B2 (en) | 2004-12-16 | 2006-10-19 | Dynamic reconstruction of high-resolution video from color-filtered low-resolution video-to-video super-resolution |
Country Status (1)
Country | Link |
---|---|
US (2) | US20060291750A1 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101794440A (en) * | 2010-03-12 | 2010-08-04 | 东南大学 | Weighted adaptive super-resolution reconstructing method for image sequence |
US20110182528A1 (en) * | 2008-07-25 | 2011-07-28 | Eads Deutschland Gmbh | Method and device for generating images having a reduced error rate, high resolution and improved contrast |
US8750647B2 (en) | 2011-02-03 | 2014-06-10 | Massachusetts Institute Of Technology | Kinetic super-resolution imaging |
CN104867107A (en) * | 2015-06-04 | 2015-08-26 | 清华大学深圳研究生院 | Image super-resolution method |
CN110084752A (en) * | 2019-05-06 | 2019-08-02 | 电子科技大学 | A kind of Image Super-resolution Reconstruction method based on edge direction and K mean cluster |
CN111489292A (en) * | 2020-03-04 | 2020-08-04 | 北京思朗科技有限责任公司 | Super-resolution reconstruction method and device for video stream |
CN111915492A (en) * | 2020-08-19 | 2020-11-10 | 四川省人工智能研究院(宜宾) | Multi-branch video super-resolution method and system based on dynamic reconstruction |
WO2022242448A1 (en) * | 2021-05-20 | 2022-11-24 | 腾讯科技(深圳)有限公司 | Image processing method and apparatus, and computer device, program and storage medium |
Families Citing this family (57)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004088992A1 (en) * | 2003-03-28 | 2004-10-14 | Olympus Corporation | Image processing device and image processing program |
DE60317053T2 (en) * | 2003-07-04 | 2008-08-07 | Mitsubishi Denki K.K. | Method and device for displaying a group of pictures |
JP4461937B2 (en) * | 2003-09-30 | 2010-05-12 | セイコーエプソン株式会社 | Generation of high-resolution images based on multiple low-resolution images |
US7412107B2 (en) * | 2004-12-17 | 2008-08-12 | The Regents Of The University Of California, Santa Cruz | System and method for robust multi-frame demosaicing and color super-resolution |
US8666196B2 (en) * | 2005-01-19 | 2014-03-04 | The United States Of America As Represented By The Secretary Of The Army | System and method for super-resolution imaging from a sequence of color filter array (CFA) low-resolution images |
CN101371569B (en) * | 2006-01-17 | 2011-07-27 | 皇家飞利浦电子股份有限公司 | Detection of the presence of television signals embedded in noise using cyclostationary toolbox |
US7860333B2 (en) | 2007-01-09 | 2010-12-28 | University Of Utah Research Foundation | Systems and methods for deblurring data corrupted by shift variant blurring |
JP4839448B2 (en) * | 2007-03-19 | 2011-12-21 | 国立大学法人東京工業大学 | Image quality improvement processing method and image quality improvement processing program for multiple areas |
JP4776587B2 (en) * | 2007-06-13 | 2011-09-21 | 国立大学法人北海道大学 | Image processing device, driving support device |
US8290212B2 (en) * | 2007-07-17 | 2012-10-16 | Lockheed Martin Corporation | Super-resolving moving vehicles in an unregistered set of video frames |
WO2009034688A1 (en) * | 2007-09-10 | 2009-03-19 | Nikon Corporation | Image processing method and program |
US8212837B1 (en) | 2007-10-02 | 2012-07-03 | Grandeye, Ltd. | Color processing pipelines generating a lower color bit-depth image compared to an unprocessed image from a wide-angle camera |
US20090110285A1 (en) * | 2007-10-26 | 2009-04-30 | Technion Research And Development Foundation Ltd | Apparatus and method for improving image resolution using fuzzy motion estimation |
TWI381719B (en) * | 2008-02-18 | 2013-01-01 | Univ Nat Taiwan | Full-frame video stabilization with a polyline-fitted camcorder path |
US8306121B2 (en) * | 2008-03-17 | 2012-11-06 | Ati Technologies Ulc | Method and apparatus for super-resolution of images |
US7941004B2 (en) * | 2008-04-30 | 2011-05-10 | Nec Laboratories America, Inc. | Super resolution using gaussian regression |
TWI396142B (en) * | 2008-09-11 | 2013-05-11 | Nat Univ Tsing Hua | Method of 3d image reconstitution with complementary fusion |
US8165394B2 (en) * | 2008-09-18 | 2012-04-24 | Microsoft Corporation | Reconstruction of image in a Bayer pattern |
US20100086048A1 (en) * | 2008-10-03 | 2010-04-08 | Faisal Ishtiaq | System and Method for Video Image Processing |
US9064476B2 (en) * | 2008-10-04 | 2015-06-23 | Microsoft Technology Licensing, Llc | Image super-resolution using gradient profile prior |
KR101659427B1 (en) * | 2009-02-06 | 2016-09-23 | 가부시키가이샤 한도오따이 에네루기 켄큐쇼 | Method for driving display device |
US8218068B2 (en) * | 2009-04-01 | 2012-07-10 | Omnivision Technologies, Inc. | Exposing pixel groups in producing digital images |
US8520736B2 (en) * | 2009-04-14 | 2013-08-27 | Fastvdo, Llc | Real-time superresolution and video transmission |
EP2302588B1 (en) * | 2009-08-21 | 2012-02-29 | Telefonaktiebolaget L M Ericsson (Publ) | Method and apparatus for estimation of interframe motion fields |
US8487929B2 (en) * | 2009-09-09 | 2013-07-16 | Advanced Micro Devices, Inc. | Resolution enhancement of video stream based on spatial and temporal correlation |
US8558899B2 (en) * | 2009-11-16 | 2013-10-15 | The Aerospace Corporation | System and method for super-resolution digital time delay and integrate (TDI) image processing |
TWI399703B (en) * | 2009-12-02 | 2013-06-21 | Micro Star Int Co Ltd | Forward and backward resizing method |
US8884989B2 (en) * | 2009-12-23 | 2014-11-11 | Indian Institute Of Technology Bombay | System and method for fusing images |
JP2011180798A (en) * | 2010-03-01 | 2011-09-15 | Sony Corp | Image processing apparatus, image processing method, and program |
JP2012004908A (en) * | 2010-06-17 | 2012-01-05 | Sony Corp | Image processing device, image processing method and program |
RU2431889C1 (en) * | 2010-08-06 | 2011-10-20 | Дмитрий Валерьевич Шмунк | Image super-resolution method and nonlinear digital filter for realising said method |
US9137503B2 (en) * | 2010-11-03 | 2015-09-15 | Sony Corporation | Lens and color filter arrangement, super-resolution camera system and method |
JP5653184B2 (en) * | 2010-11-11 | 2015-01-14 | 三菱電機株式会社 | Image processing apparatus and method |
US8368774B2 (en) * | 2010-11-22 | 2013-02-05 | The Aerospace Corporation | Imaging geometries for scanning optical detectors with overlapping fields of regard and methods for providing and utilizing same |
CN102073993B (en) * | 2010-12-29 | 2012-08-22 | 清华大学 | Camera self-calibration-based jittering video deblurring method and device |
US8768069B2 (en) | 2011-02-24 | 2014-07-01 | Sony Corporation | Image enhancement apparatus and method |
JP2012186593A (en) * | 2011-03-04 | 2012-09-27 | Sony Corp | Image processing system, image processing method, and program |
DE202012013411U1 (en) | 2011-04-25 | 2016-11-15 | Terra Bella Technologies Inc. | Systems for overhead image and video display |
US9292905B2 (en) * | 2011-06-24 | 2016-03-22 | Thomson Licensing | Method and device for processing of an image by regularization of total variation |
US8718407B2 (en) * | 2011-11-18 | 2014-05-06 | Stmicroelectronics (Canada), Inc. | High-quality single-frame superresolution training and reconstruction engine |
US20130177242A1 (en) * | 2012-01-10 | 2013-07-11 | James E. Adams, Jr. | Super-resolution image using selected edge pixels |
CN103152540B (en) * | 2013-03-11 | 2016-01-20 | 深圳创维-Rgb电子有限公司 | Resolution conversion method and device, ultra-high-definition television |
US20150363912A1 (en) * | 2014-06-12 | 2015-12-17 | Samsung Electronics Co., Ltd. | Rgbw demosaic method by combining rgb chrominance with w luminance |
US10230925B2 (en) | 2014-06-13 | 2019-03-12 | Urthecast Corp. | Systems and methods for processing and providing terrestrial and/or space-based earth observation video |
US10410398B2 (en) * | 2015-02-20 | 2019-09-10 | Qualcomm Incorporated | Systems and methods for reducing memory bandwidth using low quality tiles |
US10871561B2 (en) | 2015-03-25 | 2020-12-22 | Urthecast Corp. | Apparatus and methods for synthetic aperture radar with digital beamforming |
CN108432049B (en) | 2015-06-16 | 2020-12-29 | 阿卜杜拉阿齐兹国王科技城 | Efficient planar phased array antenna assembly |
WO2017091747A1 (en) | 2015-11-25 | 2017-06-01 | Urthecast Corp. | Synthetic aperture radar imaging apparatus and methods |
CA3064735C (en) | 2017-05-23 | 2022-06-21 | Urthecast Corp. | Synthetic aperture radar imaging apparatus and methods |
EP3646054A4 (en) | 2017-05-23 | 2020-10-28 | King Abdulaziz City for Science and Technology | Synthetic aperture radar imaging apparatus and methods for moving targets |
US10337923B2 (en) * | 2017-09-13 | 2019-07-02 | Qualcomm Incorporated | Directional interpolation and cross-band filtering for hyperspectral imaging |
WO2019226194A2 (en) | 2017-11-22 | 2019-11-28 | Urthecast Corp. | Synthetic aperture radar apparatus and methods |
CN108830790B (en) * | 2018-05-16 | 2022-09-13 | 宁波大学 | Rapid video super-resolution reconstruction method based on simplified convolutional neural network |
CN108961186B (en) * | 2018-06-29 | 2022-02-15 | 福建帝视信息科技有限公司 | Old film repairing and reproducing method based on deep learning |
US11720999B2 (en) * | 2019-10-11 | 2023-08-08 | Kayrros | Method, device and non-transitory computer-readable storage medium for increasing the resolution and dynamic range of a sequence of respective top view images of a same terrestrial location |
US11544815B2 (en) | 2019-11-18 | 2023-01-03 | Advanced Micro Devices, Inc. | Gaming super resolution |
US11240465B2 (en) | 2020-02-21 | 2022-02-01 | Alibaba Group Holding Limited | System and method to use decoder information in video super resolution |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6411333B1 (en) * | 1999-04-02 | 2002-06-25 | Teralogic, Inc. | Format conversion using patch-based filtering |
US6434280B1 (en) * | 1997-11-10 | 2002-08-13 | Gentech Corporation | System and method for generating super-resolution-enhanced mosaic images |
US6650335B2 (en) * | 2001-02-22 | 2003-11-18 | Mitsubishi Electric Research Laboratories, Inc. | Method for extracting static and dynamic super-resolution textures form a sequence of images |
US6766067B2 (en) * | 2001-04-20 | 2004-07-20 | Mitsubishi Electric Research Laboratories, Inc. | One-pass super-resolution images |
US7085323B2 (en) * | 2002-04-03 | 2006-08-01 | Stmicroelectronics, Inc. | Enhanced resolution video construction method and apparatus |
US7218796B2 (en) * | 2003-04-30 | 2007-05-15 | Microsoft Corporation | Patch-based video super-resolution |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5691777A (en) * | 1988-10-17 | 1997-11-25 | Kassatly; Lord Samuel Anthony | Method and apparatus for simultaneous compression of video, audio and data signals |
US6400996B1 (en) * | 1999-02-01 | 2002-06-04 | Steven M. Hoffberg | Adaptive pattern recognition based control system and method |
US5995457A (en) * | 1993-12-22 | 1999-11-30 | Jamail; Randall H. | Method of masking data on digital video disks (DVD) |
US6542925B2 (en) * | 1995-05-30 | 2003-04-01 | Roy-G-Biv Corporation | Generation and distribution of motion commands over a distributed network |
US6381179B1 (en) * | 2000-02-24 | 2002-04-30 | Advanced Micro Devices, Inc. | Using a negative gate erase to increase the cycling endurance of a non-volatile memory cell with an oxide-nitride-oxide (ONO) structure |
-
2005
- 2005-12-12 US US11/301,817 patent/US20060291750A1/en not_active Abandoned
-
2006
- 2006-10-19 US US11/584,400 patent/US7379612B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6434280B1 (en) * | 1997-11-10 | 2002-08-13 | Gentech Corporation | System and method for generating super-resolution-enhanced mosaic images |
US6411333B1 (en) * | 1999-04-02 | 2002-06-25 | Teralogic, Inc. | Format conversion using patch-based filtering |
US6650335B2 (en) * | 2001-02-22 | 2003-11-18 | Mitsubishi Electric Research Laboratories, Inc. | Method for extracting static and dynamic super-resolution textures form a sequence of images |
US6766067B2 (en) * | 2001-04-20 | 2004-07-20 | Mitsubishi Electric Research Laboratories, Inc. | One-pass super-resolution images |
US7085323B2 (en) * | 2002-04-03 | 2006-08-01 | Stmicroelectronics, Inc. | Enhanced resolution video construction method and apparatus |
US7218796B2 (en) * | 2003-04-30 | 2007-05-15 | Microsoft Corporation | Patch-based video super-resolution |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110182528A1 (en) * | 2008-07-25 | 2011-07-28 | Eads Deutschland Gmbh | Method and device for generating images having a reduced error rate, high resolution and improved contrast |
US8849059B2 (en) * | 2008-07-25 | 2014-09-30 | Eads Deutschland Gmbh | Method and device for generating images having a reduced error rate, high resolution and improved contrast |
CN101794440A (en) * | 2010-03-12 | 2010-08-04 | 东南大学 | Weighted adaptive super-resolution reconstructing method for image sequence |
US8750647B2 (en) | 2011-02-03 | 2014-06-10 | Massachusetts Institute Of Technology | Kinetic super-resolution imaging |
CN104867107A (en) * | 2015-06-04 | 2015-08-26 | 清华大学深圳研究生院 | Image super-resolution method |
CN110084752A (en) * | 2019-05-06 | 2019-08-02 | 电子科技大学 | A kind of Image Super-resolution Reconstruction method based on edge direction and K mean cluster |
CN111489292A (en) * | 2020-03-04 | 2020-08-04 | 北京思朗科技有限责任公司 | Super-resolution reconstruction method and device for video stream |
CN111915492A (en) * | 2020-08-19 | 2020-11-10 | 四川省人工智能研究院(宜宾) | Multi-branch video super-resolution method and system based on dynamic reconstruction |
WO2022242448A1 (en) * | 2021-05-20 | 2022-11-24 | 腾讯科技(深圳)有限公司 | Image processing method and apparatus, and computer device, program and storage medium |
Also Published As
Publication number | Publication date |
---|---|
US7379612B2 (en) | 2008-05-27 |
US20070071362A1 (en) | 2007-03-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20060291750A1 (en) | Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution) | |
US7412107B2 (en) | System and method for robust multi-frame demosaicing and color super-resolution | |
US20060291751A1 (en) | Robust reconstruction of high resolution grayscale images from a sequence of low-resolution frames (robust gray super-resolution) | |
Gunturk et al. | Super-resolution reconstruction of compressed video using transform-domain statistics | |
EP2489007B1 (en) | Image deblurring using a spatial image prior | |
Rav-Acha et al. | Two motion-blurred images are better than one | |
Hardie et al. | Joint MAP registration and high-resolution image estimation using a sequence of undersampled images | |
US7616826B2 (en) | Removing camera shake from a single photograph using statistics of a natural image | |
US8233541B2 (en) | Recursive image quality enhancement on super resolution video | |
EP1492051A2 (en) | Method of restoring and reconstructing super-resolution image from low-resolution compressed image | |
US20110090378A1 (en) | Image deblurring using panchromatic pixels | |
US8126281B2 (en) | Image processing apparatus, method, and computer-readable medium for generating motion compensation images | |
Gunturk et al. | Multiframe resolution-enhancement methods for compressed video | |
Patanavijit | Super-resolution reconstruction and its future research direction | |
Tom et al. | Reconstruction of a high resolution image from multiple low resolution images | |
Zhang et al. | Bracketing is All You Need: Unifying Image Restoration and Enhancement Tasks with Multi-Exposure Images | |
Schuler et al. | Increasing spatial resolution through temporal super-sampling of digital video | |
Hardie et al. | High-resolution image reconstruction from a sequence of rotated and translated infrared images | |
Shao et al. | Partition-based interpolation for color filter array demosaicking and super-resolution reconstruction | |
Güngör et al. | A transform learning based deconvolution technique with super-resolution and microscanning applications | |
Salem et al. | Non-parametric super-resolution using a bi-sensor camera | |
Li et al. | Reconstruction of bionic compound eye images based on superresolution algorithm | |
Li et al. | Wavelet domain superresolution reconstruction of infrared image sequences | |
KR20050090920A (en) | Method for producing enhanced-resolution image by use of a plurality of low-resolution images | |
Gunturk et al. | Gray-scale resolution enhancement |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: NATIONAL SCIENCE FOUNDATION, VIRGINIA Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF CALIFORNIA;REEL/FRAME:025762/0295 Effective date: 20080724 |
|
AS | Assignment |
Owner name: NATIONAL SCIENCE FOUNDATION, VIRGINIA Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF CALIFORNIA;REEL/FRAME:025561/0750 Effective date: 20080724 |