US20150016745A1 - Method for determining noise level - Google Patents

Method for determining noise level Download PDF

Info

Publication number
US20150016745A1
US20150016745A1 US14/504,171 US201414504171A US2015016745A1 US 20150016745 A1 US20150016745 A1 US 20150016745A1 US 201414504171 A US201414504171 A US 201414504171A US 2015016745 A1 US2015016745 A1 US 2015016745A1
Authority
US
United States
Prior art keywords
wavelet coefficients
blocks
image
color
wavelet
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/504,171
Inventor
Christophe Bernard
Sarah Lannes
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Technologies Inc filed Critical Qualcomm Technologies Inc
Priority to US14/504,171 priority Critical patent/US20150016745A1/en
Assigned to QUALCOMM TECHNOLOGIES, INC. reassignment QUALCOMM TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CSR PLC, ZORAN (FRANCE) S.A.
Assigned to ZORAN (FRANCE) S.A. reassignment ZORAN (FRANCE) S.A. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BERNARD, CHRISTOPHE, LANNES, SARAH
Publication of US20150016745A1 publication Critical patent/US20150016745A1/en
Assigned to QUALCOMM INCORPORATED reassignment QUALCOMM INCORPORATED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: QUALCOMM TECHNOLOGIES, INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G06T5/70
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/001Image restoration
    • G06T5/002Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20016Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20048Transform domain processing
    • G06T2207/20064Wavelet transform [DWT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20182Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30168Image quality inspection

Definitions

  • the present invention relates to noise estimation domain in particular in the domain of image or video processing.
  • a possible way to estimate the amount of noise is to use robust statistical method. For instance, (see Donoho, David L.; Iain M. Johnstone, December 1995, “Adapting to Unknown Smoothness via Wavelet Shrinkage”. Journal of the American Statistical Association Vol. 90, No. 432: 1200-1244), a possible way to estimate a noise level of an image when the noise is white noise consists in computing the median of a high-pass subband.
  • the median of the absolute values of coefficients may be proportional to the noise standard deviation. This median may be scaled with an appropriate constant to yield an estimate of the standard deviation of the Gaussian noise.
  • the median may produce an estimate of the noise level that is much higher than what it ought to be: when a median is computed over a highly textured image, state of the art methods overestimate the amount of noise, apply a stronger than necessary noise reduction and wash out the textures that were confused with noise by the noise estimation algorithm.
  • the invention relates to a method for determining noise levels in a subband of an image, the subband comprising at least one color domain and at least two space domains, said subband comprising first wavelet coefficients associated with coordinate value in the at least one color domain and the at least two space domains.
  • the method comprises:
  • a typical image is a 2D grid comprising points or pixels having two space domains (for instance, (x, y) or (n, m)), these two space domain being orthogonal.
  • a subband may comprise wavelet coefficients d c, j k (n, m) associated with coordinate value c in the color domain and with coordinate values n, m in the space domains.
  • Determining block regions in the space domains may be regrouping points of the space domains.
  • the block regions may be regular rectangles or squares or any other geometrical forms or any arbitrary forms.
  • a ⁇ B block regions may be defined in the two unidimensional space domains.
  • n and m may be coordinate values respectively in said two space domains with 0 ⁇ n ⁇ N and 0 ⁇ m ⁇ M, N and M being integer values.
  • a and B may be integers.
  • the two unidimensional space domains may define a two-dimensional space domain (n, m).
  • N and M may be the height and the width of the image.
  • “identifying first wavelet coefficients” may comprise determining first wavelet coefficients associated with coordinate values verifying a ⁇ A ⁇ m ⁇ (a+1) ⁇ A and b ⁇ B ⁇ n ⁇ (b+1) ⁇ B.
  • coordinates values of the at least one color domain may comprise ⁇ c 1 , c 2 , . . . , c f ⁇ .
  • “Computing the correlation matrix” may comprise the computation of each elements ⁇ Corr g, h ⁇ g, h of the matrix, where g and h being in ⁇ 1, . . . f ⁇ .
  • Corr g, h may be function of
  • S is a surface of the block region, p being a point of the block region having coordinate values in the at least two space domains, d c g (p) being the first wavelet coefficient associated with coordinate values of point p and with coordinate value c g in the at least one color domain, d c h (p) being the first wavelet coefficient associated with coordinate values of point p and with coordinate value c h in the at least one color domain.
  • the correlation matrix may be a f ⁇ f matrix and each element Corr g, h of the matrix may correspond to the correlation between the color c g and c h for the wavelet coefficients in the block region.
  • the notation d c (p) is a simplified notation for d c, j k (p) with a given scale j and a given orientation k (i.e. for a given subband).
  • the point p may have coordinates value (n, m) in the space domains. Therefore, the Corr g, h may be noted
  • “computing second wavelet coefficients” may comprise a principal component analysis transform.
  • Principal component analysis is a mathematical procedure that uses an orthogonal transformation to convert a set of observations of possibly correlated variables into a set of values of linearly uncorrelated (or mostly uncorrelated) variables called principal components. This transformation is often defined in such a way that the first principal component has the largest possible variance, and each succeeding component has the highest variance possible under the constraint that it be orthogonal to (i.e., uncorrelated with) the preceding components. Principal components are guaranteed to be independent only if the data set is jointly normally distributed.
  • PCA may also be named the discrete Karhunen-Loève transform (KLT), the Hotelling transform or proper orthogonal decomposition (POD).
  • “computing at least one noise level” may comprise the computation of at least a median.
  • Median is the numerical value separating the higher half of a sample, a population, or a probability distribution, from the lower half.
  • M S
  • “computing second wavelet coefficients” may transform the at least one color domain into at least one new color domain.
  • One median may be computed.
  • the latter median may be function of temporary medians, each temporary median of the temporary medians being associated with a coordinate value in the at least one new color domain of the subband, each temporary median being function of the coefficients associated with the coordinate value in the at least one new color domain of the subband associated with.
  • block region S corresponds to the entire space domains of the subband (i.e. of the image size).
  • a temporary median may be computed for each coordinate value of the color domain.
  • the latter median may be equal to the minimal temporary medians.
  • a plurality of medians may be computed. Each median may be associated with a defined block region. Each median may be function of temporary medians, each temporary median of the temporary medians being associated with a coordinate value in the at least one new color domain of the subband, each temporary median being function of the coefficients associated with the coordinate value in the at least one new color domain of the subband associated with.
  • block region S is one of the defined block regions.
  • the color domain comprises a plurality of coordinate values (for instance, for the RGB color model)
  • a temporary median may be computed for each coordinate value of the color domain. Then the median may be the minimal temporary median.
  • An estimate of the noise level may be the minimal median in the plurality of computed medians.
  • Another aspect of the invention relates to a computer program product comprising a computer readable medium, having thereon a computer program comprising program instructions.
  • the computer program is loadable into a data-processing unit and adapted to cause the data-processing unit to carry out the method described above when the computer program is run by the data-processing unit.
  • Yet another aspect of the invention relates to a device for determining noise levels in a subband of an image.
  • the subband comprises at least one color domain and at least two space domains.
  • the subband comprises first wavelet coefficients associated with coordinate values in the at least one color domain and the at least two space domains.
  • the device comprises:
  • FIG. 1 a and FIG. 1 b are representations of possible splitting of a subband into a plurality of block regions
  • FIGS. 2 a and 2 b represent the correlation of noise levels between two color coordinates, respectively in case of a pure noise and in case of a noisy texture;
  • FIG. 2 c is a representation of a method to compute uncorrelated color components in case of a noisy texture
  • FIG. 3 is a flow chart describing a possible embodiment of the present invention.
  • FIG. 4 is a possible embodiment for a device that enables the present invention.
  • An image I[m, n] (with n and m the coordinate values in the image, e.g. the pixel coordinate values) may be transformed into a set of wavelets decomposition subbands d j k [n, m], where j is a scale index, and k is an orientation index.
  • the orientation index k is ranging from 1 to 3 (e.g. vertical, horizontal and diagonal).
  • Each subband has a varying size depending on a scale index j that ranges from 1 to some maximum value D (integer).
  • Block B 1 k [a, b] (element 101 ) contains the coefficients d j k (m, n) for
  • a median value M a, b is defined for each block in ⁇ B 1 k [a, b] ⁇ a, b as the median of the set of values ⁇
  • M a, b median( ⁇
  • At least one block may provide a reliable estimate of the noise level. All other blocks may provide an over-estimated noise level.
  • the intersection between two blocks is empty. Nevertheless, it may also be possible to partially superpose blocks for instance as described in FIG. 1 b.
  • the blocks (elements 103 , 104 ) contain the same number of coefficients i.e. the blocks size are A ⁇ B.
  • Block B 1 k [a, b] (element 101 ) contains the coefficients d j k (m, n) for
  • a texture in a given image I[m, n] contains high frequency contents. This content may be located on a single color channel, or on a low-dimensional manifold of the color space. For example, as a grass texture is mostly green, the texture mostly contains high spatial frequencies on a sub manifold of the color space that contains shades of green.
  • Real noise on the other hand is often distributed on all three color channels (if the color model is not RGB for “Red Green Blue”), so the noise is colored and is spanning a real three-dimensional subset of the color cube. If the color model is not RGB (for instance YCbCr or CMYK or any other color models) the considerations are similar.
  • FIG. 2 a represents wavelet coefficients of a given subband of a noised color image with two color channels/coordinates (for simplification purpose only). This Figure may be generalized with a greater number of color coordinates. The wavelets coefficients are associated with the two color coordinates W C1 and W C2 representing the two colors C1 and C2.
  • the dots 201 represent the population of wavelet coefficients of the channels with noise.
  • the population is in a centered circle 202 without any privileged direction.
  • FIG. 2 b represents wavelet coefficients of a given subband of a noised color image with two color channels, the image having a textured content.
  • the wavelets coefficients are associated with the two color coordinates W C1 and W C2 representing the two colors C1 and C2.
  • the dots 203 represent the population of wavelet coefficients of subband according to the color coordinates.
  • the population may be grouped in an ovoid 204 .
  • the ovoid 204 have a privileged direction 206 .
  • the form 204 is flat and elongated along a principal direction 206 .
  • the population of coefficients is correlated as the distribution along each axis W C1 and W C2 are not uniform.
  • the rotated ovoid 207 is similar to the ovoid 204 of FIG. 2 b (disregarding the rotation).
  • PCA Principal component analysis
  • the median of coefficients along the axis W′ C1 is smaller than the median of coefficients along the axis W′ C2 .
  • W′ C1 mostly carries noise.
  • the objective of this transformation is to capture a value which is proportional to a noise level, the captured value being the width of ovoid (arrow 208 in FIG. 2 c ) and not width of the projection of the ovoid onto a random axis (arrow 209 in FIG. 2 b ), which would be much larger.
  • FIG. 3 is a flow chart describing a possible embodiment of the present invention. Part of this flow chart may represent steps of an example of a computer program which may be executed by the device of FIG. 4 .
  • this input image 300 may be decomposed into a plurality of subbands (step 301 ).
  • Each subband may be associated with a given scale/resolution j (in reference of a multiresolution wavelet transform), a color c, and an orientation k (for instance, three possible orientations).
  • Each scales ( 302 , 303 , etc) may comprises a plurality of subband (characterized for instance by an orientation k).
  • Each subband (defined by k and j) may be decomposed (step 304 ) into a plurality of blocks ⁇ B j k [a, b] ⁇ a, b as described in FIG. 1 b or FIG. 1 b.
  • the following description uses the notations introduced in the description in relation with these Figures.
  • indexes n, m are determined so that:
  • a correlation matrix of coefficients between colors may be computed (step 306 ). For instance, the correlation matrix of d c1, j k (n, m) and d c2, j k (n, m) is
  • the matrix U is a matrix of eigenvectors which diagonalizes the matrix Corr a, b .
  • D is the diagonal matrix of eigenvalues of Corr a, b .
  • This step will typically involve the use of a computer-based algorithm for computing eigenvectors and eigenvalues. These algorithms are readily available as sub-components of most matrix algebra systems.
  • This application of U T to the vector of components may be done block by block (i.e. for n and m that verify a ⁇ A ⁇ m ⁇ (a+1) ⁇ A, and b ⁇ B ⁇ n ⁇ (b+1) ⁇ B), so that the PCA (for “Principal component analysis”) may be adapted locally on the texture properties.
  • the noise level may be estimated (step 308 ) from the median of the whole subband C jk3 (n, m) or blockwise from this subband as described above.
  • the noise level estimation for each subband may be stored in a database 309 or in a memory for future use.
  • a filter may be applied (step 310 ) for instance on the subband or on the image.
  • Many noise reduction filters may be used such as NL-means, linear smoothing filters, anisotropic diffusion filters, etc. according to the noise level stored in the database 309 .
  • a new image 315 may be constructed (step 314 ) according to these new scales with an inverse wavelet transformation.
  • FIG. 4 is a possible embodiment for a device that enables the present invention.
  • the device 400 comprise a computer, this computer comprising a memory 405 to store program instructions loadable into a circuit and adapted to cause circuit 404 to carry out the steps of the present invention when the program instructions are run by the circuit 404 .
  • the memory 405 may also store data and useful information for carrying the steps of the present invention as described above.
  • the circuit 404 may be for instance:
  • This computer comprises an input interface 403 for the reception of subbands and an output interface 406 for providing a noise level.
  • a screen 401 and a keyboard 402 may be provided and connected to the computer circuit 404 .

Abstract

The present invention relates to a method for determining noise levels in a subband of an image. The method comprises receiving the subband of the image, defining block regions in the at least two space domains of the subband, for each defined block region, identifying first wavelet coefficients associated with coordinate values in the at least two space domains in the defined block region, computing a correlation matrix between identified wavelet coefficients to determine the correlation between first wavelet coefficients according to the at least one color domain, computing second wavelet coefficients, the computation of second wavelet coefficients being based on the correlation matrix and the first wavelet coefficients, computing at least one noise level, the noise level computation being based on at least one second wavelet coefficient and providing the at least one noise level.

Description

    BACKGROUND OF THE INVENTION
  • The present invention relates to noise estimation domain in particular in the domain of image or video processing.
  • The approaches described in this section could be pursued, but are not necessarily approaches that have been previously conceived or pursued. Therefore, unless otherwise indicated herein, the approaches described in this section are not prior art to the claims in this application and are not admitted to be prior art by inclusion in this section. Furthermore, all embodiments are not necessarily intended to solve all or even any of the problems brought forward in this section.
  • A possible way to estimate the amount of noise is to use robust statistical method. For instance, (see Donoho, David L.; Iain M. Johnstone, December 1995, “Adapting to Unknown Smoothness via Wavelet Shrinkage”. Journal of the American Statistical Association Vol. 90, No. 432: 1200-1244), a possible way to estimate a noise level of an image when the noise is white noise consists in computing the median of a high-pass subband.
  • The underlying expectation is that the median is carrying only information about the noise, and that the signal is sparse enough to have little impact on this median. Therefore, coefficients (in which the signal is relevant) represent less than few percent of the coefficient population).
  • In particular, the median of the absolute values of coefficients may be proportional to the noise standard deviation. This median may be scaled with an appropriate constant to yield an estimate of the standard deviation of the Gaussian noise.

  • σ=median(|s|)×f with s the signal
  • The factor f (for instance f=1/0.67) may be estimated by measuring the median of values drawn from a known Gaussian generator of known standard deviation.
  • Such estimation has drawbacks as this expectation (i.e that the signal is sparsely represented in the high pass subband) is not always adequate.
  • Indeed, when the image is highly textured, or contains parts that are highly textured, the median may produce an estimate of the noise level that is much higher than what it ought to be: when a median is computed over a highly textured image, state of the art methods overestimate the amount of noise, apply a stronger than necessary noise reduction and wash out the textures that were confused with noise by the noise estimation algorithm.
  • There is thus a need for having a noise estimation method robust even if parts of the images are highly textured and then to improve image quality through a more robust noise level estimation leading to smother noise reduction, and less aggressive flattening of textures in the highly textured images.
  • SUMMARY OF THE INVENTION
  • The invention relates to a method for determining noise levels in a subband of an image, the subband comprising at least one color domain and at least two space domains, said subband comprising first wavelet coefficients associated with coordinate value in the at least one color domain and the at least two space domains.
  • The method comprises:
      • receiving the subband of the image;
      • defining block regions in the at least two space domains of the subband;
      • for each defined block region:
        • identifying first wavelet coefficients associated with coordinate values in the at least two space domains in the defined block region;
        • computing a correlation matrix between identified wavelet coefficients to determine the correlation between first wavelet coefficients according to the at least one color domain;
        • computing second wavelet coefficients, the computation of second wavelet coefficients being based on the correlation matrix and the first wavelet coefficients;
      • computing at least one noise level, the noise level computation being based on at least one second wavelet coefficient;
      • providing the at least one noise level.
  • A subband is typically a set of coefficients {dc, j k(n, m)}j, k with j a scale index (e.g 1, 2, etc.) and k an orientation index (e.g. 1=vertical, 2=horizontal, 3=diagonal).
  • A typical image comprises a plurality of color channel such as a red channel, a blue channel and green channel (if the color model is RGB). It is possible to create a color domain c which comprises three values (e.g. c=1 for red, c=2 for blue and c=3 for green). In addition, a typical image is a 2D grid comprising points or pixels having two space domains (for instance, (x, y) or (n, m)), these two space domain being orthogonal.
  • As explained above, a subband may comprise wavelet coefficients dc, j k(n, m) associated with coordinate value c in the color domain and with coordinate values n, m in the space domains.
  • “Defining block regions in the space domains” may be regrouping points of the space domains. For instance, the block regions may be regular rectangles or squares or any other geometrical forms or any arbitrary forms.
  • In addition, the image comprising two unidimensional space domains, A×B block regions may be defined in the two unidimensional space domains.
  • n and m may be coordinate values respectively in said two space domains with 0≦n≦N and 0≦m≦M, N and M being integer values. A and B may be integers.
  • n and m may verify a·A≦m<(a+1)·A, b·B≦n<(b+1)·B and a=0, 1/A . . . (M−1)/A and b=0, 1/B . . . (N−1)/B.
  • In such situation, the two unidimensional space domains may define a two-dimensional space domain (n, m). The two-dimensional space domain may therefore be split into rectangles of size A×B and the coordinate values of a corner of the rectangle may be (aA, bB) with a=0, 1/A . . . (M−1)/A and b=0, 1/B . . . (N−1)/B.
  • N and M may be the height and the width of the image.
  • According to a possible embodiment, “identifying first wavelet coefficients” may comprise determining first wavelet coefficients associated with coordinate values verifying a·A≦m<(a+1)·A and b·B≦n<(b+1)·B.
  • In addition, coordinates values of the at least one color domain may comprise {c1, c2, . . . , cf}. “Computing the correlation matrix” may comprise the computation of each elements {Corrg, h}g, h of the matrix, where g and h being in {1, . . . f}. Corrg, h may be function of
  • 1 S p S d c g ( p ) d c h ( p )
  • where S is a surface of the block region, p being a point of the block region having coordinate values in the at least two space domains, dc g (p) being the first wavelet coefficient associated with coordinate values of point p and with coordinate value cg in the at least one color domain, dc h (p) being the first wavelet coefficient associated with coordinate values of point p and with coordinate value ch in the at least one color domain.
  • Hence, the correlation matrix ma be a f×f matrix and each element Corrg, h of the matrix may correspond to the correlation between the color cg and ch for the wavelet coefficients in the block region.
  • The notation dc(p) is a simplified notation for dc, j k(p) with a given scale j and a given orientation k (i.e. for a given subband).
  • The point p may have coordinates value (n, m) in the space domains. Therefore, the Corrg, h may be noted
  • 1 S ( n , m ) S d c g ( n , m ) d c h ( n , m ) .
  • If the block region is a rectangle of size A×B and if a corner of the rectangle have coordinates (aA, bB), then Corrg, h may be noted
  • 1 AB a · A n < ( a + 1 ) · A b · B n < ( b + 1 ) · B d c 1 ( n , m ) d c 2 ( n , m ) .
  • According to one embodiment, “computing second wavelet coefficients” may comprise a principal component analysis transform.
  • Principal component analysis (or PCA) is a mathematical procedure that uses an orthogonal transformation to convert a set of observations of possibly correlated variables into a set of values of linearly uncorrelated (or mostly uncorrelated) variables called principal components. This transformation is often defined in such a way that the first principal component has the largest possible variance, and each succeeding component has the highest variance possible under the constraint that it be orthogonal to (i.e., uncorrelated with) the preceding components. Principal components are guaranteed to be independent only if the data set is jointly normally distributed. PCA may also be named the discrete Karhunen-Loève transform (KLT), the Hotelling transform or proper orthogonal decomposition (POD).
  • Moreover, “computing at least one noise level” may comprise the computation of at least a median.
  • Median is the numerical value separating the higher half of a sample, a population, or a probability distribution, from the lower half.
  • It is possible to compute a median for specific coefficients in the second wavelet coefficients.
  • A median MS for a block region S may be noted MS={|dj k[p]|:p∈S} for a given scale j and a given orientation k (i.e. for a given subband), p being a point of the space domain.
  • In addition, “computing second wavelet coefficients” may transform the at least one color domain into at least one new color domain. One median may be computed. The latter median may be function of temporary medians, each temporary median of the temporary medians being associated with a coordinate value in the at least one new color domain of the subband, each temporary median being function of the coefficients associated with the coordinate value in the at least one new color domain of the subband associated with.
  • In such situation the above mentioned block region S corresponds to the entire space domains of the subband (i.e. of the image size).
  • If the color domain comprises a plurality of coordinate values (for instance, for the RGB color model), a temporary median may be computed for each coordinate value of the color domain.
  • Then, the latter median may be equal to the minimal temporary medians.
  • In a different embodiment, a plurality of medians may be computed. Each median may be associated with a defined block region. Each median may be function of temporary medians, each temporary median of the temporary medians being associated with a coordinate value in the at least one new color domain of the subband, each temporary median being function of the coefficients associated with the coordinate value in the at least one new color domain of the subband associated with.
  • In such situation the above mentioned block region S is one of the defined block regions.
  • If the color domain comprises a plurality of coordinate values (for instance, for the RGB color model), a temporary median may be computed for each coordinate value of the color domain. Then the median may be the minimal temporary median.
  • An estimate of the noise level may be the minimal median in the plurality of computed medians.
  • Another aspect of the invention relates to a computer program product comprising a computer readable medium, having thereon a computer program comprising program instructions. The computer program is loadable into a data-processing unit and adapted to cause the data-processing unit to carry out the method described above when the computer program is run by the data-processing unit.
  • Yet another aspect of the invention relates to a device for determining noise levels in a subband of an image. The subband comprises at least one color domain and at least two space domains. The subband comprises first wavelet coefficients associated with coordinate values in the at least one color domain and the at least two space domains.
  • The device comprises:
      • an input interface for receiving the subband of the image;
      • a circuit for defining block regions in the at least two space domains of the subband;
      • a circuit for identifying first wavelet coefficients associated with coordinate values in the at least two space domains in the identified block;
      • a circuit for computing a correlation matrix between identified wavelet coefficients to determine the correlation between first wavelet coefficients according to the at least one color domain;
      • a circuit for computing second wavelet coefficients, the computation of second wavelet coefficients being based on the correlation matrix and the first wavelet coefficients;
      • a circuit for computing at least one noise level, the noise level computation being based on at least one second wavelet coefficients;
      • an output interface for providing the at least one noise level.
  • Other features and advantages of the method and apparatus disclosed herein will become apparent from the following description of non-limiting embodiments, with reference to the appended drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings, in which like reference numerals refer to similar elements and in which:
  • FIG. 1 a and FIG. 1 b are representations of possible splitting of a subband into a plurality of block regions;
  • FIGS. 2 a and 2 b represent the correlation of noise levels between two color coordinates, respectively in case of a pure noise and in case of a noisy texture;
  • FIG. 2 c is a representation of a method to compute uncorrelated color components in case of a noisy texture;
  • FIG. 3 is a flow chart describing a possible embodiment of the present invention;
  • FIG. 4 is a possible embodiment for a device that enables the present invention.
  • DESCRIPTION OF PREFERRED EMBODIMENTS
  • An image I[m, n] (with n and m the coordinate values in the image, e.g. the pixel coordinate values) may be transformed into a set of wavelets decomposition subbands dj k[n, m], where j is a scale index, and k is an orientation index.
  • For typical wavelet transforms used for images, (and in particular for those described in Stéphane Mallat, “Une Exploration des Signaux en Ondelettes”, Editions de l'Ecole Polytechnique, ISBN: 2-7302-0733-3 for 2D images), the orientation index k is ranging from 1 to 3 (e.g. vertical, horizontal and diagonal). Each subband has a varying size depending on a scale index j that ranges from 1 to some maximum value D (integer).

  • dj k[m, n] for j=1 . . . D, and k=1 . . . 3.
  • A standard approach may consist in considering the specific subband d1 k[m, n] for k=1, 2 or 3 (i.e. the subband corresponding to the first scale, j=1), and to compute the median of the absolute values of this population of coefficients. If the majority of the surface of the image is covered with high activity texture, resulting in many high-frequency coefficients, the presence of the texture will bias the noise level estimation, leading to an overestimation of the noise level.
  • In order to avoid this drawback, it is possible to split the subband d1 k[m, n] (for k=1, 2 or 3) into blocks of coefficients according to the following method.
  • In reference to FIG. 1 a, and assuming that the considered subband d1 k[m, n] (element 100) comprises M×N coefficients dj k(m, n) with n=1 . . . N and m=1 . . . M, then the subband d1 k[m, n] (element 100) is split into several blocks {B1 k [a, b]}a, b (elements 101, 102) of size A×B (with a=0, 1/A . . . (M−1)/A and b=0, 1/B . . . (N−1)/B).
  • Block B1 k [a, b] (element 101) contains the coefficients dj k(m, n) for

  • a·A≦m<(a+1)·A,

  • and

  • b·B≦n<(b+1)·B.
  • Then a median value Ma, b is defined for each block in {B1 k [a, b]}a, b as the median of the set of values {|dj k[m, n]|:a·A≦m<(a+1)·A and b·B≦n<(b+1)·B}:

  • M a, b=median({|d j k [m, n]|:a·A≦m<(a+1)·A and b·B≦n<(b+1)·B})
  • Therefore if at least one block does not contain texture, it may provide a reliable estimate of the noise level. All other blocks may provide an over-estimated noise level.
  • A reasonable estimate of the noise level is then the minimum of these blockwise estimates: σ=mina, b(Ma, b·C) where the coefficient C may be calibrated by doing the same estimation on a known Gaussian source of the same size and the same number of blocks.
  • In this embodiment the intersection between two blocks is empty. Nevertheless, it may also be possible to partially superpose blocks for instance as described in FIG. 1 b. In this latter embodiment, the blocks (elements 103, 104) contain the same number of coefficients i.e. the blocks size are A×B. Block B1 k [a, b] (element 101) contains the coefficients dj k(m, n) for
  • a · A 3 m < ( a + 3 ) · A 3 , and b · B 3 n < ( b + 3 ) · B 3 .
  • All other adaptations with other sub-sampling factors is possible (here the sub-sampling factor is 3)
  • In most case, a texture in a given image I[m, n] contains high frequency contents. This content may be located on a single color channel, or on a low-dimensional manifold of the color space. For example, as a grass texture is mostly green, the texture mostly contains high spatial frequencies on a sub manifold of the color space that contains shades of green.
  • Real noise on the other hand is often distributed on all three color channels (if the color model is not RGB for “Red Green Blue”), so the noise is colored and is spanning a real three-dimensional subset of the color cube. If the color model is not RGB (for instance YCbCr or CMYK or any other color models) the considerations are similar.
  • FIG. 2 a represents wavelet coefficients of a given subband of a noised color image with two color channels/coordinates (for simplification purpose only). This Figure may be generalized with a greater number of color coordinates. The wavelets coefficients are associated with the two color coordinates WC1 and WC2 representing the two colors C1 and C2.
  • This image contains noise without any texture. Therefore, the dots 201 represent the population of wavelet coefficients of the channels with noise. The population is in a centered circle 202 without any privileged direction.
  • In such situation, where then distribution of population is symmetric according to a point 205, the wavelet components WC1 and WC2 (representing the channels of the image) are uncorrelated.
  • FIG. 2 b represents wavelet coefficients of a given subband of a noised color image with two color channels, the image having a textured content. The wavelets coefficients are associated with the two color coordinates WC1 and WC2 representing the two colors C1 and C2.
  • Therefore, the dots 203 represent the population of wavelet coefficients of subband according to the color coordinates. The population may be grouped in an ovoid 204. The ovoid 204 have a privileged direction 206.
  • Since the noise-free texture is assumed to be lying on a small dimensional manifold, the form 204 is flat and elongated along a principal direction 206.
  • In the situation represented in FIG. 2 b, the population of coefficients is correlated as the distribution along each axis WC1 and WC2are not uniform.
  • Nevertheless, it is possible to “rotate” the color axis to obtain two new uncorrelated color components W′C1 and W′C2 as described in FIG. 2 c. Therefore, the rotated ovoid 207 is similar to the ovoid 204 of FIG. 2 b (disregarding the rotation).
  • To compute uncorrelated components, it is possible to use a Principal component analysis (PCA) mathematical procedure to convert the correlated population of coefficients into a set of values of linearly uncorrelated variables.
  • Once the color component have been “rotated”, it is possible to easily compute a noise level for the subband coefficients.
  • In FIG. 2 c, the median of coefficients along the axis W′C1 is smaller than the median of coefficients along the axis W′C2. In consequence, in case of colored texture, W′C1 mostly carries noise.
  • The objective of this transformation is to capture a value which is proportional to a noise level, the captured value being the width of ovoid (arrow 208 in FIG. 2 c) and not width of the projection of the ovoid onto a random axis (arrow 209 in FIG. 2 b), which would be much larger.
  • FIG. 3 is a flow chart describing a possible embodiment of the present invention. Part of this flow chart may represent steps of an example of a computer program which may be executed by the device of FIG. 4.
  • Upon the reception of an input image 300, this input image 300 may be decomposed into a plurality of subbands (step 301). Each subband may be associated with a given scale/resolution j (in reference of a multiresolution wavelet transform), a color c, and an orientation k (for instance, three possible orientations).
  • Using the notion of a multiresolution analysis, it is possible to “project” the images values of the image onto a span of functions to obtain a plurality of resolution approximations (i.e. scales, elements 302, 303).
  • Each scales (302, 303, etc) may comprises a plurality of subband (characterized for instance by an orientation k).
  • Each subband (defined by k and j) may be decomposed (step 304) into a plurality of blocks {Bj k [a, b]}a, b as described in FIG. 1 b or FIG. 1 b. The following description uses the notations introduced in the description in relation with these Figures.
  • For each block Bj k [a, b] of the subband (j, k), a noise level is to be computed. Therefore, if the noise level of one block in {Bj k [a, b]}a, b has not been computed (test 305, output OK), the following steps 306, 307,308 are executed.
  • At first, indexes n, m are determined so that:

  • a·A≦m<(a+1)·A,

  • and

  • b·B≦n<(b+1)·B.
  • The wavelet coefficients dc, j k(n, m) on such a range of indexes n, m are also determined for all color components of the image (and of the subband) (the image being encoded according a model in RGB, YCbCr, etc. model), where the index ‘c’ is denoting the color index for the color domain (e.g. c=1 for red, c=2 for green and c=3 for blue in RGB or similarly for a YCbCr color space).
  • For simplification purpose, it is assumed that the color model used to code the image is RGB and thus that there are three color components.
  • The wavelet coefficients being of zero mean, a correlation matrix of coefficients between colors may be computed (step 306). For instance, the correlation matrix of dc1, j k(n, m) and dc2, j k(n, m) is
  • Corr a , b ( c 1 , c 2 ) = 1 AB a · A n < ( a + 1 ) · A b · B n < ( b + 1 ) · B d c 1 , j k ( n , m ) d c 2 , j k ( n , m ) .
  • A “Principal component analysis” (or PCA) may be computed (step 307) with theses correlations matrixes {Corra, b(c1, c2): c1=1 . . . 3 and c2=1 . . . 3}. The correlation matrix Corra, b may be noted Corra, b=U D UT where U is an orthogonal matrix and D is a diagonal matrix with decreasing diagonal coefficients. The matrix U is a matrix of eigenvectors which diagonalizes the matrix Corra, b. D is the diagonal matrix of eigenvalues of Corra, b. This step will typically involve the use of a computer-based algorithm for computing eigenvectors and eigenvalues. These algorithms are readily available as sub-components of most matrix algebra systems.
  • Once the matrix U determined, applying UT to the vector of wavelet color components generates new uncorrelated coefficients:
  • [ C jk 1 ( n , m ) C jk 2 ( n , m ) C jk 3 ( c , m ) ] = U T × [ d 1 , j k ( n , m ) d 2 , j k ( n , m ) d 3 , j k ( n , m ) ]
  • This application of UT to the vector of components may be done block by block (i.e. for n and m that verify a·A≦m<(a+1)·A, and b·B≦n<(b+1)·B), so that the PCA (for “Principal component analysis”) may be adapted locally on the texture properties.
  • Then, the noise level may be estimated (step 308) from the median of the whole subband Cjk3(n, m) or blockwise from this subband as described above.
  • Alternatively, it can be computed by doing a blockwise median estimation on
      • blocks of Cjk1[n, m],
      • blocks of Cjk2[n, m],
      • blocks of Cjk3[n, m],
  • and by computing the minimum of all blockwise medians obtained with all the above blockwise median estimations.
  • The noise level estimation for each subband may be stored in a database 309 or in a memory for future use.
  • Once the noise level of all blocks in {Bj k [a, b]}a, b has been computed (test 305, output KO), a filter may be applied (step 310) for instance on the subband or on the image. Many noise reduction filters may be used such as NL-means, linear smoothing filters, anisotropic diffusion filters, etc. according to the noise level stored in the database 309.
  • When all new scales (311, 312, 313) are available, a new image 315 may be constructed (step 314) according to these new scales with an inverse wavelet transformation.
  • FIG. 4 is a possible embodiment for a device that enables the present invention.
  • In this embodiment, the device 400 comprise a computer, this computer comprising a memory 405 to store program instructions loadable into a circuit and adapted to cause circuit 404 to carry out the steps of the present invention when the program instructions are run by the circuit 404.
  • The memory 405 may also store data and useful information for carrying the steps of the present invention as described above.
  • The circuit 404 may be for instance:
      • a processor or a processing unit adapted to interpret instructions in a computer language, the processor or the processing unit may comprise, may be associated with or be attached to a memory comprising the instructions, or
      • the association of a processor/processing unit and a memory, the processor or the processing unit adapted to interpret instructions in a computer language, the memory comprising said instructions, or
      • an electronic card wherein the steps of the invention are described within silicon, or
      • a programmable electronic chip such as a FPGA chip (for<<Field-Programmable Gate Array>>).
  • This computer comprises an input interface 403 for the reception of subbands and an output interface 406 for providing a noise level.
  • To ease the interaction with the computer, a screen 401 and a keyboard 402 may be provided and connected to the computer circuit 404.
  • A person skilled in the art will readily appreciate that various parameters disclosed in the description may be modified and that various embodiments disclosed may be combined without departing from the scope of the invention.

Claims (21)

What is claimed is:
1-10. (canceled)
11. A method for determining a noise level in a sub-band of an image, the method comprising:
receiving the sub-band of the image, the image being expressed by a color domain comprising a plurality of color channels;
dividing the sub-band spatially into a plurality of blocks;
determining a first wavelet coefficient for each of the blocks;
computing a correlation matrix between each of the color channels for each of the blocks;
computing a plurality of second wavelet coefficients based on the correlation matrix and the first wavelet coefficients for each of the blocks; and
determining the noise level based on the second wavelet coefficients.
12. The method of claim 11, wherein each block comprises a plurality of points and wherein each value of the correlation matrix represents a correlation between two color channels for a corresponding point of the block.
13. The method of claim 11, wherein the computing the second wavelet coefficients comprises:
determining an orthogonal transformation matrix based on the correlation matrix; and
generating the second wavelet coefficients by applying the orthogonal transformation matrix to the first wavelet coefficients.
14. The method of claim 13, wherein the orthogonal transformation matrix is selected such that the noise in the second wavelet coefficients is substantially uncorrelated.
15. The method of claim 11, wherein each of the blocks at least partially overlaps an adjacent one of the blocks.
16. The method of claim 11, wherein the determining the noise level determining the minimum median of the second wavelet coefficients.
17. The method of claim 11, wherein the computing the second wavelet coefficients comprises transforming the color domain into a new color domain and wherein the noise in each color channel of the new color domain is substantially uncorrelated.
18. A device for determining a noise level in a sub-band of an image, the device comprising:
an input interface configured to receive the sub-band of the image, the image being expressed by a color domain comprising a plurality of color channels;
a memory configured to store the sub-band; and
a processor operatively coupled to the memory and the input interface and configured to:
divide the sub-band spatially into a plurality of blocks;
determine a first wavelet coefficient for each of the blocks;
compute a correlation matrix between each of the color channels for each of the blocks;
compute a plurality of second wavelet coefficients based on the correlation matrix and the first wavelet coefficients for each of the blocks; and
determine the noise level based on the second wavelet coefficients.
19. The device of claim 18, wherein each block comprises a plurality of points and wherein each value of the correlation matrix represents a correlation between two color channels for a corresponding point of the block.
20. The device of claim 18, wherein the processor is further configured to compute the second wavelet coefficients based on:
determining an orthogonal transformation matrix based on the correlation matrix; and
generating the second wavelet coefficients by applying the orthogonal transformation matrix to the first wavelet coefficients.
21. The device of claim 20, wherein the processor is further configured to select orthogonal transformation matrix such that the noise in the second wavelet coefficients is substantially uncorrelated.
22. The device of claim 18, wherein each of the blocks at least partially overlaps an adjacent one of the blocks.
23. The device of claim 18, wherein the processor is further configured to determine the noise level based on determining the minimum median of the second wavelet coefficients.
24. The device of claim 18, wherein the processor is further configured to compute the second wavelet coefficients based on transforming the color domain into a new color domain and wherein the noise in each channel of the new color domain is substantially uncorrelated.
25. An apparatus, comprising:
means for receiving a sub-band of an image, the image being expressed by a color domain comprising a plurality of color channels;
means for dividing the sub-band spatially into a plurality of blocks;
means for determining a first wavelet coefficient for each of the blocks;
means for computing a correlation matrix between each of the color channels for each of the blocks;
means for computing a plurality of second wavelet coefficients based on the correlation matrix and the first wavelet coefficients for each of the blocks; and
means for determining the noise level based on the second wavelet coefficients.
26. The apparatus of claim 25, wherein the means for computing the second wavelet coefficients comprises:
means for determining an orthogonal transformation matrix based on the correlation matrix; and
means for generating the second wavelet coefficients by applying the orthogonal transformation matrix to the first wavelet coefficients.
27. The apparatus of claim 26, wherein the orthogonal transformation matrix is selected such that the noise in the second wavelet coefficients is substantially uncorrelated.
28. A non-transitory computer readable medium comprising code that, when executed, causes an apparatus to perform a process comprising:
receive a sub-band of an image, the image being expressed by a color domain comprising a plurality of color channels;
divide the sub-band spatially into a plurality of blocks;
determine a first wavelet coefficient for each of the blocks;
compute a correlation matrix between each of the color channels for each of the blocks;
compute a plurality of second wavelet coefficients based on the correlation matrix and the first wavelet coefficients for each of the blocks; and
determine the noise level based on the second wavelet coefficients.
29. The non-transitory computer readable medium of claim 28, further comprising code that, when executed, causes the apparatus to compute the second wavelet coefficients based on:
determining an orthogonal transformation matrix based on the correlation matrix; and
generating the second wavelet coefficients by applying the orthogonal transformation matrix to the first wavelet coefficients.
30. The non-transitory computer readable medium of claim 29, further comprising code that, when executed, causes the apparatus to select the orthogonal transformation matrix such that the noise in the second wavelet coefficients is substantially uncorrelated.
US14/504,171 2013-05-07 2014-10-01 Method for determining noise level Abandoned US20150016745A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/504,171 US20150016745A1 (en) 2013-05-07 2014-10-01 Method for determining noise level

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/888,802 US8879863B1 (en) 2013-05-07 2013-05-07 Method for determining noise level
US14/504,171 US20150016745A1 (en) 2013-05-07 2014-10-01 Method for determining noise level

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/888,802 Continuation US8879863B1 (en) 2013-05-07 2013-05-07 Method for determining noise level

Publications (1)

Publication Number Publication Date
US20150016745A1 true US20150016745A1 (en) 2015-01-15

Family

ID=51798268

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/888,802 Active US8879863B1 (en) 2013-05-07 2013-05-07 Method for determining noise level
US14/504,171 Abandoned US20150016745A1 (en) 2013-05-07 2014-10-01 Method for determining noise level

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/888,802 Active US8879863B1 (en) 2013-05-07 2013-05-07 Method for determining noise level

Country Status (1)

Country Link
US (2) US8879863B1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104137144B (en) * 2012-02-29 2017-03-08 独立行政法人科学技术振兴机构 Image procossing digital filter and character string inclination illusion generating means
CN111144299B (en) * 2019-12-26 2023-05-23 冠捷电子科技(福建)有限公司 Identification method of high-correlation image under low light source

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6661842B1 (en) * 2000-09-22 2003-12-09 General Dynamics Decision Systems, Inc. Methods and apparatus for error-resilient video coding
US20040126020A1 (en) * 2002-10-02 2004-07-01 Hiroyuki Sakuyama Apparatus and method for processing image data based on object movement speed within a frame
US20060222255A1 (en) * 2005-03-29 2006-10-05 Megachips Lsi Solutions Inc. Image enhancement device
US20080166064A1 (en) * 2007-01-05 2008-07-10 Guoyi Fu Method And Apparatus For Reducing Noise In An Image Using Wavelet Decomposition

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7308146B2 (en) * 2002-09-30 2007-12-11 Canon Kabushiki Kaisha Digital video compression
US7450779B2 (en) * 2004-05-21 2008-11-11 Imaging Dynamics Company Ltd. De-noising digital radiological images
US8120679B2 (en) * 2008-08-01 2012-02-21 Nikon Corporation Image processing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6661842B1 (en) * 2000-09-22 2003-12-09 General Dynamics Decision Systems, Inc. Methods and apparatus for error-resilient video coding
US20040126020A1 (en) * 2002-10-02 2004-07-01 Hiroyuki Sakuyama Apparatus and method for processing image data based on object movement speed within a frame
US20060222255A1 (en) * 2005-03-29 2006-10-05 Megachips Lsi Solutions Inc. Image enhancement device
US20080166064A1 (en) * 2007-01-05 2008-07-10 Guoyi Fu Method And Apparatus For Reducing Noise In An Image Using Wavelet Decomposition

Also Published As

Publication number Publication date
US8879863B1 (en) 2014-11-04
US20140334726A1 (en) 2014-11-13

Similar Documents

Publication Publication Date Title
Sheikh et al. No-reference quality assessment using natural scene statistics: JPEG2000
Sheikh et al. An information fidelity criterion for image quality assessment using natural scene statistics
KR101664913B1 (en) Method and system for determining a quality measure for an image using multi-level decomposition of images
Lyu et al. Exposing region splicing forgeries with blind local noise estimation
US8532396B2 (en) Method and system for determining structural similarity between images
Wang et al. A new alternating minimization algorithm for total variation image reconstruction
Pizurica et al. A joint inter-and intrascale statistical model for Bayesian wavelet based image denoising
Narwaria et al. SVD-based quality metric for image and video using machine learning
Sheikh et al. Image information and visual quality
Grigoryan et al. Transform-based image enhancement algorithms with performance measure
US8660363B2 (en) Method and system for determining a quality measure for an image using a variable number of multi-level decompositions
Rezazadeh et al. A novel discrete wavelet transform framework for full reference image quality assessment
Panigrahi et al. Curvelet‐based multiscale denoising using non‐local means & guided image filter
Ueda et al. Motion analysis using 3D high-resolution frequency analysis
US8879863B1 (en) Method for determining noise level
Thriveni Edge preserving Satellite image enhancement using DWT-PCA based fusion and morphological gradient
Zhang et al. SPCM: Image quality assessment based on symmetry phase congruency
Rezazadeh et al. Low-complexity computation of visual information fidelity in the discrete wavelet domain
Saeedzarandi et al. Image denoising in undecimated dual-tree complex wavelet domain using multivariate t-distribution
Celik et al. Adaptive colour constancy algorithm using discrete wavelet transform
Cakir et al. Image quality assessment using two-dimensional complex mel-cepstrum
US9478044B2 (en) Method and apparatus of creating a perceptual harmony map
Tomaszewska Blind noise level detection
CN112950597B (en) Distorted image quality evaluation method and device, computer equipment and storage medium
Fassold et al. A localized no-reference blurriness measure for omnidirectional images and video

Legal Events

Date Code Title Description
AS Assignment

Owner name: QUALCOMM TECHNOLOGIES, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZORAN (FRANCE) S.A.;CSR PLC;REEL/FRAME:034089/0234

Effective date: 20140608

Owner name: ZORAN (FRANCE) S.A., FRANCE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BERNARD, CHRISTOPHE;LANNES, SARAH;SIGNING DATES FROM 20130614 TO 20130618;REEL/FRAME:034142/0355

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO PAY ISSUE FEE

AS Assignment

Owner name: QUALCOMM INCORPORATED, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:QUALCOMM TECHNOLOGIES, INC.;REEL/FRAME:041694/0336

Effective date: 20170210