CN102158698A - Method for carrying out layered channel coding on H.264 video data - Google Patents
Method for carrying out layered channel coding on H.264 video data Download PDFInfo
- Publication number
- CN102158698A CN102158698A CN 201110062540 CN201110062540A CN102158698A CN 102158698 A CN102158698 A CN 102158698A CN 201110062540 CN201110062540 CN 201110062540 CN 201110062540 A CN201110062540 A CN 201110062540A CN 102158698 A CN102158698 A CN 102158698A
- Authority
- CN
- China
- Prior art keywords
- layer
- video
- ldpc
- carried out
- layers
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a method for carrying out layered channel coding on a compressed video streaming based on an H.264 standard so as to realize layered protection to the H.264 video streaming.
Description
Joint study
The application is by North China University of Tech and the joint study of information institute of Beijing Jiaotong University, and obtains following fund assistance: Beijing talent of institution of higher education directly under the jurisdiction of a municipal government teaches in-depth planning item (PHR201008187) by force; State natural sciences fund (No.60903066, No.60972085); Beijing's natural science fund (No.4102049), the beginning teacher of Ministry of Education fund (No.20090009120006).
Technical field
The present invention relates to H.264 the video coding transmission, and more specifically, relate to a kind of layering form that adopts to carrying out chnnel coding, to realize the method for the layering protection of video flowing H.264 based on the compressing video frequency flow of standard H.264.
Background technology
Along with the 3G mobile communication rapid development, people require more and more higher to reliability of video data transmission and real-time.H.264 as the video encoding standard of a new generation, have compression ratio and more superior network-adaptive more efficiently.Yet compression ratio can make compressing video frequency flow responsive more to channel error code in transmission course efficiently, particularly wireless channel.In case single unexpected error occurs, just may seriously disturb the normal decoder of decoding end, the quality of decoded video is sharply descended.
H.264 standard has higher code efficiency and stronger anti-bit error performance, but H.264 video code flow has removed a large amount of time and spatial coherence, and this will make code stream very responsive to channel error code.
And in the prior art, source encoding (for example H.264, coding such as MPEG X) is separated with chnnel coding and is carried out.When carrying out chnnel coding, can't consider the difference between can patient channel bit error rate of different pieces of information in the source encoding, and generally adopt conforming impartial mode that the compressed bit stream (output code flow that for example adopt H.26X, MPEG X standard is compressed) of input is carried out chnnel coding.In an example, channel encoder by being divided into a plurality of data blocks with the irrelevant ad hoc rules of source encoding, and adds redundant information at each data block according to regular coding rate (encoding rate) with the video flowing of input.
In order to realize video reliable transmission on the strong wireless channel of fluctuation, the fusion of exploring source encoding and chnnel coding is a kind of effective ways.
Therefore, current press for a kind of can by will be H.264 source encoding combine with chnnel coding, improve the anti-bit error performance of video code flow H.264 and while and can have video flowing coding and transmission method than high coding efficiency.
Summary of the invention
The present invention proposes a kind of can be efficiently in conjunction with the H.264 video transmission method of the characteristic of source encoding and chnnel coding H.264; this method can be under the strong channel circumstance of fluctuation; by video flowing H.264 being carried out layering and at the different code redundancy of each layer interpolation; realize inequality protection to the different data of importance in the video flowing H.264; thereby improve the subjectivity and the objective quality of reconstructing video, strengthened the robustness of transmission system.
For this reason; the present invention is at first to carrying out layering through the video code flow of H.264 encoding; adopt a kind of new chnnel coding algorithm subsequently based on the precoding of carrying out with LDPC (low density parity check code) sign indicating number; come to combine, thereby realize layering protection the H.264 transmission of video code flow with this H.264 video flowing layering protection.
In a scheme, a kind of video flowing is H.264 carried out the method for chnnel coding, may further comprise the steps: according to standard H.264 the video flowing of input is encoded, to obtain H.264 video code flow; According in the described H.264 significance level to decoding when video code flow is decoded, be a plurality of layers with different significance levels with described H.264 video stream decomposing; And adopt LDPC (low density parity check code) precoder that the symbol of each layer in described a plurality of layers is carried out the channel precoding, and subsequently the LDPC coded identification is carried out chnnel coding, so that for the layer that has higher significance level in described a plurality of layers produces more redundant information, and be the less redundant information of layer generation that has low significance level in described a plurality of layer; And with added the described a plurality of laminated of redundant information and after launch.
In another scheme, a kind of video flowing is H.264 carried out the device of chnnel coding, comprising: be used for the video flowing of input being encoded, to obtain the H.264 module of video code flow according to standard H.264; Being used for according in the described H.264 significance level to decoding when video code flow is decoded, is a plurality of layers module with different significance levels with described H.264 video stream decomposing; And be used for adopting LDPC (low density parity check code) precoder that the symbol of described a plurality of each layer of layer is carried out the channel precoding, and subsequently the LDPC coded identification is carried out chnnel coding, so that for the layer that has higher significance level in described a plurality of layers produces more redundant information, and produce the module of less redundant information for the layer that has low significance level in described a plurality of layers; And be used for added the described a plurality of laminated of redundant information and after the module of launching.Described a plurality of layer comprises: layer A, and it comprises header; Layer B, it comprises coefficient information in intra-frame encoding mode and the frame, and wherein, only under the situation that layer A successfully transmitted, the data among the described layer B can be used to decoding; Layer C, it comprises interframe encoding mode and interframe coefficient.
In another scheme, a kind of computer program, it comprises instruction, and described instruction realizes each step in the aforesaid method when being carried out by processor.
Description of drawings
Fig. 1 is source encoding according to an embodiment of the invention provides hierarchical information for chnnel coding a block diagram;
Fig. 2 is a schematic diagram with communication terminal of coding and decoding video ability;
Fig. 3 is according to principle of the present invention, different layers is added the schematic diagram of different redundant codes;
Fig. 4 is according to one embodiment of present invention, compressed video bit stream is carried out the schematic diagram of chnnel coding;
Fig. 5 is the method flow diagram that is used for video data encoder is H.264 carried out the layering chnnel coding according to an embodiment of the invention; And
Fig. 6 is the device schematic diagram that is used for video data encoder is H.264 carried out the layering chnnel coding according to an embodiment of the invention.
Embodiment
Below in conjunction with a plurality of specific embodiments the present invention has been carried out detail parameters.Some details in each embodiment, have been set forth; but it is evident that for those of ordinary skills; these details are not to be intended to protection scope of the present invention is limited to this, and only make those skilled in the art can more easily understand and realize the present invention as example content.Protection scope of the present invention is defined by subsidiary claim.
In Fig. 1, show source encoding according to one embodiment of present invention provides hierarchical information for chnnel coding block diagram.As shown in the figure, data source provides video data stream to be sent, and it can be the video flowing that produces in every way, the digital video frame sequence of taking with digital camera for example, television content sequence of frames of video that obtains by means of TV card or the like.Data source offers source encoder with data, and H.264 it adopt standard this sequence of frames of video to be encoded the video code flow that obtains encoding.Encoded video streams is transfused to channel encoder and carries out chnnel coding.Channel encoder carries out layering according to the information from source encoder with the video code flow of encoding.
Particularly, channel encoder according to data of different types in the video code flow of coding to the difference of the significance level of the source coding of receiver end, with the data in the video code flow of coding be divided into a plurality of layer 1,2,3 ..., and to the different redundant information of these layers interpolation, as discussed further below.
Furthermore, in order to adapt to the chnnel coding of this layering, the present invention proposes a kind of channel coding method based on layering.At first adopt LDPC (low density parity check code) sign indicating number to a plurality of layers 1,2,3 ... middle data are carried out preliminary treatment respectively, and then carry out chnnel coding.
After ovennodulation, filtering, up-conversion or the like operation, on wired or wireless channel, send to the recipient of expection through the code stream after the chnnel coding.The recipient is after receiving the expection signal, carry out operations such as down-conversion, filtering, demodulation to the received signal, and the opposite mode of processing that carry out in employing and transmit leg place is carried out channel-decoding, source coding, to recover the sequence of frames of video that data source was provided by transmit leg, and provide it to data sink, use after a while treating.
As can be seen from Figure 1, an innovative point of the present invention is, be not to be with H.264 coding and chnnel coding are handled dividually, but the hierarchical information that provides by source encoder (for example, provide in every way), will H.264 encode and chnnel coding (through corresponding modification) combines.
Fig. 2 has provided a kind of schematic block diagram that wherein can use the wireless terminal of the solution of the present invention.In the drawings, memory 250 storages sequence of frames of video to be sent, it can obtain with variety of way known in the art by I/O interface 230.H.264 260 pairs of sequence of frames of video from memory 250 of codec are encoded, obtain coded bit stream, and coded bit stream is input to emission/reception (TX/RX) data processor 210 carries out chnnel coding (as described in detail further below) based on layering.Data flow through chnnel coding is provided for operations such as emittor/receiver (TX/RX) unit 200 is modulated, filtering, up-conversion, and sends via antenna 220.
At receiving terminal, the equipment such as wireless terminal, user terminal, base station with similar structures can adopt the opposite mode of processing of carrying out with transmit leg that the data that receive are handled, with the sequence of frames of video that recovers to be sent out.
Though Fig. 2 illustrates a kind of concrete structure of wireless terminal, it will be appreciated that can to use wireless terminal of the present invention not limited thereto.For example; TX/RX 200, H.264 some or all of function of codec 260 and TX/RX data processor 210 can merge in the single processing unit 240; and those skilled in the art retrain in conjunction with specific design, can carry out repartitioning of function between these assemblies and can not break away from protection scope of the present invention.
Fig. 3 is according to principle of the present invention, different layers is added the schematic diagram of different redundant codes.In order in chnnel coding, to give its corresponding different redundant information according to the type of different pieces of information in the video flowing H.264; thereby realize difference protection to different types of data; in coding stage H.264; the information relevant with macro block, quantization parameter, motion vector, intra coded information and interframe encode information is offered channel encoder; and channel encoder carries out layering according to this information to the H.264 video flowing of importing, wherein the significance level difference of each layer when decoding.Based on to the ordering that each layer carries out, being that different layers adds different redundant codes in the significance level in when decoding according to each layer.As shown in the figure, layer 1,2,3,4,5 ... be according to from high to low tactic of significance level, and be the quantity of the redundant code of its interpolation also be according to from how to few tactic.
In a specific embodiment, channel encoder is divided into 3 layers according to above-mentioned hierarchical information with video flowing:
Layer A: it comprises header.This is a most important type in each layer, is losing under the situation of this layer data, and other layers are out of use.This layer can comprise as MB, quantization parameter and motion vector etc.
Layer B: it comprises coefficient information in intra-frame encoding mode and the frame, belongs to interior layer.Under the effective situation of layer A, layer B just can be used for decoding, because the frame internal information can stop further variation, so it is more important than inter-frame information.
Layer C: it comprises interframe encoding mode and interframe coefficient, belongs to the interframe layer.This layer information need be not synchronous between encoder, so belong to non-important kind.
So just can realize error protection in various degree at the difference of importance.Generally speaking, some control informations, synchronizing information and the motion vector information in the video code flow is the data that belong to important, should be with these data organizations at layer A, and other can be organized in a layer B as DCT coefficient etc.Usually, if layer B or layer C lose, effectively header is the efficient that can be used for improving error concealment, and under the packet loss channel, this will make that decoded video quality increases.
Fig. 4 is according to one embodiment of present invention, compressed video bit stream is carried out the schematic diagram of chnnel coding.In one embodiment of the invention, at the source symbol { X that imports
1, X
2, X
3..., X
k(promptly H.264 video flowing), at first adopt the LDPC sign indicating number to carry out precoding, adopt improved chnnel coding of the present invention to LDPC coded identification Y then
1, Y
2, Y
3... Y
nCarry out chnnel coding.Concrete coding step is as follows.
1. construct the check matrix of LDPC sign indicating number.
2. the length that exists in the elimination LDPC check matrix is 4 becate.
3. obtain the coded-bit u after LDPC encodes.
Particularly, check matrix H [A|B] is carried out Gaussian elimination gets H[I|P],
By
Can get
On GF (2) territory, obtain I*c '=P*s ', i.e. c '=P*s ', thereby obtain coded-bit u=[c|s].Wherein, I is a unit matrix, and u is the coded-bit behind the LDPC coding, and c is a check bit, and s is an information bit, and u ', c ' and s ' are corresponding transposed matrix.
4. determine the degree distribution function u (d) of LT coding.This paper adopts the robust orphan after the improvement to distribute:
Wherein desirable orphan distributes
The robust orphan distributes
The Z=∑
dρ (d)+τ (d),
In above formula, d is degree, and K is the source symbolic number, and δ receives the probability limit that can't decipher after the individual coded identification that knows of K '.C be value (0,1] free variable.
5. according to the degree d that generates, from K information source, select d mutual different source symbol to carry out XOR randomly and promptly obtain coded identification.
Fig. 5 is the method flow diagram that is used for video data encoder is H.264 carried out the layering chnnel coding according to an embodiment of the invention.
In step 501, according to standard H.264 the video flowing of input is encoded, to obtain H.264 video code flow.
In step 503,, be a plurality of layers with different significance levels with described H.264 video stream decomposing according in the described H.264 significance level to decoding when video code flow is decoded.
In step 505, adopt the symbol of each layer in above-mentioned LDPC channel precoding and improved these layers of channel coding method to carry out channel precoding and chnnel coding, so that for the layer that has higher significance level in described a plurality of layers produces more redundant information, and be the less redundant information of layer generation that has low significance level in described a plurality of layer.
In step 507, with added the described a plurality of laminated of redundant information and after offer modulator-demodulator and further handle so that via transmission mediums such as wire message way, wireless channel, optical fiber and be transmitted into the recipient.
The recipient, the signal that receives through receiver regulate, down-conversion, filtering and carry out offering channel decoder after the demodulation through TX/RX data processor (for example TX/RX data processor 210 shown in Fig. 2) and decode.Concrete decoding step can be divided into following step:
1. search for a degree and be 1 check code t
n, promptly this check code only with a source symbol S
kContact.If search less than, decoding this time stops, if search, then makes S
k=t
n, with S
kWith all and S
kAssociated t
nXOR is deleted all and S
kContact.
2. repetitive process 1, up to all S of decoding
k
3. to the prior probability of channel presupposed information bit undetermined and iterations is set.
4. draw the posterior probability of each check-node by belief propagation algorithm by the prior probability of information node.
5. extrapolate the posterior probability of information node by the posterior probability of check-node.
6. the posterior probability of information node is done hard decision, obtain decoded result.If cH '=0, then decoding finishes, otherwise repetitive process 3 continues iteration.
Fig. 6 is the device schematic diagram that is used for video data encoder is H.264 carried out the layering chnnel coding according to an embodiment of the invention.Wherein each module can be each functional module that corresponds respectively to the step 501-507 among Fig. 5, and these functional modules can be realized with software, hardware, firmware, middleware and combination thereof.
Each embodiment of the present invention can adopt hardware, software, firmware, middleware or the like to realize.Under situation about realizing with software, each embodiment of the present invention can realize in various routines or application specific processor with the executable instruction form.Under with hard-wired situation, each embodiment of the present invention can be implemented as video encoder chip, video encoder circuit logic or the like, perhaps is incorporated in to wherein.
Claims (8)
1. one kind is carried out the method for chnnel coding to video flowing H.264, may further comprise the steps:
According to standard H.264 the video flowing of input is encoded, to obtain H.264 video code flow;
According in the described H.264 significance level to decoding when video code flow is decoded, be a plurality of layers with different significance levels with described H.264 video stream decomposing; And
Adopt LDPC (low density parity check code) precoder that the symbol of each layer in described a plurality of layers is carried out the channel precoding, and subsequently the LDPC coded identification is carried out chnnel coding, so that for the layer that has higher significance level in described a plurality of layers produces more redundant information, and be the less redundant information of layer generation that has low significance level in described a plurality of layer; And
With added the described a plurality of laminated of redundant information and after launch.
2. the method for claim 1, wherein described a plurality of layer comprises:
Layer A, it comprises header;
Layer B, it comprises coefficient information in intra-frame encoding mode and the frame, and wherein, only under the situation that layer A successfully transmitted, the data among the described layer B can be used to decoding;
Layer C, it comprises interframe encoding mode and interframe coefficient.
3. the method for claim 1, wherein described employing LDPC precoder further may further comprise the steps the step that the symbol of each layer in described a plurality of layers carries out the channel precoding:
(1) is respectively the check matrix H [A|B] of each layer structure LDPC sign indicating number in the described a plurality of layer;
(2) length that exists in the elimination LDPC check matrix is 4 becate;
(3) the coded-bit u of acquisition behind the LDPC coding;
4. method as claimed in claim 3, wherein, described chnnel coding further may further comprise the steps:
(4) determine the degree distributed constant u (d) of LT encoder;
(5), from K source symbol, select d mutual different source symbol to carry out XOR randomly and obtain coded identification according to the degree d that generates.
5. method as claimed in claim 3, wherein, described step (3) further comprises: each check matrix H [A|B] is carried out Gaussian elimination to obtain H[I|P], wherein,
By
And on GF (2) territory, obtain I*c '=P*s ', i.e. c '=P*s ', thereby obtain coded-bit u=[c|s], and wherein, I is a unit matrix, and u is the coded-bit behind the LDPC coding, c is a check bit, and s is an information bit, and u ', c ' and s ' are corresponding transposed matrix.
6. method as claimed in claim 4, wherein, described step (4) further comprises: the degree distributed constant of determining the LT encoder
Wherein,
Desirable orphan distributes
The robust orphan distributes
And
Z＝∑
dρ(d)+τ(d)，
And wherein,
7. one kind is carried out the device of chnnel coding to video flowing H.264, comprising:
Be used for the video flowing of input being encoded, to obtain the H.264 module of video code flow according to standard H.264;
Being used for according in the described H.264 significance level to decoding when video code flow is decoded, is a plurality of layers module with different significance levels with described H.264 video stream decomposing; And
Be used for adopting LDPC (low density parity check code) precoder that the symbol of described a plurality of each layer of layer is carried out the channel precoding, and subsequently the LDPC coded identification is carried out chnnel coding, so that for the layer that has higher significance level in described a plurality of layers produces more redundant information, and produce the module of less redundant information for the layer that has low significance level in described a plurality of layers; And
Be used for added the described a plurality of laminated of redundant information and after the module of launching,
Wherein, described a plurality of layer comprises:
Layer A, it comprises header;
Layer B, it comprises coefficient information in intra-frame encoding mode and the frame, and wherein, only under the situation that layer A successfully transmitted, the data among the described layer B can be used to decoding;
Layer C, it comprises interframe encoding mode and interframe coefficient.
8. computer program, it comprises instruction, described instruction when carrying out by processor,
Realize as each step in the described method of claim 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110062540 CN102158698B (en) | 2011-03-16 | 2011-03-16 | Method for carrying out layered channel coding on H.264 video data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110062540 CN102158698B (en) | 2011-03-16 | 2011-03-16 | Method for carrying out layered channel coding on H.264 video data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102158698A true CN102158698A (en) | 2011-08-17 |
| CN102158698B CN102158698B (en) | 2013-01-09 |
Family
ID=44439842
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110062540 Expired - Fee Related CN102158698B (en) | 2011-03-16 | 2011-03-16 | Method for carrying out layered channel coding on H.264 video data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102158698B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112532569A (en) * | 2019-09-19 | 2021-03-19 | 澜至电子科技（成都）有限公司 | Video code stream protection device, method and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101106722A (en) * | 2007-06-18 | 2008-01-16 | 北京交通大学 | A multi-description video encoding and decoding method based on self-adapted time domain sub-sampling |
| US20090034629A1 (en) * | 2007-07-02 | 2009-02-05 | Lg Electronics Inc. | Digital broadcasting system and data processing method |
| US20090103649A1 (en) * | 2007-10-22 | 2009-04-23 | Nokia Corporation | Digital Broadcast Signaling Metadata |
| CN101626512A (en) * | 2009-08-11 | 2010-01-13 | 北京交通大学 | Method and device of multiple description video coding based on relevance optimization rule |
-
2011
- 2011-03-16 CN CN 201110062540 patent/CN102158698B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101106722A (en) * | 2007-06-18 | 2008-01-16 | 北京交通大学 | A multi-description video encoding and decoding method based on self-adapted time domain sub-sampling |
| US20090034629A1 (en) * | 2007-07-02 | 2009-02-05 | Lg Electronics Inc. | Digital broadcasting system and data processing method |
| US20090103649A1 (en) * | 2007-10-22 | 2009-04-23 | Nokia Corporation | Digital Broadcast Signaling Metadata |
| CN101626512A (en) * | 2009-08-11 | 2010-01-13 | 北京交通大学 | Method and device of multiple description video coding based on relevance optimization rule |
Non-Patent Citations (1)
| Title |
|---|
| 《中国优秀博士学位论文数据库》 20090616 白慧慧 多描述图像/视频编码的研究 全文 1-8 , * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112532569A (en) * | 2019-09-19 | 2021-03-19 | 澜至电子科技（成都）有限公司 | Video code stream protection device, method and storage medium |
| CN112532569B (en) * | 2019-09-19 | 2022-05-31 | 澜至电子科技（成都）有限公司 | Video code stream protection device, method and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102158698B (en) | 2013-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101626512A (en) | Method and device of multiple description video coding based on relevance optimization rule | |
| CN104871546B (en) | Enhanced video stream with application layer forward error correction is sent | |
| CN101578871A (en) | Cavlc enhancements for svc cgs enhancement layer coding | |
| CN103260033B (en) | Robust video transmission method combined with networking coding on end system and relay node | |
| CN110740334B (en) | Frame-level application layer dynamic FEC encoding method | |
| CN103227926A (en) | Video coding device and method applicable to low-bandwidth wireless communication channel | |
| CN103347202A (en) | EWF code decoding method for wireless communication system | |
| CN108924593A (en) | Use the forward error correction for the source block for having the synchronization start element identifier between symbol and data flow from least two data flows | |
| CN103139571A (en) | Video fault-tolerant error-resisting method based on combination of forward error correction (FEC) and WZ encoding and decoding | |
| KR101259659B1 (en) | A priority-differential non-uniform raptor coding method | |
| CN101902796B (en) | Acquisition degree distributing method, data transmission method and equipment as well as relay system | |
| CN102158698B (en) | Method for carrying out layered channel coding on H.264 video data | |
| CN102710943B (en) | Real-time video transmission method based on forward error correction encoding window expanding | |
| CN104137455A (en) | Method and apparatus for providing streaming service | |
| US9131254B2 (en) | Cross layer coding for satellite mobile TV broadcast method and apparatus | |
| Chang et al. | Unequal-protected LT code for layered video streaming | |
| CN102065289A (en) | Reliable video transmission method and device based on network coding | |
| CN102316315A (en) | Real-time video transmission method | |
| CN102547287B (en) | Raptor code-based image coding method | |
| Qing et al. | Practical distributed video coding in packet lossy channels | |
| Gillani et al. | VQProtect: Lightweight visual quality protection for error-prone selectively encrypted video streaming | |
| Prasetiadi et al. | Decoding scheme of error correction using fake error addition to compress data transmission | |
| CN104394401B (en) | A kind of stereo video transmission method based on without rate modulation | |
| Wang et al. | Error robustness scheme for H. 264 based on LDPC code | |
| CN105554500A (en) | Video transmission method and system based on RCM (Rate Compatible Modulation) decoding symbol unequal allocation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130109 Termination date: 20140316 |