Significance map encoding and decoding using partition selection

Patent No. US9774885 (titled "Significance map encoding and decoding using partition selection") on Oct 7, 2016. The application was issued on Sep 26, 2017.

What is this patent about?

’885 is related to the field of video data compression, specifically the entropy encoding and decoding of significance maps within transform units. In modern codecs like HEVC, significance maps identify the locations of non-zero coefficients, and their efficient compression is vital as they represent a substantial portion of the total bitstream. Traditional methods often utilize uniform context modeling, which may not optimally account for the statistical distribution of coefficients across a block.

The underlying idea behind ’885 is that the probability distribution of significant coefficients is not spatially uniform, and therefore, the assignment of contexts should be non-uniform to balance accuracy with adaptivity. By using a non-spatially-uniform partitioning of the significance map, the invention ensures that high-frequency areas with sparse data share contexts to speed up probability convergence, while low-frequency areas with dense data use more granular contexts. This approach prevents the “dilution” of context statistics in regions where non-zero coefficients are rarely encountered.

The claims of ’885 focus on a decoding method and apparatus that reconstructs a significance map by assigning contexts based on a specific quadrant-based partition set. The independent claims require that the upper-left quadrant of the map assigns unique contexts to each bit position, while the upper-right and lower-left quadrants utilize shared contexts among groups of bits. Finally, the lower-right quadrant, where coefficients are least likely to be significant, assigns a single shared context to the majority of its bit positions.

In practice, the system determines the appropriate context for each bit position by looking up its coordinates within a predefined partition map, such as a 4x4 or 8x8 grid. As the decoder processes each significant coefficient flag, it uses the assigned context to interpret the bitstream and then immediately updates that context’s state to reflect the observed data. This allows the probability models to evolve dynamically during the decoding of a single slice, improving the compression ratio for both luma and chroma components.

This invention differs from prior approaches by moving away from rigid, one-to-one context mapping or perfectly symmetrical sub-block partitioning. By clustering bit positions in the bottom-right high-frequency region into a single context, the invention reduces the total number of contexts the hardware must track and update. This reduction in context overhead, combined with the ability to switch between coarse and fine partition sets based on slice size or quantization parameters, results in a more efficient and hardware-friendly entropy coding engine.

How does this patent fit in bigger picture?

Technical Landscape

In the early 2010s when ’885 was filed, video compression systems commonly relied on block-based spectral transforms where residual data was converted into quantized transform domain coefficients. At a time when significance maps were typically implemented using fixed context modeling schemes, the encoding process required tracking a high number of distinct contexts for different transform unit sizes, such as 4x4, 8x8, 16x16, and 32x32 blocks. Hardware and software constraints made the real-time processing of these maps non-trivial, as the memory overhead and computational logic required to look up and update nearly a hundred different context models for every transform unit created significant bottlenecks in high-speed entropy coding architectures.

Prosecution Position

The disclosed invention addresses the technical problem of high computational complexity and memory requirements in entropy encoding by introducing a flexible partition selection architecture for significance maps. Instead of maintaining a rigid, high-count set of context models for every possible coefficient position or fixed sub-block, the system utilizes a method of selecting a partition set from a plurality of available sets based on the size of the transform unit. This architectural shift enables the grouping of coefficient positions into specific partitions that share context models, effectively reducing the total number of contexts the encoder and decoder must track. The resulting technical effect is a streamlined entropy coding process that maintains compression efficiency while significantly lowering the hardware resource demands for context management and look-up operations.

Claims

This patent contains 21 claims, with claims 1, 8, and 15 serving as the independent claims. These independent claims focus on a method, a decoder, and a storage medium for reconstructing a significance map from encoded data by assigning specific context-adaptive decoding parameters to different quadrants of a transform unit, specifically utilizing at least four contexts for the upper left quadrant and a single context for the majority of the lower right quadrant. The dependent claims serve to further define the selection of partition sets based on unit size or text type and specify various initialization procedures for the context values, such as setting them to equiprobability or predetermined probability states.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Context-adaptive decoding
(Claim 1, Claim 8, Claim 15)
The entropy encoding of the symbols in significance map is based upon a context model. The encoder and decoder track separate contexts for luma and chroma TUs. The method involves determining a context for a bit position, decoding based on that context, and updating the context based on the reconstructed bit value.A decoding process where the probability model (context) used to interpret a bit value is selected based on the position of the bit and is updated based on the reconstructed value.
Partition set
(Claim 1, Claim 8, Claim 15)
The partition set assigns contexts to bit positions within the significance map. The 8x8 TUs are partitioned (conceptually for the purpose of context association) into 2x2 blocks such that one distinct context is associated with each 2x2 block. The partition set defines how the significance map is divided into regions for the purpose of assigning contexts.A grouping or mapping scheme that assigns specific contexts to different bit positions or regions within a significance map to reduce the total number of contexts tracked.
Significance map
(Claim 1, Claim 8, Claim 15)
The significance map indicates the positions in the block (other than the last significant coefficient position) that contain non-zero coefficients. The entropy encoding of the symbols in significance map is based upon a context model. The significance map is a block of flags, where each flag corresponds to a coefficient position in the transform unit.A matrix or set of flags corresponding to a transform unit that indicates which positions in the block contain non-zero (significant) coefficients.
Significant coefficient flag
(Claim 1, Claim 8, Claim 15)
The significance map is a block of flags, where each flag corresponds to a coefficient position in the transform unit. A flag is set to one if the corresponding coefficient is non-zero and is set to zero if the coefficient is zero. These flags are decoded using context-adaptive decoding.A specific bit or symbol within the significance map that identifies whether the coefficient at a particular bit position is non-zero.
Transform unit
(Claim 1, Claim 8, Claim 15)
The block or matrix of quantized transform domain coefficients is sometimes referred to as a 'transform unit'. In H.264/AVC and in the current development work for HEVC, the quantized transform coefficients are encoded by encoding a significance map. 4x4, 8x8, 16x16, and 32x32 TUs are contemplated.A block or matrix of quantized transform domain coefficients, such as those resulting from a discrete cosine transform (DCT) or variant, which is the subject of entropy encoding.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
1:25-cv-00967Jun 23, 2025Velos Media, LLC v. ByteDance Ltd et al

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US9774885

SEP
Application Number
US15288115A
Filing Date
Oct 7, 2016
Status
Granted
Publication Date
Sep 26, 2017
External Links
Slate, USPTO , Google Patents