Multi-level significance maps for encoding and decoding

Patent No. US8964849 (titled "Multi-level significance maps for encoding and decoding") on Nov 1, 2011. The application was issued on Feb 24, 2015.

What is this patent about?

’849 is related to the field of video data compression, specifically focusing on the efficient entropy coding of significance maps within large transform units. In modern video standards like HEVC, significance maps identify the locations of non-zero coefficients, but as transform blocks grow to 16x16 or 32x32, the computational cost of determining contexts for every individual flag becomes a significant bottleneck for memory bandwidth and processing speed.

The underlying idea behind ’849 is to implement a multi-level hierarchy for significance maps by partitioning a large transform unit into smaller, non-overlapping blocks or groups. By first signaling a high-level flag for each group to indicate whether it contains any non-zero data, the system can bypass the processing of entire clusters of zero-value coefficients. This hierarchical approach reduces the total number of flags that must be entropy-encoded and allows the decoder to skip memory-intensive context lookups for empty regions of the transform unit.

The claims of ’849 focus on a method and apparatus for reconstructing these flags using a specific inference logic to further save bits. The system decodes a group-level flag and, if non-zero, proceeds to decode individual coefficient flags within that group; however, it includes a mechanism to infer the value of the final flag in a group. Specifically, if a group is known to be non-empty but all previously scanned flags in that group are zero, the decoder automatically infers that the remaining flag at the group's starting position must be one, thereby omitting it from the bitstream.

In practice, the invention operates by scanning the transform unit in a prescribed order, such as a reverse diagonal scan, to identify the last significant coefficient. The encoder uses rate-distortion optimized quantization to decide if certain groups should be entirely zeroed out to improve compression efficiency. During decoding, the system utilizes neighbor-based context modeling—looking at the status of groups to the right and below—to predict the probability of the current group containing non-zero coefficients, which streamlines the arithmetic coding process.

This approach differs from prior methods by moving away from a flat, single-level significance map where every coefficient position requires a dedicated context and bit. By introducing the significant-coefficient-group flag, the invention effectively compresses the map itself. The specific inference rule for the (0,0) position within a group ensures that the bitstream never carries redundant information for groups already proven to be non-zero, providing a leaner data structure for high-resolution video streams.

How does this patent fit in bigger picture?

Technical Landscape

In the early 2010s when ’849 was filed, video compression systems were transitioning toward higher resolution formats at a time when significance maps for transform coefficients were typically implemented using single-level flat structures. When systems commonly relied on position-dependent context modeling for small transform units and neighbor-dependent modeling for larger units, hardware and software constraints made the processing of large transform blocks non-trivial. Specifically, the derivation of entropy coding contexts for 16x16 or 32x32 blocks required intensive memory access operations to evaluate the significance of neighboring flags, creating a computational bottleneck during the high-speed reconstruction of residual data.

Prosecution Position

The disclosed invention represents a meaningful technical advancement by introducing a multi-level significance map architecture that replaces flat, neighbor-dependent flag processing with a hierarchical grouping strategy. By partitioning a transform unit into multiple sub-blocks and assigning a higher-level flag to indicate the presence of any non-zero coefficients within each sub-block, the system enables the decoder to bypass the processing of individual coefficient flags for empty regions. This architectural shift reduces the total number of context-coded bins and minimizes the memory-intensive neighbor lookups previously required for context derivation. The resulting integration of sub-block level signaling overcomes the technical constraint of high computational complexity in entropy decoding, facilitating more efficient processing of large-scale transform units without sacrificing compression performance.

Claims

This patent contains 27 claims, with claims 1, 11, 22, and 24 serving as the independent claims. The independent claims focus on methods and hardware for encoding and reconstructing significant-coefficient flags within a transform unit by partitioning the unit into non-overlapping blocks and using group-level flags to infer or decode individual coefficient flags, specifically identifying conditions where a flag at the first position of a group can be inferred as non-zero. The dependent claims further define the system by specifying block dimensions, detailing the use of neighbor-based context modeling for flag reconstruction, and describing inference logic based on the location of last-significant or DC coefficients.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
DC block
(Claim 1, Claim 11, Claim 22)
The DC block is the block containing the DC coefficient at position (0,0) of the transform unit. In the context of inferring flags, the process checks if the group is not the DC block. For the DC block, the flag at (0,0) is not inferred because the last significant coefficient position might already imply its significance.The specific non-overlapping block within a transform unit that contains the DC (top-left) coefficient of the entire transform unit.
Inferring the significant-coefficient-flag
(Claim 1, Claim 11)
If a group is known to be significant (its group flag is 1) and all other coefficients in the group are zero, the last remaining coefficient must be non-zero. In this case, the encoder does not encode the flag and the decoder infers the value as 1. This reduces the number of bits required to represent the significance map.Determining the value of a flag to be 1 without explicitly decoding it from the bitstream, based on the status of other flags in the same group.
Significant-coefficient flags
(Claim 1, Claim 11, Claim 22, Claim 24)
A significance map indicates the positions in the block that contain non-zero coefficients. Let s(r, c) denote the significance flag of a coefficient at position (r, c), i.e., s(r, c)=1 if the coefficient is not zero and s(r, c)=0 otherwise. The significance map is a map of these flags.Binary indicators (bits) within a significance map that identify whether a transform coefficient at a specific position is non-zero.
Significant-coefficient-group flags
(Claim 1, Claim 11, Claim 22)
The transform unit is partitioned into a plurality of non-overlapping blocks or groups of coefficient positions. A significance map may be thought of as a multi-level map, in which a higher-level map indicates which groups or blocks are significant (i.e. contain at least one non-zero coefficient). The higher-level map is composed of significant-coefficient-group flags, where each flag corresponds to one of the blocks.Flags that indicate whether a specific non-overlapping block (group) within a transform unit contains any non-zero transform coefficients.
Transform unit
(Claim 1, Claim 11, Claim 22, Claim 24)
The block or matrix of quantized transform domain coefficients is sometimes referred to as a 'transform unit'. Transform units are typically N×N, with common sizes including 4×4, 8×8, 16×16, and 32×32. The transform unit contains significant-coefficient flags that indicate the positions of non-zero coefficients.A block or matrix of quantized transform domain coefficients, typically resulting from a spectral transform of residual data.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
1:25-cv-00967Jun 23, 2025Velos Media, LLC v. ByteDance Ltd et al

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US8964849

SEP
Application Number
US13286336A
Filing Date
Nov 1, 2011
Status
Granted
Publication Date
Feb 24, 2015
External Links
Slate, USPTO , Google Patents