Multiple sign bit hiding within a transform unit

Patent No. US9008184 (titled "Multiple sign bit hiding within a transform unit") on Jan 20, 2012. The application was issued on Apr 14, 2015.

What is this patent about?

’184 is related to the field of video data compression, specifically the efficient encoding and decoding of transform coefficients. In modern video standards like HEVC, residual data is converted into spectral coefficients, quantized, and then entropy encoded. A significant portion of the resulting bitstream is dedicated to specifying the sign (positive or negative) of these non-zero coefficients. Traditional methods often allocate one full bit per non-zero coefficient to indicate its sign, which represents a substantial overhead in high-bitrate or high-resolution video streams.

The underlying idea behind ’184 is to reduce bitstream overhead by embedding the sign of a specific coefficient within the mathematical properties of a group of coefficients, a technique known as sign bit hiding. Rather than explicitly signaling every sign bit, the invention partitions a transform unit into multiple non-overlapping subsets and uses the parity (even or odd nature) of the sum of the absolute values of the coefficients within each subset to represent the sign of one hidden coefficient. This allows the encoder to omit one sign bit per subset from the bitstream, provided the subset meets certain density or magnitude criteria.

The claims of ’184 focus on a method and apparatus for processing two or more distinct sets of sign bits within a single transform unit. For each set, the decoder is tasked with summing the absolute values of the reconstructed coefficients to derive a parity value, which then dictates the sign assigned to a specific coefficient in that set. On the encoding side, the claims cover the process of calculating this parity and, if it does not naturally match the sign of the coefficient to be hidden, adjusting a coefficient level by a single unit to flip the parity and ensure the hidden information is correctly embedded.

In practice, the invention leverages the existing modular structure of multi-level significance maps, where transform units are already divided into 4x4 coefficient groups. By applying a threshold test—such as the number of coefficients between the first and last non-zero values in a group—the system determines if a group is robust enough to hide a sign bit without introducing excessive distortion. If the threshold is met, the encoder uses a rate-distortion optimization or a simplified cost metric to decide which coefficient level to increment or decrement to achieve the required parity.

This approach differs from prior solutions that only attempted to hide a single sign bit for the entire transform unit. By enabling multiple hidden bits across partitioned subsets, ’184 significantly increases the potential compression gain, especially in larger 16x16 or 32x32 transform units. The integration with coefficient group scanning ensures that the sign bit hiding process aligns with the hardware-friendly modular processing used in advanced video codecs, providing a balance between computational complexity and bitstream efficiency.

How does this patent fit in bigger picture?

Technical Landscape

In the early 2010s when ’184 was filed, video compression was typically implemented using block-based spectral transformations where residual data was converted into quantized transform domain coefficients. At a time when systems commonly relied on the explicit transmission of a sign bit for every non-zero coefficient within a transform unit, the resulting overhead often accounted for a substantial portion of the total encoded bitstream. When hardware and software constraints made the reduction of bitstream density non-trivial, standard entropy encoding processes were required to manage significance maps, coefficient magnitudes, and signs as distinct data elements, often leading to inefficiencies in high-resolution video processing where the volume of non-zero coefficients was high.

Prosecution Position

The disclosed invention represents a technical advancement by integrating sign bit information directly into the parity of the sum of coefficient magnitudes within a defined block, thereby enabling the omission of at least one explicit sign bit from the bitstream. This architectural shift moves away from one-to-one sign bit signaling toward a data-hiding mechanism where the decoder reconstructs the missing sign based on the calculated parity of the received quantized levels. This technical constraint is overcome by selectively applying this hiding technique only when a block meets specific criteria, such as a minimum threshold of non-zero coefficients or a minimum spatial distance between coefficients, ensuring that the computational cost of parity adjustment does not outweigh the compression gains achieved through bit reduction.

Claims

This patent contains 26 claims, with claims 1, 6, 12, and 19 serving as the independent claims. The independent claims focus on methods and systems for video encoding and decoding that utilize parity values derived from the absolute values of coefficient sets to determine or hide sign bits, specifically by adjusting coefficient levels at the encoder and reconstructing signs at the decoder based on whether the parity is even or odd. The dependent claims provide further technical detail by specifying the organization of coefficients into 4x4 blocks, establishing threshold conditions for applying sign hiding based on scan order distance, defining specific sign assignment rules, and incorporating rate-distortion optimization techniques for selecting which coefficients to adjust.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Adjusting a level of a coefficient
(Claim 12, Claim 19)
If the parity does not correspond to the sign of the coefficient, the encoder adjusts a level of one of the coefficients in the set by one. This adjustment changes the parity value to correspond to the sign of the coefficient. The encoder may choose which coefficient to adjust based on which adjustment results in the lowest rate-distortion cost.The process of incrementing or decrementing the magnitude of a quantized coefficient by one to alter the parity of the set's sum to match the required sign bit.
Parity value
(Claim 1, Claim 6, Claim 12, Claim 19)
The parity of the sum of the absolute values of the coefficients in the set is used to signal the sign of the first non-zero coefficient. For example, an even parity may correspond to a positive sign (+) and an odd parity may correspond to a negative sign (-). The encoder ensures the parity matches the actual sign by potentially adjusting a coefficient level.A numerical result (even or odd) derived from summing the absolute values of a specific set of coefficients, used as a flag to represent the sign of a hidden sign bit.
Sets of sign bits
(Claim 1, Claim 6)
The transform unit is partitioned into sets of coefficients, and for each set, a sign bit may be hidden. The bitstream encodes two or more sets of sign bits for the transform unit, each set corresponding to a respective set of coefficients. This allows for multiple sign bits to be hidden within a single transform unit.Distinct groupings of sign indicators within a single transform unit, where each group is associated with a specific subset of coefficients for independent parity-based sign inference.
Sign bit hiding
(Claim 1, Claim 6, Claim 12, Claim 19)
Sign bit hiding is a technique of hiding the sign bit for one of the coefficients in a group of coefficients. The sign bit is hidden by ensuring that the parity of the sum of the absolute values of the coefficients in the group matches the sign of the coefficient whose sign bit is hidden. At the decoder, the parity of the sum of the absolute values of the coefficients is calculated and used to assign the sign to the coefficient.A technique where the sign of a specific coefficient in a set is not explicitly transmitted in the bitstream but is instead inferred from the parity of the sum of the absolute values of the coefficients in that set.
Transform unit
(Claim 1, Claim 6, Claim 12, Claim 19)
The block or matrix of quantized transform domain coefficients is sometimes referred to as a 'transform unit'. Transform units are typically NxN, with common sizes including 4x4, 8x8, 16x16, and 32x32. It contains the coefficients for which sign bits are being encoded or decoded.A block or matrix of quantized transform domain coefficients (indices) resulting from spectrally transforming residual video data.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
1:25-cv-00967Jun 23, 2025Velos Media, LLC v. ByteDance Ltd et al

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US9008184

SEP
Application Number
US13354465A
Filing Date
Jan 20, 2012
Status
Granted
Publication Date
Apr 14, 2015
External Links
Slate, USPTO , Google Patents