Method and associated device for filtering digital video images

Patent No. US9800891 (titled "Method and associated device for filtering digital video images") on Jan 19, 2001. The application was issued on Oct 24, 2017.

What is this patent about?

’891 is related to the field of digital video processing, specifically the reduction of visual artifacts in block-based video coding. In standard compression schemes like H.263, images are divided into discrete blocks for transformation and quantization, a process that frequently introduces discontinuities at the edges of these blocks. These discontinuities, known as blocking artifacts, degrade image quality and can propagate through subsequent frames when used in motion-compensated prediction.

The underlying idea behind ’891 is that deblocking filters should not be applied uniformly across all block edges, but should instead adapt their intensity and scope based on the specific coding history of the adjacent blocks. By recognizing that different coding modes—such as intra-coding versus motion-compensated prediction—introduce different levels of noise and edge reliability, the system can dynamically adjust the filtering strength and the number of pixels modified. This prevents the filter from inadvertently blurring real image features while ensuring that artificial edges created by the compression process are effectively smoothed.

The claims of ’891 focus on an adaptive filtering mechanism that determines the number of pixels to be examined and filtered on each side of a block boundary based on the prediction encoding methods used for the two neighboring blocks. The independent claims specify that the filter receives information identifying whether each block was encoded using intra-coding, copy coding, motion-compensated prediction, or was not coded at all. This metadata is used as a primary parameter to calculate a specific number of pixels to be processed on the first and second sides of the boundary, allowing for asymmetrical filtering if the block types differ.

In practice, the invention implements a multi-step decision process that combines the block type information with the local pixel gradient and the quantization step size. The system calculates an activity parameter to distinguish between a true image edge and a compression artifact. If the difference across the boundary is too large, the filter is disabled to preserve detail. If filtering is warranted, the truncation values derived from the block types (such as Intra or Copy) dictate exactly how many pixels deep into each block the filter will reach, ensuring the smoothing effect is proportional to the likely error in that specific region.

This approach differs from prior solutions by moving away from fixed-window low-pass filters that often over-smooth the image or fail to remove persistent artifacts. By utilizing the coding mode metadata as a control signal for the filter, the invention allows the decoder to make more intelligent decisions about the reliability of the pixel data. This results in a more refined reconstruction where the filtering is aggressive enough to hide block boundaries in flat areas but conservative enough to maintain the sharpness of actual objects within the video frame.

How does this patent fit in bigger picture?

Technical Landscape

In the early 2000s when ’891 was filed, digital video compression was typically implemented using block-based transform coding where frames were partitioned into discrete spatial segments for processing. At a time when systems commonly relied on fixed filtering operations to smooth the transitions between these segments, hardware and software constraints made the preservation of high-frequency image details non-trivial during the deblocking process. Engineering practices often utilized uniform filtering across all block boundaries, which frequently resulted in over-smoothing of actual image edges or insufficient suppression of artifacts depending on the local coding characteristics.

Prosecution Position

The disclosed invention achieves a technical advancement by introducing an adaptive filtering architecture that modifies filtering parameters based on the specific coding types of the blocks adjacent to a boundary. This structural shift moves away from static deblocking by integrating block-type analysis—such as distinguishing between inter-coded, copy, or non-coded blocks—directly into the filter control logic. This capability enables the system to dynamically adjust the number of pixels selected for correction and the filtering window size, overcoming the constraint of uniform processing that previously led to image degradation. The resulting technical effect is a more precise reduction of blocking artifacts while maintaining the integrity of authentic image edges through context-aware signal processing.

Claims

This patent contains 41 claims, with independent claims 1, 10, 17, 18, 19, 20, 21, 23, 25, 27, 29, 31, 33, 35, 36, 37, and 41 focusing on methods and hardware for adaptive block boundary filtering in video processing by determining the number of pixels to examine based on the specific prediction encoding methods used for adjacent image blocks. The dependent claims generally serve to further specify filtering parameters such as quantization step size, pixel value differences, region types, and the use of filtering windows to calculate new pixel values.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Adaptive block boundary filtering operation
(Claim 1, Claim 10, Claim 21, Claim 23, Claim 25, Claim 41)
The method according to the invention adjusts filtering parameters according to the type of blocks whose boundary is to be filtered. Different filtering parameters are chosen according to the type of block on either side of the boundary in order to yield an improved filtering result. The objectives of the invention are achieved by adapting the selection of pixels for filtering and the filtering process more flexibly than before to the features of the frame and the environment of the filtering point.A filtering process applied to pixels at or near the boundary of decoded image blocks where the filtering parameters, such as the number of pixels selected or the filter strength, are adjusted based on the coding characteristics of the adjacent blocks.
Block boundary
(Claim 1, Claim 10, Claim 17, Claim 18, Claim 19, Claim 20, Claim 21, Claim 23, Claim 25, Claim 27, Claim 29, Claim 31, Claim 33, Claim 35, Claim 36, Claim 37, Claim 41)
Because blocking artefacts only occur at block boundaries, according to the invention, filtering is advantageously only applied to pixels at block boundaries and the vicinity thereof. Because the image to be coded is generally divided into blocks both vertically and horizontally, the image contains both vertical and horizontal block boundaries. With regard to vertical block boundaries, there are pixels to the right and left of the boundary, and with regard to horizontal block boundaries, there are pixels above and below the boundary.The interface or edge formed between two adjacent decoded image blocks (either horizontally or vertically) where visual blocking artifacts typically occur.
Intra coding
(Claim 1, Claim 10, Claim 17, Claim 18, Claim 19, Claim 20, Claim 21, Claim 23, Claim 25, Claim 27, Claim 29, Claim 31, Claim 33, Claim 35, Claim 36, Claim 37, Claim 41)
The method according to the invention adjusts filtering parameters according to the type of blocks whose boundary is to be filtered. In an exemplary embodiment, the factors affecting filtering include the type of block on either side of the boundary (e.g. inter, copy, coded, not-coded). [Note: The specification uses 'inter' and 'coded' as examples of the types defined in the claims' group of prediction methods].A specific type of prediction encoding method where a block is coded based on information within the same frame, rather than referring to other frames.
Not-coded coding
(Claim 1, Claim 10, Claim 17, Claim 18, Claim 19, Claim 20, Claim 21, Claim 23, Claim 25, Claim 27, Claim 29, Claim 31, Claim 33, Claim 35, Claim 36, Claim 37, Claim 41)
In an exemplary embodiment of the filtering method according to the invention, the number of pixels to be corrected, the characteristic features of the filter being used and the size of the filtering window depend on the type of block on either side of the boundary (e.g. inter, copy, coded, not-coded).A specific type of prediction encoding method where a block is not explicitly processed with new transform coefficients, serving as one of the block types used to determine adaptive filtering parameters.
Number of pixels to be examined
(Claim 1, Claim 10, Claim 17, Claim 18, Claim 19, Claim 20, Claim 23, Claim 25, Claim 27, Claim 29, Claim 31, Claim 33, Claim 35, Claim 41)
In an advantageous embodiment of the method according to the invention, the number of the pixels selected for filtering can vary, and it is not necessarily the same on different sides of a block boundary. The number of pixels also depends on the type of block on either side of the boundary. Because the number of pixels is adapted to the general features of the image information contained by the frame in a particular region, the method produces a better filtering result.A variable parameter of the filtering operation that defines how many pixels on each respective side of a block boundary are considered or selected for the filtering process.
Prediction encoding method
(Claim 1, Claim 10, Claim 17, Claim 18, Claim 19, Claim 20, Claim 21, Claim 23, Claim 25, Claim 27, Claim 29, Claim 31, Claim 33, Claim 35, Claim 36, Claim 37, Claim 41)
In an exemplary embodiment of the filtering method according to the invention, the number of pixels to be corrected, the characteristic features of the filter being used and the size of the filtering window depend on the type of block on either side of the boundary (e.g. inter, copy, coded, not-coded). A block type is defined according to the coding method for a block selected from a predetermined set of coding types.The specific technique used to compress an image block, selected from a set including intra coding, copy coding, motion-compensated prediction, and not-coded coding, which determines how the block is reconstructed.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
0:24-cv-04269Nov 25, 2024Element Television Company, Llc V. Nokia Corporation
1:23-cv-01236Oct 31, 2023Nokia Technologies Oy V. Amazon.Com, Inc.

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US9800891

SEP
Application Number
US09766035A
Filing Date
Jan 19, 2001
Status
Expired
Publication Date
Oct 24, 2017
External Links
Slate, USPTO , Google Patents