Method for coding and an apparatus

Patent No. US10536714 (titled "Method for coding and an apparatus") on Mar 18, 2019. The application was issued on Jan 14, 2020.

What is this patent about?

’714 is related to the field of video compression, specifically the mechanisms used to predict motion vectors during the encoding and decoding of video sequences. In modern hybrid video codecs, motion information for a current block is often predicted from previously coded neighboring blocks to reduce the amount of data that must be transmitted. This process involves constructing a list of potential motion vector candidates, known as a merge list, from which an optimal predictor is selected and signaled.

The underlying idea behind ’714 is to streamline the construction of the motion vector candidate list by performing a limited, intelligent redundancy check rather than an exhaustive comparison of all possible candidate pairs. The inventor recognized that comparing every available spatial and temporal candidate to remove duplicates is computationally expensive and can lead to decoding errors if reference data is lost. By using the spatial location of a candidate block to determine a specific, restricted subset of other candidates for comparison, the system can effectively prune the list with significantly lower overhead.

The claims of ’714 focus on a method and apparatus for generating a motion vector prediction list by selecting a potential spatial candidate and determining a specific subset of existing candidates for comparison based on that candidate's location. The independent claims specify that the motion information of the first candidate is compared only with this determined subset, explicitly avoiding a full all-pairs comparison of the entire candidate set. Based on this targeted comparison, the system decides whether to include or exclude the candidate from the final list used for signaling or decoding.

In practice, the invention operates by evaluating neighboring blocks—such as those located to the left, above, or at the corners of the current prediction unit—in a specific sequence. For each neighbor, the codec identifies which previous neighbors are likely to hold identical motion data based on the geometric relationship and the partitioning mode of the coding unit. For example, if a block is split into two vertical units, the second unit may automatically exclude certain neighbors to prevent redundant signaling, ensuring the merge list remains compact and computationally efficient to process.

This approach differs from prior solutions that either performed exhaustive redundancy checks or used fixed candidate sets that did not adapt to the local geometry of the prediction units. By implementing location-based pruning, the invention ensures that the encoder and decoder remain synchronized even in high-complexity scenarios or when temporal data is unavailable. This targeted logic reduces the number of required comparison operations while maintaining high compression efficiency, effectively cutting through the processing bottleneck of candidate list management.

How does this patent fit in bigger picture?

Technical Landscape

In the early 2010s when ’714 was filed, video compression systems were transitioning toward high-efficiency coding frameworks that utilized recursive block partitioning into coding, prediction, and transform units. At a time when motion information was typically implemented using differential motion vector coding or merge modes, systems commonly relied on generating candidate lists from spatial and temporal neighbors to predict motion fields. When hardware and software constraints made the exhaustive comparison of all candidate pairs computationally expensive, encoders and decoders faced significant overhead in pruning redundant motion information to maintain bitstream efficiency. Furthermore, when systems relied on temporal motion vector predictions, the potential loss of reference frames created a technical risk where the decoder could not reliably determine which candidates to remove, leading to synchronization errors and motion information drift.

Prosecution Position

The disclosed invention addresses the technical problem of computational complexity and error resilience in motion vector prediction list construction. The architectural solution involves a selective pruning process where a first spatial motion vector prediction candidate is compared only against a specific subset of other candidates, with the selection of that subset being dynamically determined based on the spatial location of the block associated with the candidate. This represents a technical advancement by shifting from exhaustive redundancy checking to a localized, position-dependent comparison logic. The resulting technical effect is a reduction in the number of required comparison operations during merge list generation without sacrificing coding efficiency. Additionally, by decoupling the pruning of spatial candidates from temporal prediction availability, the architecture enables a more robust decoding process that prevents motion information drift in the event of reference frame loss.

Claims

US10,536,714 contains 30 claims, with claims 1, 9, 15, 23, 29, and 30 being independent. The independent claims focus on methods, apparatuses, and computer-readable media for managing motion vector prediction lists in video coding by selecting spatial motion vector prediction candidates and comparing their motion information against specific subsets to determine inclusion or exclusion without exhaustive pair-wise comparisons. The dependent claims further refine this process by specifying candidate selection orders, limiting the number of candidates, incorporating temporal prediction candidates, and defining exclusion criteria based on block partitioning and spatial redundancy.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Exclude the first spatial motion vector prediction candidate
(Claim 1, Claim 9, Claim 15, Claim 23, Claim 29, Claim 30)
After the list is generated, some of the motion vector prediction candidates may have the same motion information. In this case, the identical motion vector prediction candidates may be removed to reduce redundancy. This can be achieved by performing a limited number of motion information comparisons between candidate pairs to remove the redundant candidates rather than comparing every available candidate pair.The act of removing a candidate from the prediction list to reduce redundancy when its motion information is found to correspond with (be identical to) another candidate in the determined subset.
Motion information
(Claim 1, Claim 9, Claim 15, Claim 23, Claim 29, Claim 30)
Moreover, some high efficiency video codecs employ an additional motion information coding/decoding mechanism, often called merging/merge mode, where all the motion field information, which includes motion vector and corresponding reference picture index for each available reference picture list, may be predicted and used without any modification or correction. These motion vectors represent the displacement of the image block in the picture to be coded (in the encoder) or decoded (at the decoder) and the prediction source block in one of the previously coded or decoded images (or pictures).Data used for motion-compensated prediction, including motion vectors representing displacement and corresponding reference picture indices for reference picture lists.
Motion vector prediction list
(Claim 1, Claim 9, Claim 15, Claim 23, Claim 29, Claim 30)
Another way to create motion vector predictions is to generate a list or a set of candidate predictions from blocks in the current frame and/or co-located or other blocks in temporal reference pictures and signalling the chosen candidate as the motion vector prediction. Some video codecs employ a merge process for motion information coding and creates a list of motion prediction candidates from which one of the candidates is to be signalled as the motion information for the current coding or prediction unit. The motion prediction candidates may consist of several spatial motion predictions and a temporal motion prediction.A list or set of candidate motion vector predictions generated from spatial adjacent blocks and/or temporal reference pictures, used to signal or determine the motion information for a current coding or prediction unit.
Spatial motion vector prediction candidate
(Claim 1, Claim 9, Claim 15, Claim 23, Claim 29, Claim 30)
A spatial motion vector prediction is a prediction obtained only on the basis of information of one or more blocks of the same frame than the current frame. The spatial candidates are obtained from the motion information of e.g. spatial neighbour blocks. These motion vectors represent the displacement of the image block in the picture to be coded and the prediction source block in one of the previously coded or decoded images.A motion vector prediction obtained based on the motion information of one or more blocks within the same frame as the current block, such as spatially neighboring blocks.
Subset of spatial motion vector prediction candidates
(Claim 1, Claim 9, Claim 15, Claim 23, Claim 29, Claim 30)
The decision of whether comparing two candidates may depend on the order of the candidates to be considered for the list and/or coding/prediction mode and/or location of the blocks associated with the candidates. This can be achieved by performing a limited number of motion information comparisons between candidate pairs to remove the redundant candidates rather than comparing every available candidate pair. The spatial candidates are obtained from the motion information of e.g. spatial neighbour blocks.A limited group of spatial candidates selected from the full set of available candidates, where the selection is determined by the specific location of the block associated with a candidate being considered for the list.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
1:25-cv-00523Apr 7, 2025Nokia Technologies Oy V. Acer Inc.
0:24-cv-04269Nov 25, 2024Element Television Company, Llc V. Nokia Corporation
1:23-cv-01237Oct 31, 2023Nokia Technologies Oy V. Hp, Inc.

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US10536714

SEP
Application Number
US16356733A
Filing Date
Mar 18, 2019
Status
Granted
Publication Date
Jan 14, 2020
External Links
Slate, USPTO , Google Patents