Motion prediction in video coding

Patent No. US10523960 (titled "Motion prediction in video coding") on Jan 22, 2018. The application was issued on Dec 31, 2019.

What is this patent about?

’960 is related to the field of video compression and decompression, specifically focusing on motion-compensated prediction techniques. In modern video codecs, bi-directional prediction improves efficiency by averaging two different reference blocks to predict a current block of pixels. However, conventional methods often introduce significant rounding errors because they reduce the bit-depth of each individual prediction signal before combining them, leading to a loss of image fidelity and requiring complex signaling to manage rounding directions.

The underlying idea behind ’960 is to maintain prediction signals at a higher bit-depth throughout the intermediate calculation stages to preserve mathematical accuracy. Instead of truncating or rounding each reference block prediction to the standard pixel bit-depth immediately after interpolation, the system keeps these values in a high-precision intermediate format. By delaying the precision reduction until after the multiple prediction signals have been mathematically combined, the invention minimizes the cumulative effect of rounding noise that typically plagues multi-reference prediction.

The claims of ’960 focus on a method and apparatus that identifies a block requiring multiple reference blocks and determines specific pixel locations within those references. The system generates a first and second prediction at a second precision that is strictly higher than the original pixel bit-depth. These high-precision signals are then merged into a combined prediction, and only after this combination is the final bit-depth reduced back to the original precision through a right-shift operation.

In a practical implementation, when a motion vector points to a fractional pixel location, the encoder or decoder applies an interpolation filter to the surrounding full pixels. Rather than right-shifting the result of this filter all the way down to an 8-bit or 10-bit pixel value, the system performs a partial shift or no shift at all, storing the result in a larger register, such as a 16-bit buffer. This allows the subsequent averaging of the two blocks to occur without losing the fractional data that would have been discarded in a standard two-stage rounding process.

This approach differs from prior solutions by eliminating the need to signal rounding offsets or alternate rounding directions between frames in the bitstream. By utilizing delayed bit-depth reduction, the invention simplifies the codec architecture, as it removes the requirement for separate code branches to handle different rounding modes. The result is a more streamlined decoding process that achieves higher reconstruction quality by ensuring that the final pixel values are derived from the most accurate possible intermediate sum.

How does this patent fit in bigger picture?

Technical Landscape

In the early 2010s when ’960 was filed, video compression systems commonly relied on hybrid coding architectures where pixel blocks were predicted using either spatial or temporal references to reduce data redundancy. At a time when inter-prediction was typically implemented using motion compensation from one or more reference frames, systems often performed rounding or bit-depth reduction at each intermediate stage of the prediction process to accommodate hardware memory constraints and fixed-point arithmetic limitations. When hardware or software constraints made high-precision data handling non-trivial, these intermediate rounding operations were necessary to maintain standard bit-depths throughout the codec pipeline, even though they introduced cumulative rounding errors that could degrade the final reconstructed image quality.

Prosecution Position

The disclosed invention represents a technical advancement in video coding efficiency by implementing an architectural shift in how multi-directional prediction signals are processed. Instead of reducing the precision of individual prediction signals immediately after interpolation, the system maintains these signals at a higher bit-depth throughout the combination phase. This integration of high-precision intermediate values allows for the summation of multiple reference blocks before a single, final precision reduction is applied. The resulting technical effect is the mitigation of cumulative rounding errors and the elimination of the need to signal rounding offsets within the bitstream, thereby improving prediction accuracy while reducing the overhead associated with rounding control parameters.

Claims

This patent contains 26 claims, with claims 1, 8, 15, 19, and 23 being independent. The independent claims focus on a system and method for processing pixel blocks by determining reference locations, generating high-precision predictions, combining those predictions, and then reducing the final precision through bit-shifting. The dependent claims serve to specify further technical details such as handling integer samples, applying specific rounding offsets, managing intermediate precision levels, and defining the block types as bi-directional or multidirectional.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Combined prediction
(Claim 1, Claim 8, Claim 15, Claim 19, Claim 23)
The accuracy of the bi-directional or multidirectional prediction signal can then be downshifted to an appropriate accuracy for post processing purposes. The rounding to the bit-depth range of the video signal is performed after both prediction signals are added. This combined prediction is obtained based at least partly upon the first prediction and the second prediction.A multi-directional or bi-directional prediction signal formed by merging at least two high-precision reference signals before any bit-depth reduction occurs.
First precision
(Claim 1, Claim 8, Claim 15, Claim 19, Claim 23)
The first precision indicates a number of bits needed to represent the values of the pixels. The invention performs rounding to the bit-depth range of the video signal after both prediction signals are added. This precision is lower than the intermediate precision used during prediction calculations.The bit-depth or number of bits used to represent the pixel values of the original video signal or the final decoded output.
Second precision
(Claim 1, Claim 8, Claim 15, Claim 19, Claim 23)
Prediction signals are maintained in a higher precision during the prediction calculation and the precision is reduced after the two or more prediction signals have been combined with each other. This second precision indicates the number of bits needed to represent values of the first and second predictions. It keeps the motion compensated prediction signal of each one of the predictions at the highest precision possible after interpolation.An intermediate higher bit-depth used during motion compensation and interpolation to maintain accuracy and reduce rounding errors before combining multiple predictions.
Shifting bits of the combined prediction to the right
(Claim 1, Claim 8, Claim 15, Claim 19, Claim 23)
The accuracy of the bi-directional or multidirectional prediction signal can then be downshifted to an appropriate accuracy for post processing purposes. This process decreases the precision of the combined prediction to the first precision. It removes the need to signal a rounding offset or use different methods for rounding for different frames.A bitwise operation used to decrease the numerical precision of the combined prediction signal to match the original video bit-depth.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
1:25-cv-00523Apr 7, 2025Nokia Technologies Oy V. Acer Inc.
1:23-cv-01237Oct 31, 2023Nokia Technologies Oy V. Hp, Inc.
1:23-cv-01236Oct 31, 2023Nokia Technologies Oy V. Amazon.Com, Inc.

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US10523960

SEP
Application Number
US15876495A
Filing Date
Jan 22, 2018
Status
Granted
Publication Date
Dec 31, 2019
External Links
Slate, USPTO , Google Patents