Video storage

Patent No. US9300969 (titled "Video storage") on Sep 9, 2009. The application was issued on Mar 29, 2016.

What is this patent about?

'969 is related to the field of video encoding, specifically techniques for adjusting the quantization parameter (QP) during video compression. The background involves standard video coding methods like MPEG and H.264, which compress video by removing redundant temporal and spatial information. A key challenge is selecting the appropriate QP to balance bit rate and video quality, especially when hardware limitations prevent looking ahead at future frames to predict motion.

The underlying idea behind '969 is to use motion-sensing data from accelerometers or location-sensing circuitry as a proxy for predicting motion in video frames. Instead of analyzing future frames, the invention leverages the device's physical movement to estimate the amount of motion that will be present in the captured video. This allows for dynamic adjustment of the QP, improving video quality without requiring extensive buffering or look-ahead capabilities.

The claims of '969 focus on an electronic device (e.g., a smartphone) with a camera, motion-sensing circuitry, and data processing circuitry. The device captures an uncompressed video frame, detects physical motion, and encodes the frame using a QP. The QP is selected based on the detected physical motion and a prediction error of a preceding encoded frame, representing a difference between the encoded frame and a source frame from which the encoded frame was coded.

In practice, the device captures video and simultaneously monitors its own movement using accelerometers or location sensors. If the device detects significant movement, it lowers the QP to preserve detail in the encoded video, anticipating that the movement will introduce more complexity. Conversely, if the device is relatively still, it increases the QP to reduce the bit rate, assuming less detail needs to be preserved. The system also compares the prediction error of previous frames with the motion-sensing input to determine if the motion data is actually indicative of motion in the video.

This approach differs from prior solutions that rely on analyzing future or past video frames to estimate motion. By using real-time motion-sensing data, the invention avoids the need for complex look-ahead algorithms or large frame buffers. This is particularly beneficial for devices with limited processing power or memory, enabling them to dynamically adjust the QP and achieve a better balance between video quality and compression efficiency. The correlation between prediction error and motion-sensing input is crucial for determining the QP.

How does this patent fit in bigger picture?

Technical Landscape

In the late 2000s when ’969 was filed, video compression was typically implemented using block-based motion estimation and compensation to reduce temporal redundancy. At a time when systems commonly relied on analyzing pixel data from previous and future frames to determine encoding complexity, hardware or software constraints made real-time quantization adjustments non-trivial for devices with limited computational look-ahead capabilities. Consequently, encoding parameters were generally derived from the video bitstream itself rather than from external physical sensors integrated into the capture hardware.

Prosecution Position

The examiner allowed the application because the prior art did not specifically disclose a video processing system that combines physical motion data with image data to adjust compression settings. Specifically, the examiner noted that existing technologies failed to show a processor that compares the prediction error of a previous frame—defined as the difference between the encoded frame and its source—against the physical movement of the device detected by motion sensors to select the quantization parameter for the current frame.

Claims

This patent contains 37 claims, of which claims 1, 7, 14, 20, and 26 are independent. The independent claims are generally directed to an electronic device, a method, or a system that encodes video frames based on motion sensing and prediction error. The dependent claims generally elaborate on the specific components, methods, or features described in the independent claims.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Motion-sensing circuitry
(Claim 1, Claim 7, Claim 14, Claim 20, Claim 26)
For example, an electronic device for obtaining and encoding video may include image capture circuitry, motion-sensing circuitry, and data processing circuitry. The image capture circuitry may capture an uncompressed video frame, and the motion-sensing circuitry may detect physical motion of the electronic device. The data processing circuitry may encode the uncompressed video frame based at least in part on a quantization parameter, which the data processing circuitry may determine based at least in part on whether the motion-sensing circuitry has detected physical motion of the electronic device.Circuitry configured to detect physical motion of the camera or electronic device.
Physical motion
(Claim 1, Claim 7, Claim 14, Claim 20, Claim 26)
For example, an electronic device for obtaining and encoding video may include image capture circuitry, motion-sensing circuitry, and data processing circuitry. The image capture circuitry may capture an uncompressed video frame, and the motion-sensing circuitry may detect physical motion of the electronic device. The data processing circuitry may encode the uncompressed video frame based at least in part on a quantization parameter, which the data processing circuitry may determine based at least in part on whether the motion-sensing circuitry has detected physical motion of the electronic device.Movement of the electronic device or camera, as detected by the motion-sensing circuitry.
Prediction error
(Claim 1, Claim 7, Claim 14, Claim 20, Claim 26)
However, the predicted frames are unlikely to perfectly predict the actual video frame to be encoded. A difference between the original, uncompressed video frame to be encoded and the predicted frame may be referred to as prediction error. This prediction error may carry additional spatial details about the predicted frame. By applying a spatial transform to the prediction error, a corresponding decoder may obtain coefficients carrying spatial detail not present in the predicted frame.A difference between the original, uncompressed video frame to be encoded and the predicted frame.
Quantization parameter
(Claim 1, Claim 7, Claim 20, Claim 26)
Based on a desired video compression bit rate and a desired quality for a given frame, the encoder may apply a quantization parameter (QP) during the encoding process to the prediction error. The QP may represent one of a finite number of step sizes for use in transforming the prediction error. With a larger value of QP, the transformation may result in a video signal having a smaller number of bits. However, the video signal may produce a distorted image if the source video frame is particularly complex.A value representing one of a finite number of step sizes used in transforming the prediction error during video encoding.
Uncompressed video frame
(Claim 1, Claim 7, Claim 14, Claim 20, Claim 26)
The image capture circuitry may capture an uncompressed video frame, and the motion-sensing circuitry may detect physical motion of the electronic device. The data processing circuitry may encode the uncompressed video frame based at least in part on a quantization parameter, which the data processing circuitry may determine based at least in part on whether the motion-sensing circuitry has detected physical motion of the electronic device.A video frame that has not yet been subjected to compression techniques to reduce its size.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
3:23-cv-00673Apr 14, 2023Clear Imaging Reasearch, LLC v. Apple Inc.

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US9300969

Application Number
US12556363A
Filing Date
Sep 9, 2009
Publication Date
Mar 29, 2016
External Links
Slate, USPTO, Google Patents