Method and apparatus for capturing stabilized video in an imaging device

Patent No. US10382689 (titled "Method and apparatus for capturing stabilized video in an imaging device") on Dec 27, 2018. The application was issued on Aug 13, 2019.

What is this patent about?

'689 is related to the field of digital image processing, specifically addressing the problem of image distortion caused by relative motion between the camera and the subject during image capture. Traditional methods for correcting blurred images often involve increasing sharpness or contrast, which can lead to data loss and alter the image's nature. Existing electro-mechanical image stabilization systems add significant cost, weight, and complexity to lenses.

The underlying idea behind '689 is to compensate for image blur by calculating and applying an inverse transfer function that represents the motion-induced distortion. This transfer function describes how the image 'travels' across the recording medium during capture. By inverting this function and applying it as a deconvolution filter, the blurring effect can be reversed, effectively recovering the original, undistorted image.

The claims of '689 focus on an imaging apparatus and a method for capturing stabilized digital video. The apparatus includes a user interface, an image sensor, motion sensors, a lens with a movable element, and a video image processor. The processor calculates shift amounts based on motion data, modifies the image sequence, and combines the modified images to create a stabilized video, which is then stored in memory. The method mirrors these steps, emphasizing the process of capturing and stabilizing video using motion-compensated image adjustments.

In practice, the invention uses motion sensors to detect and record the camera's movement while capturing video. This motion data is then used to derive the transfer function, which is subsequently inverted to create a deconvolution filter. This filter is applied to the captured video frames, shifting and combining them to counteract the blur caused by the camera's movement. The result is a stabilized video output, effectively removing the unwanted motion artifacts.

The invention differentiates itself from prior approaches by directly addressing the root cause of motion blur through real-time motion compensation. Unlike traditional image sharpening techniques that merely enhance the appearance of sharpness, this invention aims to reconstruct the original image by undoing the effects of motion. Furthermore, it offers an alternative to bulky and expensive electro-mechanical stabilization systems by leveraging digital signal processing techniques and motion-sensing technology to achieve image stabilization.

How does this patent fit in bigger picture?

Technical Landscape

In the mid-2000s when ’689 was filed, digital image capture was becoming standard at a time when motion blur was typically addressed through mechanical lens stabilization or by simply increasing shutter speeds. When systems commonly relied on physical vibration reduction hardware, software-based correction often resulted in significant data loss or artificial sharpening rather than true reconstruction of the original image. Hardware and software constraints of the era made the real-time calculation and inversion of complex two-dimensional transfer functions non-trivial, particularly when attempting to distinguish between camera shake and the independent motion of a subject within the frame.

Prosecution Position

The examiner allowed the application because the prior art failed to teach a specific method for stabilizing digital video using a combination of internal hardware and motion-based processing. While previous systems could combine image frames based on displacement, they did not specifically utilize an image sensor to capture a sequence of video images in conjunction with motion sensors that generate data representing the device's movement during capture. Furthermore, the prior art did not suggest a processor configured to use that specific motion sensor data to calculate shift amounts for the video sequence, modify the images based on those shifts, and then combine them to produce a stabilized video output.

Claims

This patent contains 30 claims, with independent claims 1 and 16. Independent claim 1 focuses on an imaging apparatus that captures stabilized digital video, while independent claim 16 focuses on a method of capturing stabilized digital video in an imaging device. The dependent claims generally elaborate on and refine the specifics of the apparatus and method described in the independent claims, adding details regarding lens movement, shift amounts, and image modification.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Motion sensors
(Claim 1, Claim 16)
One embodiment of the present invention includes one or more motion sensors, attached to or included within the imager body, the lens, or otherwise configured to sense any motion of the imager while an image is being captured, and to record this information. Such sensors are currently commercially available which are able to capture movement in a single dimension, and progress is being made to improve their accuracy, cost, and characteristics.One or more sensors that detect motion of the imaging apparatus during video capture and generate motion data representing this motion.
Movable lens element
(Claim 1, Claim 16)
In the prior art, electro-mechanical devices for correcting image blur due to camera motion are built into some high quality lenses, variously called “image stabilization”, “vibration reduction”, or similar names by camera/lens manufacturers. These devices seek to compensate for the camera/lens movement by moving one or more of the lens elements; hence countering the effect of the motion.At least one lens element within the lens that can be moved relative to the imaging apparatus.
Shift amounts
(Claim 1, Claim 16)
When an image is initially captured, the effect of relative motion between the imaging device and the subject is that it transforms the “true image” into a blurred image, according to a 2-dimensional transfer function defined by the motion. The invention determines a transfer function that represents the motion and corrects the blur.Values calculated based on motion data, used to modify the sequence of images to compensate for motion.
Stabilized video
(Claim 1, Claim 16)
The present invention processes image data in order to correct an image for distortion caused by imager movement or by movement of the subject being imaged. In another embodiment, the present invention can prevent image distortion due to motion of the imaging device or subject at relatively slow shutter speeds, resulting in a substantially undistorted image.A video sequence that has been processed to reduce or eliminate the effects of motion during capture.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
3:23-cv-00673Apr 14, 2023Clear Imaging Reasearch, LLC v. Apple Inc.

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US10382689

Application Number
US16233914A
Filing Date
Dec 27, 2018
Publication Date
Aug 13, 2019
External Links
Slate, USPTO, Google Patents