Method and apparatus to correct digital image blur due to motion of subject or imaging device

Patent No. US8630484 (titled "Method and apparatus to correct digital image blur due to motion of subject or imaging device") on Nov 19, 2008. The application was issued on Jan 14, 2014.

What is this patent about?

’484 is related to the field of digital image processing, specifically addressing the problem of image blur caused by relative motion between a camera and its subject. Traditional photography often struggles with low-light conditions where slow shutter speeds are necessary, leading to motion-induced distortion. While mechanical stabilization exists, it often requires heavy and expensive lens components that can compromise optical quality.

The underlying idea behind ’484 is to replace or augment mechanical stabilization with a computational approach that reconstructs a sharp image from motion-affected data. The invention recognizes that blur is essentially a mathematical convolution of a true image with a two-dimensional transfer function representing the path of motion. By identifying this motion path—either through hardware sensors or software-based blind estimation—the system can apply an inverse operation to recover the original, undistorted scene.

The claims of ’484 focus on a method and apparatus for generating a corrected image by capturing a sequence of multiple fast-shutter images rather than a single long exposure. The system identifies a main subject within each frame of the sequence and computationally shifts these frames vertically and horizontally to align that specific subject at a consistent coordinate. These aligned frames are then merged pixel-by-pixel to produce a final two-dimensional photographic image where the subject appears sharp.

In practice, the invention functions by capturing several images back-to-back at the highest possible shutter speed to minimize the blur within any individual frame. Because these fast exposures are naturally darker and noisier, the system uses pixel-level alignment to stack the images, effectively summing the light data to achieve the exposure of a slow shutter speed without the associated motion smudge. This alignment can be driven by pattern recognition, a tracking signal from the subject, or manual user designation via a viewfinder.

This approach differs from prior art by moving the correction from the optical/mechanical domain into the digital processing domain. Instead of trying to keep the sensor perfectly still during a long exposure, the system allows for movement and corrects it by coherently combining multiple short-exposure snapshots. This allows for the recovery of a high signal-to-noise ratio while ensuring that a moving subject or a shaking camera does not result in a lost or unusable photograph.

How does this patent fit in bigger picture?

Technical Landscape

In the mid-2000s when ’484 was filed, digital image capture was typically implemented using CCD or CMOS sensors that recorded light impressions continuously for the duration of a shutter cycle. At a time when systems commonly relied on mechanical lens-based stabilization or simple post-capture sharpening filters, correcting for motion blur was often limited by the high cost and weight of moving optical elements or the data loss inherent in contrast-enhancement software. When hardware constraints made real-time calculation of complex spatial transforms non-trivial, most consumer-grade imaging devices lacked the integrated processing power to mathematically reverse the convolution of motion during the exposure period.

Prosecution Position

The disclosed invention represents a technical advancement through the architectural integration of motion sensing and digital deconvolution to recover original image data. By modeling the relative motion between an imaging device and a subject as a two-dimensional transfer function, the system enables the calculation of an inverse deconvolution filter that reverses the blurring effect at the pixel level. This architectural shift moves beyond mere sharpening—which typically discards data—to a restorative process that uses measured or estimated motion vectors to re-align light data. The capability enabled by this approach allows for the recovery of a true image even in low-light conditions or with moving subjects, overcoming the technical constraints of traditional mechanical stabilization and the quality limitations of standard post-processing.

Claims

This patent contains a total of 30 claims, with claims 1, 8, 15, 22, 23, 24, 25, 26, 27, 28, 29, and 30 serving as the independent claims. The independent claims focus on methods, apparatuses, and computing devices for generating a corrected two-dimensional photographic image by capturing a sequence of images, identifying a common main subject within those images, shifting the images to align the subject at a consistent location, and combining the pixel values of the aligned images. The dependent claims serve to specify technical implementations such as using high shutter speeds, employing pattern recognition or image segmentation for subject detection, utilizing tracking signals or user input to locate the subject, and defining pixel combination methods like adding or averaging values.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Corrected image
(Claim 1, Claim 8, Claim 15, Claim 22, Claim 23, Claim 24, Claim 25, Claim 26, Claim 27, Claim 28)
The invention processes image data in order to correct an image for distortion caused by imager movement or by movement of the subject being imaged. The invention uses the transfer function to combine consecutive images taken at a fast shutter speed to avoid blur due to motion between camera and subject that could result from using a slow shutter speed. The image is processed through the filter, wherein blur due to the motion is reversed, and the true image is recovered.A two-dimensional photographic image generated by processing and merging multiple captured frames to reverse or avoid the blurring effects of relative motion.
Main subject
(Claim 1, Claim 8, Claim 15, Claim 22, Claim 23, Claim 24, Claim 29, Claim 30)
As a way to align a designated subject, such as the car in this example, pattern recognition and segmentation algorithms may be used that are well known to those skilled in the art, and defined in current literature. Alternatively, a tracking signal that is transmitted from the subject can be used to convey its position. Alternatively, the user can indicate, such as by an indicator in a viewfinder, which object in the field of view is the designated subject to be kept blur-free.A specific object or designated portion of the field of view that is identified across multiple image frames to serve as the reference point for alignment and blur correction.
Recording medium
(Claim 1, Claim 8, Claim 22, Claim 23, Claim 25, Claim 26, Claim 27, Claim 28, Claim 29, Claim 30)
In digital cameras, the recording medium is typically a dense arrangement of light sensors, such as a Charge-Coupled Device (CCD) or a CMOS sensor. The recording medium continuously captures the impression of the light that falls upon it as long as the camera shutter is open. If the camera and the subject are moving with respect to each other, the recorded image becomes blurred.A physical component, such as a CCD or CMOS sensor, that captures light impressions continuously while a shutter is open to create digital image data.
Shifting
(Claim 1, Claim 8, Claim 15, Claim 22, Claim 23, Claim 24, Claim 25, Claim 26, Claim 27, Claim 28, Claim 29, Claim 30)
A fourth embodiment of the invention compensates for movement of the imager or the subject by adjusting the position of the image sensor during image capture, according to the inverse of the transfer function describing the imager or subject motion, or both. The invention determines a transfer function that represents the motion and corrects the blur. The recorded image is stored, at least temporarily, in memory elements forming a matrix of values.The act of adjusting the vertical and horizontal position of image data or an image sensor to compensate for detected relative motion.
Tracking signal
(Claim 25, Claim 26)
Alternatively, a tracking signal that is transmitted from the subject can be used to convey its position. This allows the system to align a designated subject to keep it blur-free.An electronic signal emitted by the subject of the photograph that communicates its spatial coordinates or position to the imaging device.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
2:25-cv-00240Feb 26, 2025Clear Imaging Research, LLC v. Lenovo Group Limited

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US8630484

Application Number
US12274057A
Filing Date
Nov 19, 2008
Publication Date
Jan 14, 2014
External Links
Slate, USPTO , Google Patents