Method and apparatus to correct digital image blur by combining multiple images

Patent No. US9013587 (titled "Method and apparatus to correct digital image blur by combining multiple images") on Nov 4, 2014. The application was issued on Apr 21, 2015.

What is this patent about?

’587 is related to the field of digital image processing, specifically addressing the problem of image blur. In traditional photography, relative motion between the camera and the subject during a long exposure results in a smudged representation of light across the sensor. While hardware-based stabilization and software-based sharpening exist, they often introduce weight, cost, or data loss, failing to truly recover the original, sharp image data lost during the motion event.

The underlying idea behind ’587 is to replace a single, long-exposure capture with a sequence of rapid-fire, high-speed captures that are intelligently reconstructed. By operating the sensor at its maximum shutter speed to take multiple back-to-back images, the system ensures that each individual frame is sharp and free of motion displacement. These frames are then mathematically aligned and merged to synthesize the equivalent of a long exposure, maintaining high signal quality without the associated motion artifacts.

The claims of ’587 focus on a specific workflow for subject-based stabilization involving a viewfinder and a processor. The method requires displaying a live image, designating a main subject within that field of view—either automatically by a processor or via user input—and capturing a plurality of images containing that subject. The system then generates a corrected image by calculating new pixel values based on the corresponding image points across the entire captured sequence.

In practice, the invention functions by treating the designated subject as the anchor for the reconstruction process. Once the subject is identified, the processor aligns the multiple high-speed frames so that the subject remains stationary across the stack, even if the camera or the subject moved during the sequence. By combining these aligned pixels, the system performs a coherent addition of image data, which effectively boosts the signal-to-noise ratio and overcomes the low-light limitations typically associated with fast shutter speeds.

This approach differs from prior solutions by moving away from mechanical lens compensation or destructive post-capture sharpening. Instead of trying to prevent motion physically, it embraces the motion and uses temporal oversampling to reconstruct a sharp result. By focusing the alignment on a specific designated subject, the invention allows for selective stabilization, ensuring that the most important part of the composition remains crisp even when the surrounding environment or the photographer is in motion.

How does this patent fit in bigger picture?

Technical Landscape

In the mid-2000s when ’587 was filed, digital imaging systems were increasingly replacing analog film, yet they remained constrained by the physical limitations of optical assemblies and the computational overhead of real-time image processing. At a time when image stabilization was typically implemented using expensive electro-mechanical lens-shift systems, consumer-grade devices commonly relied on simple software-based contrast enhancement or sharpening filters rather than true deconvolution to address motion blur. During this era, hardware constraints made the real-time calculation of complex two-dimensional transfer functions non-trivial, often forcing a trade-off between shutter speed and image noise in low-light conditions.

Prosecution Position

The disclosed invention represents a technical advancement in digital image restoration through an architectural shift from mechanical stabilization to a computational deconvolution framework. By utilizing motion sensors to derive a two-dimensional transfer function that mathematically represents the relative movement between the imager and the subject, the system enables the recovery of a true image from a blurred recording. This integration of real-time motion sensing with a deconvolution filter overcomes the technical constraint of data loss inherent in traditional sharpening techniques, allowing for the correction of motion blur without the weight and cost of moving optical elements. The solution achieves a technical effect of reversing the smudging of light across a sensor by inverting the motion-defined transfer function to recover original image data.

Claims

This patent contains a total of 30 claims, with claims 1, 8, 15, and 23 serving as the independent claims. The independent claims focus on a method and apparatus for generating a corrected image by displaying a scene in a viewfinder, designating a main subject through either processor automation or user input, capturing multiple images containing that subject, and combining those images by calculating pixel values for the main subject's image points. The dependent claims serve to provide specific technical implementations, such as using image segmentation for subject identification, aligning images through shifting, processing sequential frames, and extending pixel value calculations to areas outside the main subject.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Combining the plurality of photographic images
(Claim 1, Claim 8, Claim 15, Claim 23)
In yet another embodiment, the invention uses the transfer function to combine consecutive images taken at a fast shutter speed to avoid blur due to motion between camera and subject that could result from using a slow shutter speed.A process of merging multiple consecutive images taken at high shutter speeds to produce a single image that avoids the blur associated with slower shutter speeds.
Corrected image
(Claim 1, Claim 8, Claim 15, Claim 23)
The invention determines a transfer function that represents the motion and corrects the blur. The image is processed through the filter, wherein blur due to the motion is reversed, and the true image is recovered.A substantially undistorted image generated by reversing the effects of motion blur or by combining multiple fast-shutter captures to recover the true image.
Main subject
(Claim 1, Claim 8, Claim 15, Claim 23)
As a way to align a designated subject, such as the car in this example, pattern recognition and segmentation algorithms may be used. Alternatively, the user can indicate, such as by an indicator in a viewfinder, which object in the field of view is the designated subject to be kept blur-free.A specific object or area within the field of view designated to be kept blur-free or aligned during image processing, distinct from the background.
Pixel value
(Claim 1, Claim 8, Claim 15, Claim 23)
The recorded image is stored, at least temporarily, in memory elements forming a matrix of values. In a 2-dimensional space with discrete coordinate indices ‘n’ and ‘m’, the undistorted image of the subject can be represented by s(n,m).A discrete value within a matrix representing the recorded image data at specific coordinate indices used for mathematical operations like convolution or deconvolution.
Recording medium
(Claim 1, Claim 8, Claim 15, Claim 23)
In digital cameras, the recording medium is typically a dense arrangement of light sensors, such as a Charge-Coupled Device (CCD) or a CMOS sensor. The recording medium continuously captures the impression of the light that falls upon it as long as the camera shutter is open.A light-sensitive component, such as a CCD or CMOS sensor, that captures and records the impression of light falling upon it while the shutter is open.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
2:25-cv-00240Feb 26, 2025Clear Imaging Research, LLC v. Lenovo Group Limited

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US9013587

Application Number
US14532654A
Filing Date
Nov 4, 2014
Publication Date
Apr 21, 2015
External Links
Slate, USPTO , Google Patents