Method and apparatus to correct blur in all or part of a digital image by combining plurality of images

Patent No. US10171740 (titled "Method and apparatus to correct blur in all or part of a digital image by combining plurality of images") on Sep 25, 2017. The application was issued on Jan 1, 2019.

What is this patent about?

’740 is related to the field of digital image processing, specifically addressing the problem of motion blur. In traditional photography, relative movement between the camera and the subject during a long exposure results in a smudged or blurred image. This is particularly problematic in low-light conditions where slow shutter speeds are required to gather enough light for a usable exposure.

The underlying idea behind ’740 is to replace a single long exposure with a sequence of high-speed captures that are intelligently aligned and merged. By using a fast shutter speed for each individual frame, the system freezes motion to prevent blur within those frames. These sharp but potentially underexposed images are then computationally stacked to achieve the light-gathering benefits of a long exposure without the associated motion artifacts.

The claims of ’740 focus on a method and device that allow for selective blur correction based on a designated subject. The system identifies a specific object within a preview image—either automatically or via user input—and processes a plurality of captured images to ensure that this primary subject remains sharp in the final output. This is achieved by aligning the frames specifically to the movement of that subject, even if it results in the rest of the scene remaining blurred.

In practice, the invention functions by capturing images back-to-back at the fastest possible shutter speed the hardware allows. A processor then performs pixel-by-pixel alignment, shifting each frame in the series to compensate for the measured or detected displacement of the target subject. When these aligned frames are summed or averaged, the signal-to-noise ratio improves significantly, effectively simulating a longer exposure while maintaining high edge definition for the tracked object.

This approach differs from prior solutions, such as mechanical image stabilization, which physically move lens elements or sensors to counter camera shake. While mechanical systems only compensate for the photographer's hand movements, this invention can correct for the independent motion of subjects within the frame. Furthermore, by allowing a user to toggle between different subjects for correction, the system provides a level of post-capture compositional control that traditional hardware-based stabilization cannot offer.

How does this patent fit in bigger picture?

Technical Landscape

In the mid-2000s when ’740 was filed, digital image capture was typically implemented using CCD or CMOS sensors that recorded light impressions continuously for the duration of a shutter cycle. At a time when systems commonly relied on mechanical shutter speeds to mitigate motion blur, hardware and software constraints made the recovery of high-frequency image data non-trivial once relative motion between the camera and subject had occurred. During this era, standard post-processing techniques were generally limited to contrast and sharpness adjustments that often resulted in permanent data loss rather than a reconstruction of the original scene, while mechanical stabilization was largely confined to expensive, heavy lens-based shifting elements.

Prosecution Position

The disclosed invention represents a technical advancement through an architectural shift from mechanical stabilization to digital deconvolution and sensor-level compensation. It addresses the problem of image degradation caused by uniform relative motion by modeling the blur as a two-dimensional transfer function. The solution integrates motion sensors or blind estimation techniques to derive this function, which is then inverted to create a deconvolution filter that reverses the blurring effect. This integration enables the recovery of a true image from a smudged representation, overcoming the technical constraint of data loss inherent in traditional sharpening algorithms and providing a lighter, more cost-effective alternative to electro-mechanical lens stabilization.

Claims

The patent contains a total of 29 claims, with claims 1, 2, 10, and 20 being independent. These independent claims focus on methods and imaging devices designed to capture and combine multiple images to create a final output where a designated subject remains blur-free while other subjects or areas are blurred. The dependent claims serve to provide additional technical details regarding pixel value calculations, user interface indicators, image alignment techniques, the number of images processed, and the sequential timing of image capture.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Blur free
(Claim 1, Claim 10, Claim 20)
The present invention processes image data in order to correct an image for distortion caused by imager movement or by movement of the subject being imaged. The invention determines a transfer function that represents the motion and corrects the blur. The image is processed through the filter, wherein blur due to the motion is reversed, and the true image is recovered.A state where the designated subject in a processed image has been corrected for motion distortion, appearing sharp relative to other elements in the scene.
Blurred compared to the first subject
(Claim 1, Claim 10, Claim 20)
In another embodiment, the present invention can prevent image distortion due to motion of the imaging device or subject at relatively slow shutter speeds, resulting in a substantially undistorted image. For example, in the case of a photograph of a moving car, wherein an image of the car is blurred due to uniform motion of all parts of the car. The background is blurred.A condition where secondary objects in a combined image retain motion-induced distortion because the correction or alignment process was specifically optimized for a different designated subject.
Combine the plurality of images
(Claim 1, Claim 10, Claim 20)
In yet another embodiment, the invention uses the transfer function to combine consecutive images taken at a fast shutter speed to avoid blur due to motion between camera and subject that could result from using a slow shutter speed. The nature of the blur resulting from uniform relative motion can be expressed mathematically. If the transfer function h(n,m) is known, or its estimate is available, the blur that it represents can be “undone” or compensated for in a processor.The act of merging multiple image frames, typically captured at high shutter speeds, into a single composite image to mitigate motion blur while maintaining image quality.
Designating... the first subject
(Claim 1, Claim 10, Claim 20)
As a way to align a designated subject, such as the car in this example, pattern recognition and segmentation algorithms may be used. Alternatively, a tracking signal that is transmitted from the subject can be used to convey its position. Alternatively, the user can indicate, such as by an indicator in a viewfinder, which object in the field of view is the designated subject to be kept blur-free.The process of identifying or selecting a specific object or area within an image to be prioritized for motion compensation or blur removal.
Preview of a field of view
(Claim 1, Claim 10, Claim 20)
The user can indicate, such as by an indicator in a viewfinder, which object in the field of view is the designated subject to be kept blur-free. The recording medium continuously captures the impression of the light that falls upon it as long as the camera shutter is open.A real-time or near real-time visual representation of the scene currently visible to the imaging sensor before a final image is captured and stored.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
2:25-cv-00240Feb 26, 2025Clear Imaging Research, LLC v. Lenovo Group Limited
3:23-cv-00673Apr 14, 2023Clear Imaging Reasearch, LLC v. Apple Inc.

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US10171740

Application Number
US15714558A
Filing Date
Sep 25, 2017
Publication Date
Jan 1, 2019
External Links
Slate, USPTO , Google Patents