Picture processing apparatus and picture processing method

Patent No. US7046302 (titled "Picture processing apparatus and picture processing method") on Aug 3, 2001. The application was issued on May 16, 2006.

What is this patent about?

’302 is related to the field of video signal processing and display management, specifically for television receivers capable of simultaneous multi-picture or reduced-picture layouts. In modern broadcasting, video signals often arrive in formats that do not match the display's aspect ratio, leading to the inclusion of black bars—known as letterboxing for vertical padding or side-paneling for horizontal padding—which consume valuable screen real estate and shrink the actual content.

The underlying idea behind ’302 is to dynamically identify and strip away non-picture padding from a video signal before it is scaled and composited into a multi-window display. By isolating only the effective picture area, the system ensures that when multiple sources are shown side-by-side, the actual content is maximized in size rather than being unnecessarily shrunk by the black borders inherent in the source signal's original format.

The claims of ’302 focus on a picture processing apparatus that utilizes a multi-modal determining section to identify the presence of peripheral non-picture portions. This section is specifically claimed to include an ID detecting portion for format identification, an additional information detector for superimposed metadata, and a non-signal detecting portion that analyzes the signal level against a threshold to physically locate the boundaries of the active video content.

In practice, the invention functions by routing selected video sources through a processor that compares the detected content boundaries against the total signal frame. If a letterbox or side-panel format is detected, the system extracts only the active pixels and writes them to a picture memory. This allows the scaling engine to interpolate or thin out only the relevant visual data, ensuring that the resulting image occupies the full allocated window on the screen without wasteful black borders.

This approach differs from prior solutions that treated the entire incoming signal frame as the display object, which resulted in tiny, poorly utilized windows when viewing formatted content. By integrating signal-level analysis with metadata detection, the invention provides a robust way to distinguish between intentional black content and structural padding, thereby optimizing screen utilization efficiency for complex layouts like picture-in-picture or text-heavy on-screen displays.

How does this patent fit in bigger picture?

Technical Landscape

In the early 2000s when ’302 was filed, television receivers were transitioning between standard and wide aspect ratios, at a time when multiple-picture display was typically implemented using fixed-ratio thinning or interpolation of the entire incoming signal. When systems commonly relied on uniform memory writing and reading for all incoming video frames rather than selective extraction of active content, hardware constraints made the dynamic identification of effective picture areas non-trivial. During this era, processing architectures generally treated the entire signal—including non-picture portions like side panels or letterbox bars—as a single monolithic data block, which often led to inefficient screen utilization and the unintended reduction of visible content when multiple sources were displayed simultaneously.

Prosecution Position

The disclosed invention addresses the technical problem of inefficient screen utilization and the reduction of visible picture size when displaying multiple video sources that contain non-picture regions, such as letterbox or side panel formats. The architectural shift involves integrating a determination means to identify these non-picture portions and a processing means that selectively extracts only the effective picture area for size adjustment and combination. This structural solution enables the capability to maximize the display area of the active video content while preventing the processing of wasteful non-picture data. The resulting technical effect is a more efficient use of the display screen and memory resources, ensuring that the visible portion of a video signal remains as large as possible during multi-picture or reduced-picture display modes.

Claims

The patent contains a total of 2 claims, with claim 1 serving as the sole independent claim. This independent claim focuses on a picture processing apparatus designed to select, identify, and combine multiple video signals by detecting non-picture peripheral areas through format identification, additional information detection, and signal level comparison to extract and resize effective picture areas for display. The dependent claim serves to further specify the operational methods of the picture processor, particularly regarding the timing of signal interpolation used to adjust image sizes and combine the various video sources on the screen.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Additional information detecting portion
(Claim 1)
For example, when an input video signal is an EDTV signal, since it is a letter box signal, a process for converting the number of lines is performed so as to display the picture on the entire screen. The microprocessor determines whether each of the selected video signals is a side panel signal, a letter box signal, or a full line signal.A component configured to detect data superimposed on the video signal, such as EDTV signals, which indicates whether the signal is a letter box or side panel format.
Effective picture area
(Claim 1)
When an input video signal is a side panel signal or a letter box signal, only a video signal of the effective picture area is extracted and read from a picture memory and displayed on the screen. The picture memory has a memory space composed of horizontal addresses xa to xb and vertical addresses ya to yb for one screen of an input video signal. When an input video signal is a side panel signal, the effective picture area is composed of horizontal addresses xc to xd and vertical addresses ya to yb.The portion of a video signal containing the actual image content, excluding any added non-signal or black borders used for format matching.
ID detecting portion
(Claim 1)
The three types of video signals differ in the number of effective pixels. The number of effective pixels of the first type is (720x480), the second type is (1280x720), and the third type is (1920x1080). In the first format the angle of view is (4:3) that is a standard screen, while in the second and third formats the angle of view is (16:9) that is a wide screen.A component that identifies the specific format of an input video signal (e.g., 720x480, 1280x720, or 1920x1080) to determine its aspect ratio and the presence of non-picture portions.
Non-picture portion
(Claim 1)
In the side panel signal, the aspect ratio of the effective picture area is (4:3) and black non-picture portions are added to the left and right thereof so that the angle of view becomes 16:9. In the letter box signal, the aspect ratio of the effective picture area is (16:9) and black non-picture portions are added to the top and bottom thereof so that the angle of view becomes 4:3. Since a side panel signal and a letter box signal contain non-picture portions, a displaying process is performed for the non-picture portions if not extracted.A black or blank area added to the periphery of an active video signal, such as the side bars in a side panel signal or the top and bottom bars in a letter box signal, to adapt the signal to a specific aspect ratio or angle of view.
Non-signal detecting portion
(Claim 1)
The non-signal detecting portion is configured to compare an overall level of each of the plurality of input video signals of the plurality of sources with a predetermined level. This allows the system to determine whether or not an input video signal is a signal of which a non-picture portion is added to the periphery of an effective picture area.A component that evaluates the signal levels of the input video to identify non-picture areas by comparing them against a predetermined threshold, such as detecting black levels.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
5:25-cv-00052Apr 21, 2025Maxell, Ltd. V. Samsung Electronics Co., Ltd.

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Get instant alerts for new documents

US7046302

Application Number
US09920765A
Filing Date
Aug 3, 2001
Publication Date
May 16, 2006
External Links
Slate, USPTO , Google Patents