Sensor Layout For Autonomous Vehicles

Patent No. US12231783 (titled "Sensor Layout For Autonomous Vehicles") was filed by Tusimple Inc on Aug 3, 2023.

What is this patent about?

’783 is related to the field of autonomous vehicle technology, specifically addressing the challenge of achieving robust environmental perception. Existing autonomous systems often struggle with accurately and reliably interpreting their surroundings due to limitations in sensor placement and configuration, leading to potential safety hazards and suboptimal decision-making. The patent aims to overcome these limitations by proposing an optimized sensor layout that enhances the vehicle's ability to perceive its environment.

The underlying idea behind ’783 is to strategically position multiple cameras with varying focal lengths around an autonomous vehicle to create a comprehensive and redundant sensing system. By using cameras with different focal lengths, the system can capture both wide-angle views for situational awareness and narrow-angle views for detailed object recognition at a distance. This multi-focal approach allows the vehicle to effectively perceive objects at varying distances and scales, improving its overall perception capabilities.

The claims of ’783 focus on a system comprising a set of forward-facing cameras with different focal lengths, along with two backward-facing cameras having the same focal length. One of the forward-facing cameras shares the same focal length as the backward-facing cameras. The claims also specify that the focal length of the backward-facing cameras is no greater than the focal length of at least one of the forward-facing cameras. This configuration aims to provide a balanced view of the environment surrounding the vehicle.

In practice, the system would involve mounting multiple cameras on the vehicle, potentially on a roof rack or other suitable locations. The forward-facing cameras, with their varying focal lengths, would provide overlapping fields of view, ensuring that objects are captured by multiple cameras. The backward-facing cameras, with their identical focal lengths, would provide a consistent view of the area behind the vehicle. The data from these cameras would then be processed by an onboard computer to create a comprehensive model of the vehicle's surroundings.

This approach differentiates itself from prior solutions by combining multiple cameras with different focal lengths to achieve a more complete and robust perception system. While existing systems may use multiple cameras, they often lack the diversity in focal lengths necessary to effectively perceive objects at varying distances and scales. The redundancy provided by the overlapping fields of view also enhances the system's robustness to sensor failures or occlusions. The use of identical focal lengths for the backward-facing cameras simplifies processing while providing adequate rear coverage. The combination of these features results in a more reliable and accurate perception system for autonomous vehicles, especially large vehicles like semi-trailer trucks .

How does this patent fit in bigger picture?

Technical landscape at the time

In the late 2010s when ’783 was filed, autonomous vehicle technology was at a time when systems commonly relied on a combination of sensors, including cameras, radar, and lidar, to perceive the surrounding environment. At a time when sensor fusion algorithms were becoming more sophisticated to integrate data from these diverse sources, and when hardware or software constraints made real-time processing of high-volume sensor data non-trivial.

Novelty and Inventive Step

The examiner approved the patent because the applicant amended the claims to include a unique combination of forward and backward-facing cameras with specific focal length relationships. Specifically, the claims require a second backward-facing camera with a focal length matching that of one of the forward-facing cameras, a feature not found or suggested in the prior art cited by the examiner.

Claims

This patent contains 20 claims, with independent claims 1 and 10. The independent claims focus on a system comprising multiple cameras with specific focal length configurations on a vehicle. The dependent claims generally elaborate on the specific configurations, features, and additional components of the system described in the independent claims.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Backward-facing camera
(Claim 1, Claim 10)
“Disclosed are devices and systems for an optimized sensor layout for an autonomous or semi-autonomous vehicle. In one aspect, the system includes a vehicle capable of semi-autonomous or autonomous operation. A plurality of forward-facing cameras is coupled to the vehicle and configured to have a field of view in front of the vehicle. At least three forward-facing cameras of the plurality of forward-facing cameras have different focal lengths. A right-side camera is coupled to the right side of the vehicle, and the right-side camera configured to have a field of view to the right of the vehicle. A left-side camera is coupled to a left side of the vehicle, and the left-side camera is configured to have a field of view to the left of the vehicle.”A camera positioned on the vehicle to capture images or video of the area behind the vehicle.
Field of view
(Claim 1, Claim 10)
“In one aspect, the system includes a vehicle capable of semi-autonomous or autonomous operation. A plurality of forward-facing cameras is coupled to the vehicle and configured to have a field of view in front of the vehicle. A right-side camera is coupled to the right side of the vehicle, and the right-side camera configured to have a field of view to the right of the vehicle. A left-side camera is coupled to a left side of the vehicle, and the left-side camera is configured to have a field of view to the left of the vehicle.”The extent of the observable world that is seen at any given moment by a camera.
Focal length
(Claim 1, Claim 10)
“In one aspect, the system includes a vehicle capable of semi-autonomous or autonomous operation. A plurality of forward-facing cameras is coupled to the vehicle and configured to have a field of view in front of the vehicle. At least three forward-facing cameras of the plurality of forward-facing cameras have different focal lengths. A right-side camera is coupled to the right side of the vehicle, and the right-side camera configured to have a field of view to the right of the vehicle. A left-side camera is coupled to a left side of the vehicle, and the left-side camera is configured to have a field of view to the left of the vehicle.”A property of a camera lens that determines the angle of view and magnification.
Forward-facing cameras
(Claim 1, Claim 10)
“In autonomous driving systems, the successful perception of the surrounding driving environment is crucial for making correct and safe decisions for a host vehicle. Multiple sensors are typically used to successfully perceive the surrounding environment utilizes. The sensors provide accurate, stable, and timely data to downstream algorithm modules. The layout and configuration of the sensors must balance providing this critical data to the algorithm modules without overwhelming the algorithm modules with excessive or redundant information.”Cameras positioned on a vehicle to capture images or video of the area in front of the vehicle.

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Date

    Description

  • Get instant alerts for new documents

US12231783

TUSIMPLE INC
Application Number
US18364558
Filing Date
Aug 3, 2023
Status
Granted
Expiry Date
Sep 16, 2039
External Links
Slate, USPTO, Google Patents