Probabilistic Neural Network For Predicting Hidden Context Of Traffic Entities For Autonomous Vehicles

Patent No. US11467579 (titled "Probabilistic Neural Network For Predicting Hidden Context Of Traffic Entities For Autonomous Vehicles") was filed by Piccadilly Patent Funding Llc As Security Holder on Feb 6, 2020.

What is this patent about?

’579 is related to the field of autonomous vehicle navigation and, more specifically, to systems that improve autonomous navigation by predicting the behavior of other traffic participants. Current autonomous systems often struggle to accurately predict the actions of pedestrians or cyclists, leading to erratic vehicle behavior. The patent addresses this problem by incorporating a prediction of the 'hidden context' of other traffic entities, such as their intentions or awareness of the autonomous vehicle.

The underlying idea behind ’579 is to use a probabilistic neural network to infer the hidden context of traffic entities from camera images and to use the uncertainty of this inference to guide the autonomous vehicle's navigation. The neural network is trained using data from human observers who have viewed similar traffic scenarios and provided their assessments of the likely behavior of the traffic entities. This allows the autonomous vehicle to make more human-like judgments about the intentions of other road users.

The claims of ’579 focus on a method, a storage medium, and a computer system for training and executing a probabilistic neural network to predict the hidden context of traffic entities. The independent claims cover receiving an image of traffic, generating a feature vector with statistical distributions, generating an output representing the hidden context (as likelihoods of user responses), determining a measure of uncertainty for these likelihoods, and navigating the autonomous vehicle based on this uncertainty.

In practice, the system captures images of traffic using a camera mounted on the autonomous vehicle. The probabilistic neural network processes these images to estimate the hidden context of nearby pedestrians, cyclists, or other vehicles. For example, the system might predict the likelihood that a pedestrian intends to cross the street and how confident it is in that prediction. The uncertainty measure is crucial because it allows the autonomous vehicle to adjust its behavior based on the reliability of the prediction. A high uncertainty might lead to a more cautious approach, while a low uncertainty allows for more assertive navigation.

The key differentiation from prior approaches lies in the use of a probabilistic neural network and the explicit consideration of uncertainty. Traditional systems often rely on kinematic models that extrapolate future motion based on current movement, which can be unreliable for predicting human behavior. By incorporating human judgment and quantifying the uncertainty in its predictions, ’579 enables the autonomous vehicle to make more robust and human-like navigation decisions , especially in complex and unpredictable traffic scenarios. The system generates a statistical distribution of possible outcomes, rather than a single point estimate, allowing for a more nuanced and safer navigation strategy.

How does this patent fit in bigger picture?

Technical landscape at the time

In the late 2010s when ’579 was filed, autonomous vehicle systems commonly relied on sensor data fusion and rule-based algorithms for navigation at a time when machine learning techniques were increasingly being explored to improve perception and decision-making. At that time, predicting the intent of pedestrians and other traffic participants was typically implemented using kinematic models and heuristics, when hardware and software constraints made real-time probabilistic reasoning about human behavior non-trivial.

Novelty and Inventive Step

The examiner approved the application because the prior art failed to teach or suggest generating an output representing hidden context for a traffic entity. This output includes multiple values, each indicating the likelihood of a specific user response when presented with an image. Furthermore, the prior art did not disclose determining a measure of uncertainty for each of these values and using this uncertainty measure to navigate an autonomous vehicle to avoid the traffic entity.

Claims

This patent contains 20 claims, with independent claims 1, 13, and 20. The independent claims are directed to a method, a non-transitory computer readable storage medium, and a computer system, all generally focused on navigating autonomous vehicles using a probabilistic neural network to interpret traffic images and associated uncertainties. The dependent claims generally elaborate on specific aspects and features of the method and system described in the independent claims, such as the statistical distributions, training methods, uncertainty measures, and navigation strategies.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Hidden context
(Claim 1, Claim 13, Claim 20)
“The hidden context of a traffic entity represents behavior of the traffic entities in the traffic. The hidden context may represent a state of mind of a user represented by the traffic entity. The hidden context may represent a task that a user represented by the traffic entity is planning on accomplishing. The hidden context may represent a goal of a user represented by the traffic entity, wherein the user expects to achieve the goal within a threshold time interval.”Behavior of the traffic entities in the traffic. It may represent a state of mind of a user represented by the traffic entity, a task that a user represented by the traffic entity is planning on accomplishing, or a goal of a user represented by the traffic entity, wherein the user expects to achieve the goal within a threshold time interval.
Measure of uncertainty
(Claim 1, Claim 13, Claim 20)
“The system determines a measure of uncertainty for each of the plurality of values. In an embodiment, the vehicle computing system 122 determines the measure of uncertainty as a confidence interval for a predicted output 132. At inference time (i.e., execution time) for the neural network 120, the vehicle computing system 122 executes the neural network 120 to generate multiple samples per output value.”A value representing a degree of uncertainty for each of the plurality of values, where each value represents a likelihood of receiving a particular user response from a user presented with the image.
Probabilistic neural network
(Claim 1, Claim 13, Claim 20)
“Embodiments of the invention use probabilistic neural networks to predict hidden context attributes associated with traffic entities. The system trains a probabilistic neural network for help in navigating through traffic. The probabilistic neural network is configured to receive an image of traffic as input and generate output representing hidden context for a traffic entity displayed in the image. The probabilistic neural network generates a feature vector for a plurality of features. The feature vector comprises values describing statistical distribution for each feature.”A neural network that receives an image of traffic as input and generates output representing hidden context for a traffic entity displayed in the image. The network generates a feature vector for a plurality of features, where the feature vector comprises values describing statistical distribution for each feature.
Statistical distribution
(Claim 1, Claim 13, Claim 20)
“In an embodiment, the values describing statistical distribution for each feature comprise a mean value and a standard deviation for the feature. The probabilistic neural network is configured to generate samples of features that correspond to their respective distributions. These samples are used to generate different outputs. The distribution of the generated outputs is used to determine a measure of uncertainty of the outputs.”Values describing statistical distribution for each feature comprise a mean value and a standard deviation for the feature.
Traffic entity
(Claim 1, Claim 13, Claim 20)
“A traffic entity may represent a pedestrian, a bicyclist, or another vehicle in a traffic encountered by a vehicle. Examples of traffic entities include pedestrians, bicyclists, or other vehicles. Examples of hidden context include, awareness of a bicyclist that a particular vehicle is driving close to the bicyclist, and intent of a pedestrian, for example, intent to cross a street, intent to continue walking along a sidewalk, and so on.”A pedestrian, a bicyclist, or another vehicle in a traffic encountered by a vehicle.

Litigation Cases New

US Latest litigation cases involving this patent.

Case NumberFiling DateTitle
2:25-cv-00742Jul 23, 2025Perceptive Automata Llc V. Tesla, Inc.

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Date

    Description

  • Get instant alerts for new documents

US11467579

PICCADILLY PATENT FUNDING LLC AS SECURITY HOLDER
Application Number
US16783845
Filing Date
Feb 6, 2020
Status
Granted
Expiry Date
Dec 1, 2040
External Links
Slate, USPTO, Google Patents