IP Verse

Systems, Methods, And Techniques For Safely Controlling Devices Using Eye Gaze Control

Patent No. US12204687 (titled "Systems, Methods, And Techniques For Safely Controlling Devices Using Eye Gaze Control") was filed by Tolt Technologies Llc on Apr 11, 2023.

What is this patent about?

’687 is related to the field of assistive technology, specifically systems that allow individuals with limited mobility to control powered devices such as wheelchairs and beds. Traditional control methods rely on joysticks and buttons, which are inaccessible to people with conditions like amyotrophic lateral sclerosis (ALS) or muscular dystrophy. This patent addresses the need for an alternative control mechanism that leverages eye-gaze tracking to restore independence to these individuals.

The underlying idea behind ’687 is to use a person's eye movements to control actuators in a powered device. A display presents virtual buttons or targets within a defined area. An eye-tracking system monitors the user's gaze, and when the gaze dwells on a target for a specified duration, the corresponding actuator is activated. This allows the user to control movement and positioning of the device using only their eyes. A key element is the use of intentional gaze determination (IGD) algorithms to filter out unintentional eye movements and ensure safe and reliable control.

The claims of ’687 focus on a microcontroller-implemented method for controlling actuators in a powered device using eye gaze. The method involves presenting visual targets on a display, receiving data from an eye gaze sensor, determining if the user's gaze intersects a target, and activating the corresponding actuator after a delay. The claims also cover the reverse process: if the user's gaze leaves the attention area or the system loses track of the eyes, the actuator is deactivated after a delay. This provides a fail-safe mechanism to prevent unintended or continuous movement.

In practice, the system works by continuously monitoring the user's eye gaze. The eye-tracking camera captures the user's eye movements, and software algorithms determine the gaze vector and its intersection with the displayed targets. To avoid accidental activation, a dwell time is required before a target is considered 'selected'. This dwell time filters out involuntary eye movements like blinks or saccades. Once a target is activated, the corresponding actuator is engaged, causing the device to move or adjust its position.

The invention differentiates itself from prior approaches by using a combination of visual targets, eye gaze tracking, and intentional gaze determination algorithms. Unlike traditional joystick or button controls, this system allows individuals with limited motor skills to control powered devices. Furthermore, the system incorporates safety mechanisms, such as the deactivation delay and optional sensor integration, to prevent accidents and ensure safe operation. The system can also be enhanced with features like semi-latched mode , which allows for smoother control by maintaining actuation as long as the user's gaze remains within the attention area, even if not directly on a target.

How does this patent fit in bigger picture?

Technical landscape at the time

In the early 2020s when ’687 was filed, eye-tracking technology was at a time when systems commonly relied on specialized cameras and algorithms to determine gaze direction, and when hardware or software constraints made real-time, accurate gaze tracking for control applications non-trivial. At a time when X was typically implemented using Y, eye tracking was typically implemented using infrared cameras and computer vision algorithms running on embedded processors or dedicated hardware.

Novelty and Inventive Step

Claims 1-3, 5-6, 15-18, and 22-25 were rejected under 35 U.S.C. 103. Claims 4, 7-14, and 19-21 were objected to as being dependent upon a rejected base claim. This action is final.

Claims

This patent contains 25 claims, with independent claims 1, 15, and 25. The independent claims are directed to a method, a device, and a computer-readable medium, respectively, all relating to controlling a powered device using eye gaze interaction. The dependent claims generally elaborate on and refine the features and functionalities described in the independent claims.

Key Claim Terms New

Definitions of key terms used in the patent claims.

Term (Source)Support for SpecificationInterpretation
Activation delay timer
(Claim 1, Claim 15, Claim 25)		“Fixation, the pausing of the gaze vector on a visual target, for 100 milliseconds or more can indicate intention to act and removal of eye gaze from a target or attention area in excess of 333 milliseconds can be used to indicate intention to stop action.”A timer used to determine if a user intends to activate or maintain activation of a visual target based on the duration of their gaze.
Attention area
(Claim 1, Claim 15, Claim 25)		“The EGACS uses a combination of visual targets (e.g., user interface elements) in an attention area, an eye gaze camera which measures a location in the attention area where the person is looking, and a set of intentional gaze determination (“IGD”) algorithms that removes involuntary, distracted, or ephemeral data from the inputted information. Attention areas and visual targets are described further with respect to FIGS. 12 and 13.”A designated area of a display or projection, representing a subset of the user's field of view, where visual targets are presented for eye gaze interaction.
Eye gaze sensor
(Claim 1, Claim 15, Claim 25)		“That application describes a powered wheelchair equipped with a tablet computer mounted in front of the wheelchair occupant and connected to the control system of the powered wheelchair. The tablet computer has a camera on it which views the person's eyes (an “eye gaze camera”) and then uses well known algorithms (e.g., executing on a microcontroller) to determine where the person is looking on the screen. In some cases, the eye gaze camera is a discrete device and in other cases the eye gaze camera is integrated into the chassis of the display.”A sensor that captures eye position to determine occupant intent to select virtual user interface controls.
Eye gaze vector
(Claim 1, Claim 15, Claim 25)		“Fixation, the pausing of the gaze vector on a visual target, for 100 milliseconds or more can indicate intention to act and removal of eye gaze from a target or attention area in excess of 333 milliseconds can be used to indicate intention to stop action. When not in semi-latched mode, and when the gaze vector intersects this diagonal cross-hatched area 1305 (e.g., not intersecting a visual target), the EGACS application will begin the process of deactivating any previously activated target”A vector indicating the direction of a user's gaze, determined from data received from the eye gaze sensor.
Visual targets
(Claim 1, Claim 15, Claim 25)		“In brief, the tablet is executing a software/firmware application which presents user interface controls/elements such as virtual buttons which actuate (e.g., are selected/clicked) when the person looks at the button continuously for a period of time. As the person continues to look at the button, it becomes ‘pressed’ to allow the person to select the duration of control and therefore the amount of position change. The EGACS uses a combination of visual targets (e.g., user interface elements) in an attention area, an eye gaze camera which measures a location in the attention area where the person is looking, and a set of intentional gaze determination (“IGD”) algorithms that removes involuntary, distracted, or ephemeral data from the inputted information.”User interface controls presented on a display or projection that can be selected via eye gaze.

Patent Family

Patent Family

File Wrapper

The dossier documents provide a comprehensive record of the patent's prosecution history - including filings, correspondence, and decisions made by patent offices - and are crucial for understanding the patent's legal journey and any challenges it may have faced during examination.

  • Date

    Description

  • Get instant alerts for new documents

US12204687

TOLT TECHNOLOGIES LLC
Application Number
US18133177
Filing Date
Apr 11, 2023
Status
Granted
Expiry Date
Apr 11, 2043
External Links
Slate, USPTO, Google Patents