Introduction

Gaze Controlled Robotic Platform

The objective of the project is the creation of a sensor system able to determine the point of focus of a user's gaze, software capable of directing a robot towards that point, and a robot which is able to move to that location.

There are two main sensor systems being considered for this design. The first (referred to as the base design) consists of ordinary image processing (using OpenCV) where the computer processing the visual input will construct a model based upon a calibration pattern placed on the field. The transformation parameters will be stored so that the relative position of the robot and the target point, marked by an ordinary laser pointer, can be established from future image captures. With the relative locations known, the program will wirelessly transmit instructions to the robotic platform to direct it to the target point. Upon reaching the point, an LED on the robot will be illuminated to indicate the algorithm is finished.