Touch-Free Interaction for Public Terminals

Project Background

In the present era, public spaces play a major role in daily life especially in crowded areas like Hong Kong where maintaining public health through hygienic practices is vital. The various public digital terminals such as fast-food restaurant, ticket machines, and public transport navigation systems are used by thousands on a daily basis. 

These terminals are high-touch surfaces which means the risk of disease transmission is very high— more so with the current global health issues such as COVID-19always looming large. 

This project brings in a state-of-the-art touch-free user interaction system using gesture recognition technology to make these interfaces free from any physical contact requirements. This would greatly promote public health and safety by eliminating the need for people to touch these surfaces at all levels.
The need for this technology is highlighted by the growing attention and alarm about cleanliness in communal spaces. Touchscreens, buttons— these relics from a bygone era can serve as breeding grounds for bacteria that might spiral into epidemics threatening public health all because of a simple touch.
With this project aiming to introduce a contactless system, the endeavor hopes to present an innovative, secure, effective, and hygienic means where people can easily transact with digital terminal without any physical contact.

Project Objectives

• Innovate Interaction: The initiative aims to create a universally fitting, touchless interaction module which can easily be fitted into current systems and easily designed into new ones, thus promoting innovation in public health safety.

• Enhance Public Health Safety: The core objective of this health concern is minimizing the public’s exposure to disease-causing pathogens due to shared surfaces. This module goes a long way in curbing the spread of both viral and bacterial infections through touch points within public spaces.

• Boost Accessibility and Ease of Use: By creating an interface that operates through intuitive gestures, the module caters to a broad spectrum of the population.

• Seamless Integration: In terms of integration, the design guarantees that the module can easily blend with different digital infrastructures. As a result, upgrades can be done without complications and many people can adopt it widely without interfering with how their current systems operate.

Technologies Employed

• ESP32 Microcontroller: This powerful microcontroller is at the heart of the module, handling all data processing and connectivity. Its robust performance ensures the system operates efficiently under various conditions.

• PAJ7620 Gesture Recognition Sensor: Utilizing this advanced sensor, the module can detect a wide array of user gestures—such as swipes and selections—which are then translated into commands for the digital terminal. The sensor’s ability to accurately interpret gestures ensures a smooth user experience.

• Customizable Software Interface: The software interface is designed to be adaptable, allowing users and administrators to personalize gesture-command mappings to fit different environmental and operational needs. This flexibility enhances the module’s utility across diverse settings.

• Reliable Communication Protocols: A novel handshake protocol, inspired by proven HTTP communication techniques, is employed to ensure secure and stable connections between the touchfree module and host devices. This protocol guarantees that the interactions are not only seamless but also secure from interruptions.

Detailed Functionality and Features

• Advanced Gesture Recognition: The system allows users to interact with menus, make selections, and navigate through options using straightforward hand movements. Recognizable gestures include swiping in various directions and air tapping, facilitating an interaction that feels natural and is easy to adopt.

• Handshake Algorithm: Essential for secure communication, the handshake algorithm operates through several stages:

1. Initialization: Automatically detects when the ESP32 module is connected to a host device.
2. Signal Exchange: Engages in a robust exchange of predefined signals to establish a secure connection.
3. Confirmation: Confirms a successful handshake before activating the module to receive and interpret gesture inputs.

• Modular Design: The module’s design is inherently modular, allowing for easy installation on a wide range of terminal types—from small ticket machines to large informational kiosks—without the need for extensive modifications.

• Customizable User Profiles: The system supports the creation of multiple user profiles, enabling individual users to save and switch between different configurations of gesture controls. This feature significantly enhances personalization and ease of use.

• Reliable Case Manufacturing: The module is encased in a robust, custom-designed enclosure that includes an innovative angle adjustment mechanism. This feature allows the device to be optimally positioned based on the terminal’s installation height and angle, enhancing usability and user comfort across various public terminals.

Conclusion

In conclusion, this project will change the way people interact with public digital systems in Hong Kong forever. 

Not only does it promote public health safety but it also aligns itself with the digital transformation goals of EDPS Fund. With support from the fund, the project will further refine its technology offerings— leading towards a more secure, accessible and hygienic public digital infrastructure. The launch of this touch-free module is a significant stride in ensuring safety and efficiency of public interactions— even as we face present and future health challenges.