Interactive Restaurant Menu Ordering System using Projection Mapping and Machine Learning

Abstract

Integration of automation and technology in every aspect of life is the global trend in the present age. It encompasses every facet of society including education, medicine, entertainment, defense, clothing, and restaurants, among others. Restaurants have also embraced technologies to facilitate their customers. Technologies like tablets for customer order, augmented reality, projection mapping for menu projection, touchscreen panels for order placement are among few worth mentioning. This paper proposes an entertaining way for the customers to place their orders without a waiter, using Machine Learning & Projection Mapping. The table serves as an interactive medium to browse through the menu and communicate with the kitchen with the touch of a finger. We have developed the product using TensorFlow and OpenCV using Python, along with a webcam or IP camera. The Graphical User Interface (GUI) has been designed in QT designer using pyqt5. This system is user friendly and can be installed in every environment. It can prove to be a low cost, high accuracy, real-time alternative to the existing technologies and can work in the cluttered environment with different illuminations with 96% accuracy.