When the client first approached the CXR team, they presented the vision of Pick Dish, a mobile application designed for both restaurants and customers, offering two distinct use cases. For restaurants, the app enables them to showcase their menu to customers seamlessly. Meanwhile, for customers, the app uses Augmented Reality (AR) to display a visual representation of the restaurant's menu.

One major challenge was integrating the photogrammetry API for precise dish scanning, recognition and tracking in the AR environment. We needed to accurately identify dishes under different angles and lighting, ensuring a smooth and immersive AR experience. Standardizing dish sizes for consistency across restaurants was also critical. Our team established universal dish size standards for easy adoption. Additionally, we tackled the technical hurdle of implementing AR dish plane tracking, developing a system to accurately follow dishes in motion, considering factors like camera positioning and lighting.