Real-Time Augmented Reality Assistant for Greenhouse Training

Combining data and XR for improved training

The horticulture sector is experiencing a shortage in staff due to the retirement of many experienced employees, too few newcomers in the field and a training trajectory that takes too much time. Due to the technological advances inside greenhouses, there is, however, a large amount of data being collected that could be used to help train new greenhouse workers. This data is typically only available outside of the greenhouse and is visualized in the form of different types of dashboards. The availability of this data combined with the staff shortage problem presented an opportunity to explore if and how immersive tech could contribute to a solution.

This project, commissioned by Robocrops, combined the Immersive Xperience Lab’s expertise on research and design of effective usage of immersive technology with 360Fabriek’s extensive experience with development of XR applications, especially on the topic of training and simulation. The Immersive Xperience Lab conducted preliminary research and organized brainstorm sessions with horticulture technology experts. We used the outcomes to design an augmented reality prototype application that visualizes greenhouse data live on location, inside the greenhouse, real-time, and in a spatial way. Trainees would be able to wear augmented reality glasses while working to be able to see these data visualizations inside the greenhouse, make decisions based on what they see, and use this information to build their skills quicker, not having to rely on the slow development of intuition.

Our design was then brought to life by 360Fabriek’s XR development team and showcased on location to experts. Based on feedback collected from the showcase, the prototype showed a lot of potential to become a useful tool for greenhouse workers, once further developed into a full application.

In this application, the added value was created by taking the data at hand and making it available live on location in a spatial way. It leverages the unique capabilities of immersive technology with the aim of improving training and shortening the trajectory. The collaboration between the Immersive Xperience Lab, 360Fabriek and Robocrops provided the valuable combination of expertise in research and design for immersive, XR development and the horticulture sector.