It’s not far-fetched to imagine that one day it will be commonplace for manufacturing and warehouse workers to get trained using augmented reality headsets. In fact, a group of Northeastern University researchers are in the process of developing and testing that kind of technology today. Mohsen Moghaddam, a professor of mechanical and industrial engineering at Northeastern, is leading a project that takes advantage of mixed reality headsets from companies like Microsoft to develop AI-based coaches used to train facility workers.
In an interview, Moghaddam played out one scenario where these types of assistants would be ideal. “You put the headset on, and it instantly scans the environment and provides you with instruction in the form of audio, text, video and immersive animations that are superimposed in 3D space on top of the physical objects in your scene,” he says. “Let’s say you need to unscrew a bolt. It can point to that bolt and provide you with an animation of how you’re supposed to do that on screen.”