Provide real-world scenarios that explain computer vision, robotics, and how AI ties it all together for improved workplace safety and efficiency
Microsoft’s Ambient Computing and Robotics team has been working hard to develop a system that can improve safety and efficiency via connected cameras and other devices. Not only should the system be able to recognize people and objects, but the system should start to learn about the environment, becoming aware of context and policies.
Working with the researchers and engineering team to develop an admin interface as well as some on-screen graphics was the first challenge. We explored and designed across several device types and modalities, including chat bots, web desktop, and video.
Once the proof of concept was up and running, explaining how the system worked, and the powerful connections it could make to provide actionable tasks was the next challenge.