Timezone: »

 
Human-in-the-Loop Approaches For Task Guidance In Manufacturing Settings
Ramesh Manuvinakurike · Santiago Miret · Richard Beckwith · Saurav Sahay · Giuseppe Raffa

@
in AI for Accelerated Materials Design (AI4Mat) »
Event URL: https://openreview.net/forum?id=WkQXFNplt9 »

We introduce a task guidance framework for manufacturing settings aiming to improve the well-being and productivity of manufacturing workers completing a given task. The assistive technology proposed in this work centers on a dialogue system built upon semantic frame extraction of process specifications detailing a given manufacturing process. The dialogue system interacts with the technician performing the task by capturing their actions and assisting them in performing relevant steps. Specifically, we develop components to parse expert-authored natural language documents called specs and utilize the parse for task guidance and continual learning. While still in the early stages, we believe that an interactive, assistive AI framework similar to the one we are exploring will become an important component of high-volume manufacturing in the future. Such a system could increase the quality and scalability of next-generation materials and materials-related products, such as batteries or fuel cells, produced by automated materials synthesis techniques and analyzed by automated materials characterization techniques.

Keywords: human in the loop · Task guidance · Language processing · Spec documents · Manufacturing

Author Information

Ramesh Manuvinakurike (Intel)
Santiago Miret (Intel AI Lab)
Richard Beckwith
Saurav Sahay (Intel)
Giuseppe Raffa (Intel)
Giuseppe Raffa

Giuseppe "Beppe" Raffa is a Principal Engineer and Research Manager at Intel Labs where he focuses on AI technologies and their application to Ambient Computing. Beppe leads a multi-disciplinary team working at the intersection of User Experience, HCI and innovation in AI technologies. He received his PhD in Computer Engineering from the University of Bologna (Italy) for his thesis on "Context-Aware Computing in Smart Environments". In his career at Intel, Beppe worked on the Intel Labs Sensor-Hub prototype, inertial-based gesture recognition, wearable computing & interfaces, and soft sensing for advanced telemetry and device usage assessment. He published >20 papers on ubiquitous computing, he is a long-standing committee member in top tier IEEE/ACM conferences, and he has >100 patents filed or granted. Over the years he has been collaborating with many universities including Portland State University, National Taiwan University, MIT, Oregon State University, VirginiaTech, KAIST, American University of Beirut.

More from the Same Authors