Search results
1 – 2 of 2Li Shaochen, Zhenyu Liu, Yu Huang, Daxin Liu, Guifang Duan and Jianrong Tan
Assembly action recognition plays an important role in assembly process monitoring and human-robot collaborative assembly. Previous works overlook the interaction relationship…
Abstract
Purpose
Assembly action recognition plays an important role in assembly process monitoring and human-robot collaborative assembly. Previous works overlook the interaction relationship between hands and operated objects and lack the modeling of subtle hand motions, which leads to a decline in accuracy for fine-grained action recognition. This paper aims to model the hand-object interactions and hand movements to realize high-accuracy assembly action recognition.
Design/methodology/approach
In this paper, a novel multi-stream hand-object interaction network (MHOINet) is proposed for assembly action recognition. To learn the hand-object interaction relationship in assembly sequence, an interaction modeling network (IMN) comprising both geometric and visual modeling is exploited in the interaction stream. The former captures the spatial location relation of hand and interacted parts/tools according to their detected bounding boxes, and the latter focuses on mining the visual context of hand and object at pixel level through a position attention model. To model the hand movements, a temporal enhancement module (TEM) with multiple convolution kernels is developed in the hand stream, which captures the temporal dependences of hand sequences in short and long ranges. Finally, assembly action prediction is accomplished by merging the outputs of different streams through a weighted score-level fusion. A robotic arm component assembly dataset is created to evaluate the effectiveness of the proposed method.
Findings
The method can achieve the recognition accuracy of 97.31% and 95.32% for coarse and fine assembly actions, which outperforms other comparative methods. Experiments on human-robot collaboration prove that our method can be applied to industrial production.
Originality/value
The author proposes a novel framework for assembly action recognition, which simultaneously leverages the features of hands, objects and hand-object interactions. The TEM enhances the representation of dynamics of hands and facilitates the recognition of assembly actions with various time spans. The IMN learns the semantic information from hand-object interactions, which is significant for distinguishing fine assembly actions.
Details
Keywords
Christopher Igwe Idumah, Raphael Stone Odera and Emmanuel Obumneme Ezeani
Nanotechnology (NT) advancements in personal protective textiles (PPT) or personal protective equipment (PPE) have alleviated spread and transmission of this highly contagious…
Abstract
Purpose
Nanotechnology (NT) advancements in personal protective textiles (PPT) or personal protective equipment (PPE) have alleviated spread and transmission of this highly contagious viral disease, and enabled enhancement of PPE, thereby fortifying antiviral behavior.
Design/methodology/approach
Review of a series of state of the art research papers on the subject matter.
Findings
This paper expounds on novel nanotechnological advancements in polymeric textile composites, emerging applications and fight against COVID-19 pandemic.
Research limitations/implications
As a panacea to “public droplet prevention,” textiles have proven to be potentially effective as environmental droplet barriers (EDBs).
Practical implications
PPT in form of healthcare materials including surgical face masks (SFMs), gloves, goggles, respirators, gowns, uniforms, scrub-suits and other apparels play critical role in hindering the spreading of COVID-19 and other “oral-respiratory droplet contamination” both within and outside hospitals.
Social implications
When used as double-layers, textiles display effectiveness as SFMs or surgical-fabrics, which reduces droplet transmission to <10 cm, within circumference of ∼0.3%.
Originality/value
NT advancements in textiles through nanoparticles, and sensor integration within textile materials have enhanced versatile sensory capabilities, robotics, flame retardancy, self-cleaning, electrical conductivity, flexibility and comfort, thereby availing it for health, medical, sporting, advanced engineering, pharmaceuticals, aerospace, military, automobile, food and agricultural applications, and more. Therefore, this paper expounds on recently emerging trends in nanotechnological influence in textiles for engineering and fight against COVID-19 pandemic.
Details