Publication

Abstract : TensorRT is a high-performance deep learning inference optimizer and runtime that can be used to speed up the deployment of deep learning models. In this paper, the performance of different neural network architectures when using TensorRT is compared and showed that TensorRT can significantly reduce the inference time of deep learning models on embedded systems. The SARS-CoV-2 virus, which causes the infectious disease COVID-19, has had a significant impact on global health and the economy. Non-pharmaceutical interventions such as wearing face masks are an effective way to reduce the spread of the virus, and automatic detection systems based on CNN’s can help to detect mask-wearing without requiring human intervention which saves resources or manpower deployed. The results demonstrate that TensorRT is a valuable tool for deploying deep learning applications in resource-constrained environments and can help to improve the performance of a wide range of neural network architectures.