Tencent /TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
★ 4,664⑂ 771👁 90⑃ 1,044● 957▤ 1
AI-Infra-Guard4,664
stars
+0+0+8
771
forks
90
watchers
1,044
prs
957
issues
1
releases
–
discussions
README
中文版本 Introduction TNN: A high-performance, lightweight neural network inference framework open sourced by Tencent Youtu Lab. It also has many outstanding advantages such as cross-platform, high performance, model compression, and code tailoring. The TNN framework further strengthens the support and performance optimization of mobile devices on the basis of the original Rapidnet and ncnn frameworks. At the same time, it refers to the high performance and good scalability characteristics of the industry's mainstream open source frameworks, and expands the support for X86 and NV GPUs. On the mobile phone, TNN has been used by many applications such as mobile QQ, weishi, and Pitu. As a basic acceleration framework for Tencent Cloud AI, TNN has provided acceleration support for the implementation of many businesses. Everyone is welcome to participate in the collaborative construction to promote the further improvement of the TNN inference framework. Effect Example Face Detection(blazeface) | Face Alignment(from Tencent Youtu Lab) | Hair Segmentation(from Tencent Guangying Lab) :-------------------------: | :------: | :------: model link: tflite tnn | model link: tnn | model link: tnn Pose Estimation(from Tencent Guangliu) | Pose Estimation(blazepose) | Chinese OCR :--------------------------: | :------: | :------: model link: tnn | model link: tflite tnn | model link: onnx tnn Object Detection(yolov5s) | Object Detection(MobilenetV2-SSD) | Reading Comprehension :-------------------------: |:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| :------: model link: onnx tnn | model link: tensorflow tnn | model link: onnx tnn Chinese OCR demo is the TNN implementation of chineseocr_lite project. It is lightweight and supports tilted, rotated and vertical text recognition. The support for each demo is shown in the following table. You can click the ✅ and find the entrance code for each demo. demo | ARM | OpenCL | Metal | Huawei NPU | Apple NPU | X86 | CUDA :---------------------------------------------------------------------------------------: | :------: | :------: | :------: | :------: | :------: | :------: |:------: Face Detection (blazeface) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ Object Detection (yolov5s) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ Face Alignment | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ Hair Segmentation | ✅ | ✅ | ✅ | ✅ | ✅| ✅ | ✅ Pose Estimation(from Tencent Guangliu) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ Pose Estimation (blazepose) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ Chinese OCR | ✅ | ✅ | ✅ | | | ✅ | ✅ Reading