PcDuino9 AI visual edge computing development kit

From LinkSprite Playgound
Jump to: navigation, search

Introduction

pcDuino9 AI computer vision edge computing development kit is for AI based security application.

The kit includes general IPC using hi3516D solution and pcDuino9 embedded AI edge computing module. The kit mainly uses the pcDuino9 embedded module to process the video stream acquired from hi3516D, and carries out a series of analysis and processing of the video stream. The kit builds a basic development environment for developers. It provides video frames obtained from hi3516D by pcDuino9, developers can freely develop on the raw frame, such as face detection, license plate detection, object detection and other AI functions. At the same time, it provides an open API interface. Developers can return the information which were processed on pcDuino9 to hi3516D, and the detected image can be optimized select on hi3516D, and then output them via FTP.


Moreover, if RK3288 processing not enough, Movidius module can be added to the pcDuino9 to extend the processing power.


PcDuino9 AI Cam Ai Kit-7.PNG

PcDuino9 AI Cam Ai Kit-8.PNG


PcDuino9 AI Cam Ai Kit-9.PNG


PcDuino9 AI Cam Ai Kit-10.PNG


Basic Framework

PcDuino9 AI Cam Ai Kit.PNG


The development environment has been provided:

1. pcDuino9 Gets Video Frames from hi3516D

2. Return the information analyzed and processed by the developer to hi3516D

3. Select high quality pictures which has been analyzed on hi3516D and output them via FTP


Examples of development functions

1. Developing Frame maps on pcDuino9,such as face detection, license plate detection, object detection and other AI image analysis and processing functions.

2. Output of the analyzed pictures via FTP for other application requirements

3. ……

Package List

• General IPC with Hi3516D

pcDuino9 embedded AI visual edge computing module


Hardware Introduction

The introduction of pcDuino9 embedded AI visual edge computing module

I/O Diagram

PcDuino9 AI Cam Ai Kit-1.PNG


Pin Map

PcDuino9 AI Cam Ai Kit-2.PNG


Specifications

PcDuino9 AI Cam Ai Kit-3.PNG


RK3288 CPU Benchmark

PcDuino9 AI Cam Ai Kit-4.jpg


Specifications of Hi3516D IPC

PcDuino9 AI Cam Ai Kit-11.PNG

PcDuino9 AI Cam Ai Kit-13.PNG

How To Develop

How To Get Video Frames from Hi3516D

Hi3516 transfers BT1120 data to pcDuino 9. pcDuino 9 converts BT1120 data into MIPI signal through LT8918, and then receives it. At present, it supports 640x480 60FPS frame data transmission. We encapsulate the protocol layer and make it similar to OpenCV style. While reading the frame data, we will return the frame number, which is transmitted by 3516 and is the synchronous frame number for data interaction.

PcDuino9 AI Cam Ai Kit-14.PNG

How To Optimize Your Network and Run Object Detect

pcDuino9 has a CPU with Quad-Core Cortex-A17 up to 1.8GHz and GPU with ARM Mali-T764. if you would like to run your Network on CPU,you can refer to NCNN.or if you would like to run your Network on GPU,you can refer to MACE.

CPU Benchmark:

PcDuino9 AI Cam Ai Kit-15.PNG

Object Detect:

PcDuino9 AI Cam Ai Kit-16.PNG

PcDuino9 AI Cam Ai Kit-17.PNG

PcDuino9 AI Cam Ai Kit-18.PNG

PcDuino9 AI Cam Ai Kit-19.PNG

How To Communicate With IPC

We provide an open API interface. Developers can return the information which were processed on pcDuino9 to hi3516D, and the detected image can be optimized select on hi3516D, and then output them via FTP.

PcDuino9 AI Cam Ai Kit-20.PNG

PcDuino9 AI Cam Ai Kit-21.PNG

PcDuino9 AI Cam Ai Kit-22.PNG


Resources