This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Graph Stream ProcessingNext Generation of Processing for ML/DL Applications
Founded in 2010 by Industry Leading CPU & GPU Experts (ex. Intel) • Dinakar Munagala (CEO), Satyaki Koneru (CTO)
Ke Yin (VP Engineering), Val Cook (Chief SW Architect)
~250+ Employees World Wide (95% Eng & Ops)• El Dorado Hills, CA (HQ), Campbell, CA (Silicon Valley)• Hyderabad, India , Kings Langley & Leeds, UK
Focused on AI Solutions & Tools • GSP architecture for efficient computing • Comprehensive SDK & development tools• SoCs, modules, boards & platforms • Client, edge & data center applications
Major Corporate, Gov & VC Investors • Denso, Magna, Daimler, Temasek, Mirai Creation/SPARX Group (Toyota),
Graph Streaming Processor™ (GSP) Architecture • Up to 10-100x more efficient than traditional CPU/GPU solutions• Scalable across data center, edge and client devices for enterprise
and consumer• Broad AI applicability in Machine Learning, Deep Learning, Neural
Networks and Vision Processing
Powerful Software Development Kit (SDK)• Popular AI frameworks such as TensorFlow, PyTorch & Caffe2• Direct programing access for custom/proprietary development
Comprehensive Platform Roadmap• Built around powerful Thinci GSP SOC modules • SoCs, PCIe cards, M.2 cards and appliances for data center, edge
Example: Auto Smart Vision Object RecognitionImplementation for ADAS or autonomous driving module
ARM NIC-400
Debug unit (JTAG
)
GSP Cluster
AXI bridge
ARM TrustZoneCryptoCell
ARM A53MP 2-core
1000 MHz
RAM
Boot RO
M
CAN
BusC
ontrol x3
QSPI
SD
GPIO
x32
I2C x5
Peripheral DM
A
UAR
T x2
MIPI CIS2 x4(in)
MIPI D
SI(out)
MIPI C
IS2(out)
H264/H265Decode
H264/H265Encode
SPI slave
Ethernet
I2S
USB 3.0
LPDD
R
LPDD
R
PCIe-3.14 lane
• ISP functions combine input from multiple cameras to provide 360-degree view• AI segmentation and detection of pedestrians, road signs and other objects• Encode video for in-cabin display, other modules or distribution to the cloud• Automotive grade ASIL B
• up-to 30 on-road objects type • Driveable free space detection• ~25 FPS on HD Images
Description:
Semantic Segmentation allows us to perceive the environment with more robust knowledge than just detection. e.g., when you require to find out the safe corridor for ego-vehicle, Semantic Segmentation provides information about free space.
Auto Smart Vision: Sensor Data Dense Fusion (LiDAR + Front Camera)
Features:
• Driveable free space detection• ~30FPS
Description:
Sensor fusion is the process of merging data from multiple sensors such that to reduce the amount of uncertainty that may be involved in a navigation motion or task performing. Sensor fusion helps in building a more accurate world model in order for the vehicle to navigate and behave more successfully.
Auto Smart Vision: On–Road Objects Volumetric Analysis
Description:
3D object detection subtask is itself one of the most important prerequisites to autonomous navigation, as this task is what allows the car controller to account for obstacles when considering possible future trajectories.
• Multi Vehicle 3D Tracking• Speed Estimation• >50 FPS• EKF based tracking
Description:
3D object tracking is one of the most important prerequisites to autonomous navigation. This task reduces the burden of heavy object detection and processing time while at the same time it will help to estimate leading vehicle trajectory, behaviour and its speed.
• Highlight lane marking and leading vehicles in low light condition
• HDMaps & Reinforcement Learning based Thinci algorithms
Description:
This Driver Assistive System facilitates clear and safe driving with real-time, accurate, and clear digital maps that reveal nearby objects to allow increased driving speed, lane keeping, under poor visibility such as fog, snow, rain, and darkness, prevent crashes and save lives.
Graph Streaming Processor™ (GSP) Architecture • Up to 10-100x more efficient than traditional CPU/GPU solutions• Scalable across data center, edge and client devices for enterprise
and consumer• Broad AI applicability in Machine Learning, Deep Learning, Neural
Networks and Vision Processing
Powerful Software Development Kit (SDK)• Popular AI frameworks such as TensorFlow, PyTorch & Caffe2• Direct programing access for custom/proprietary development
Comprehensive Platform Roadmap• Built around powerful Thinci GSP SOC modules • SoCs, PCIe cards, M.2 cards and appliances for data center, edge