Skip to Main content Skip to Navigation
Conference papers

PhD Forum Towards embedded heterogeneous FPGA-GPU smart camera architectures for CNN inference

Abstract : The success of Deep Learning (DL) algorithms in computer vision tasks have created an ongoing demand of dedicated hardware architectures that could keep up with the their required computation and memory complexities. This task is particularly challenging when embedded smart camera platforms have constrained resources such as power consumption, Processing Element (PE) and communication. This article describes a heterogeneous system embedding an FPGA and a GPU for executing CNN inference for computer vision applications. The built system addresses some challenges of embedded CNN such as task and data partitioning, and workload balancing. The selected heterogeneous platform embeds an Nvidia® Jetson TX2 for the CPU-GPU side and an Intel Altera® Cyclone10GX for the FPGA side interconnected by PCIe Gen2 with a MIPI-CSI camera for prototyping. This test environment will be used as a support for future work on a methodology for optimized model partitioning.
Document type :
Conference papers
Complete list of metadatas

Cited literature [6 references]  Display  Hide  Download

https://hal-univ-rennes1.archives-ouvertes.fr/hal-02365853
Contributor : Laurent Jonchère <>
Submitted on : Tuesday, January 14, 2020 - 4:53:32 PM
Last modification on : Monday, January 20, 2020 - 8:53:03 AM
Document(s) archivé(s) le : Wednesday, April 15, 2020 - 7:30:48 PM

File

Carballo-Hernandez-2019-Phd Fo...
Files produced by the author(s)

Identifiers

Citation

W. Carballo-Hernández, F. Berry, Maxime Pelcat, M. Arias-Estrada. PhD Forum Towards embedded heterogeneous FPGA-GPU smart camera architectures for CNN inference. 13th International Conference on Distributed Smart Cameras, ICDSC 2019, Sep 2019, Trento, Italy. pp.a34, ⟨10.1145/3349801.3357136⟩. ⟨hal-02365853⟩

Share

Metrics

Record views

201

Files downloads

78