Energy Efficient Implementations on Heterogeneous Platforms: Lessons Learned

Speaker:       Dimitrios Soudris

Time:            10:30, Apr. 3rd.

Location:      SIST 3-301

Host:             Prof. Yanjun Ha

Abstract:

This talk presents practical lessons from deploying energy-efficient applications across heterogeneous platforms spanning edge to cloud. We explore HW/SW co-design strategies that balance performance, power, and adaptability under real-world constraints. Through case studies on CPUs, GPUs, and FPGAs, we show how workload characteristics drive architecture selection and mapping decisions. Key insights highlight the role of memory hierarchy, data movement, and precision scaling in achieving high energy efficiency. We present results from an energy-efficient LLM inference serving framework and analyze the interaction between dynamic data types, memory hierarchy, and DSP utilization on FPGA platforms. Empirical findings demonstrate substantial improvements in performance-per-watt. The talk concludes with design guidelines for scalable, energy-aware systems.   

Bio:

Dr. Dimitrios Soudris received his diploma and PhD in Electrical Engineering from the University of Patras in 1987 and 1992, respectively. He worked as a Lecturer, Assistant and Associate Professor in the Department of Electrical and Computer Engineering, Democritus University of Thrace for thirteen years from 1995 until 2008. Currently, he works as a Full Professor in the School of Electrical and Computer Engineering, National Technical University of Athens. His research interests include Hardware & Software Design of Embedded Systems, Reconfigurable Architectures (FPGAs), Hardware Accelerators, Edge Computing and Methodologies and Design of DSP applications. He has published plethora of papers in international journals and conferences and holds three international patents. Also, he is the author and editor of ten books Kluwer and Springer. He is Director of Microprocessor and Digital systems Lab (MicroLab). He is project coordinator and/or and principal investigator in numerous research & development projects (>70 ) funded by the European Commission, ENIAC-JU, European Space Agency, the Greek Government and the European and Greek Industry. He is member of IEEE, ACM and HiPEAC.