Embedded, Cyber-Physical, and IoT Systems
Shuvra S. Bhattacharyya • Miodrag Potkonjak
Senem Velipasalar
Editors
Embedded, Cyber-Physical,
and IoT Systems
Essays Dedicated to Marilyn Wolf on the
Occasion of Her 60th Birthday
123
Editors
Shuvra S. Bhattacharyya Dept. of ECE and UMIACS University of Maryland College Park
MD, USA
Miodrag Potkonjak Dept. of Computer Science University of California Los Angeles
CA, USA Senem Velipasalar
Dept. of EECS Syracuse University Syracuse NY, USA
ISBN 978-3-030-16948-0 ISBN 978-3-030-16949-7 (eBook) https://doi.org/10.1007/978-3-030-16949-7
© Springer Nature Switzerland AG 2020
This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed.
The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use.
The publisher, the authors, and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This Springer imprint is published by the registered company Springer Nature Switzerland AG.
The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland
Foreword
The search for efficient means of computing and automation has permeated modern society starting from the time of the industrial revolution. Progress has been driven by visionaries who could quickly grasp the entire flow of the computing chain, from data acquisition to information elaboration, to visualization, and to actuation. Such visionaries also provided solutions matching the technology at hand. In this way, computing morphed through the years, from large mainframes to portable devices.
Automation became ubiquitous through the use of embedded computing nodes.
Within computing systems, the balance of hardware and software and their concurrent design—dubbed hw/sw co-design—has been an important enabling methodology. Marilyn Wolf has been a pioneer in analyzing co-design tools and methods as well as in creating procedures for optimal co-design in various metrics.
As a founding parent of co-design in electronic design automation, her seminal work brought consciousness to the research community of the multitude of issues in co-design and of the synergy of circuit, architecture, and algorithm techniques in addressing the problem.
Later on, as the field of embedded systems emerged as the fastest growing segment of the computing industry, Marilyn Wolf’s leadership in research and edu- cation became prominent. Her books allowed many of us to understand the various abstractions of distributed computing and control and leverage them in designing tools for embedded systems analysis and synthesis. Her textbook, Computers as Components, was seminal as it allowed engineers to put computing elements in the perspective of large systems.
Next, as distributed systems became elaborate means of processing the informa- tion and as such information became semantically richer, Marilyn Wolf contributed to the field by proposing and perfecting visual acquisition capturing and processing systems. Distributed image processing is a key constituent of security and defense, and it is used also to monitor industrial production and the environment. Her contribution is present in many tangible aspects of modern society.
v
vi Foreword Overall, Marilyn contributed to the advancement of electrical engineering and computer science, both in academia and in industry. Her contribution to education and dissemination of technology are well known throughout the world. This book serves as a reference point for scientists and engineers to understand the complex field of computing and its evolution through her outstanding contributions.
EPFL, Lausanne, Switzerland Giovanni De Micheli
2019
Preface
This Festschrift volume is published in honor of Marilyn Wolf, on the occasion of her 60th birthday. The book covers various topics in Embedded, Cyber-Physical, and Internet of Things (IoT) Systems, with emphasis on topics related to Smart Cameras, Hardware/Software Co-Design, and Multimedia Applications. Marilyn has made pioneering contributions of great impact in all of these areas. Embedded systems are everywhere; cyber-physical systems enable monitoring and control of complex physical processes with computers; and IoT technology is of increasing relevance in major application areas, including factory automation, and smart cities. Smart cameras and multimedia technologies introduce novel opportunities and challenges in embedded, cyber-physical, and IoT applications. Advanced hardware/software co-design methodologies provide valuable concepts and tools for addressing these challenges. The purpose of the book is to provide a collection of timely articles that cover important topics in the aforementioned areas, which represent major themes in Marilyn’s career.
Marilyn Wolf
vii
viii Preface
Attendees at the Workshop on Embedded Computing, which was held in honor of Professor Wolf on September 21, 2018: Jacques Florence, Graham Hellestrand, Chia-Han Lee, Weichen Liu, Burak Ozer, Nikshep Patil, Dimitrios Serpanos, Umer Tariq, Marilyn Wolf, Yuan Xie, Jiang Xu, Jishen Zhao
Preface ix Marilyn Wolf is the Georgia Research Alliance Eminent Scholar and Rhesa “Ray” S.
Farmer, Jr., Distinguished Chair in Embedded Computing Systems in the School of Electrical and Computer Engineering at Georgia Institute of Technology. Her major distinctions and awards include the ASEE Frederick E. Terman Award (2003), IEEE Circuits and Systems Society Education Award (2006), IEEE Computer Society Golden Core Award, and Fellow of both the ACM and IEEE. She has helped to found major international conferences, including CODES (now CODES-ISSS as part of Embedded Systems Week) and MPSoC. She has written several books that are used widely throughout the world. These include Embedded System Interfacing;
Computers as Components; High-Performance Embedded Computing; The Physics of Computing; Smart Camera Design: Algorithms, Architectures, and Art; and Internet-of-Things (IoT) Systems.
The diverse topics of the chapters in this Festschrift help to reflect the great breadth and depth of Marilyn’s contributions in research and education. The chap- ters have been written by some of Marilyn’s closest collaborators and colleagues.
The completion of this Festschrift follows a Workshop on Embedded Computing, which was held in honor of Marilyn on September 21, 2018, at the Georgia Tech campus in Atlanta, Georgia. The workshop featured technical presentations, as well as personal stories of the tremendous positive influence that Marilyn has had on the careers and lives of people who have worked with her, including those who had the fortune to study under her mentorship. The workshop also included several video greetings from scholars around the world who were unable to attend the event in person.
We would like to thank all of the authors who contributed to this Festschrift and the reviewers who provided constructive feedback during the development of the chapters. We would also like to thank Paul Drougas, Jennifer Evans, and Rachel Toy at Springer for their support.
To Marilyn, we would like to extend our heartiest congratulations on her truly outstanding contributions in research and education. We look forward to many more years of friendship and collaboration with her.
College Park, MD, USA Shuvra S. Bhattacharyya
Los Angeles, CA, USA Miodrag Potkonjak
Syracuse, NY, USA Senem Velipasalar
Contents
i-Core: A Runtime-Reconfigurable Processor Platform
for Cyber-Physical Systems . . . . 1 Marvin Damschen, Martin Rapp, Lars Bauer, and Jörg Henkel
Color Primary Correction of Image and Video Between Different
Source and Destination Color Spaces . . . . 37 Santanu Dutta
Hardware/Software Interface Codesign for Cyber Physical Systems . . . . 73 Ahmed Amine Jerraya
Run-Time Security Assurance of Cyber Physical System Applications . . . . 79 Muhammad Taimoor Khan, Dimitrios Serpanos, and Howard Shrobe
Moving Camera Analytics: Computer Vision Applications . . . . 89 Chung-Ching Lin, Karthikeyan Natesan Ramamurthy,
Sharathchandra U. Pankanti
Code Compression for Embedded Systems . . . 115 Chang Hong Lin, Wei-Jhih Wang, Jui-Chun Chen, and Che-Wei Lin
Wearable Sensor Applications: Processing of Egocentric Videos
and Inertial Measurement Unit Data . . . 149 Yantao Lu and Senem Velipasalar
Nonvolatile Processor Architecture Exploration
for Energy-Harvesting Application Scenarios . . . 175 Kaisheng Ma, Shuangchen Li, Vijaykrishnan Narayanan, and Yuan Xie
A Fast Joint Application-Architecture Exploration Platform
for Heterogeneous Systems . . . 203 Rafael K. Vivas Maeda, Peng Yang, Haoran Li, Zhongyuan Tian,
Zhehui Wang, Zhifei Wang, Xuanqi Chen, Jun Feng, and Jiang Xu
xi
xii Contents
The Journey of a Project Through the Eyes of a Smart Camera . . . 233 Burak Ozer
Rotators in Fast Fourier Transforms . . . 245 Fahad Qureshi, Jarmo Takala, and Shuvra Bhattacharyya
Biolabs as Computing Components . . . 263 Georgi Tanev, Winnie Svendsen, and Jan Madsen
Teaching Embedded System Design Among K-12 Students Based
on Trees-Forest-View Methodology . . . 283 Shengqi Yang, Kainian Xie, and Mansun Chan