Jan Harkes

Jan Harkes

Auto-generated profile, based on publicly available information

Jan Harkes

Carnegie Mellon University, Pittsburgh, PA, USA

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

6 December 2023
Verified
Conference Paper
Open access
MBMihir Bala
Mihir Bala
TEThomas Eiszler
Thomas Eiszler
XCXiangliang Chen
Xiangliang Chen
JHJan Harkes
Jan Harkes
JBJames Blakley
James Blakley
MSMahadev Satyanarayanan
Mahadev Satyanarayanan
Fully autonomous flight by low-cost, lightweight commercial off-the-shelf (COTS) drones could transform many use cases involving real-time computer vision. We show how such autonomy can be achieved using edge computing from a flight platform costing less than $800, and composed of a 320 g COTS drone with a 26 g COTS wearable device as payload. In spite of the extreme austerity of this platform and thermal limits on its LTE transmission, the system is able perform tasks such as detecting and then tracking a target. It is also able to visually navigate around obstacles. Such capabilities are only found on heavier and more expensive drones today.

14 January 2019 in IEEE Internet Computing
Verified
Journal Article
Closed access
ZFZiqiang Feng
Ziqiang Feng
SGShilpa George
Shilpa George
JHJan Harkes
Jan Harkes
RKRoberta L. Klatzky
Roberta L. Klatzky
MSMahadev Satyanarayanan
Mahadev Satyanarayanan
PPPadmanabhan Pillai
Padmanabhan Pillai
The generation of high-quality training data has become the key bottleneck in the use of deep learning across many domains. We describe Eureka, an interactive system that leverages edge computing and early discard to greatly improve the productivity of experts in the construction of a labeled data set. Our experimental results show that Eureka reduces the labeling effort needed to construct a training set by two orders of magnitude relative to a brute-force approach.

27 June 2023
Verified
Conference Paper
Open access
MSMahadev Satyanarayanan
Mahadev Satyanarayanan
JHJan Harkes
Jan Harkes
JBJames Blakley
James Blakley
Olive enables execution of closed-source applications decades after their creation. With appropriate authentication and authorization, anyone on the Internet can execute any archived application with no more effort than a mouse click. User experience is good, even for an interaction-intensive application. Olive uses virtual machine (VM) technology to encapsulate legacy software, including the operating system and all layers above it. If the legacy hardware is already obsolete at curation time, an emulator for it on more modern hardware can be included within the VM image. This paper is an experience report on the decade-long evolution of this concept.

17 October 2024 in IEEE Transactions on Emerging Topics in Computing
Verified
Journal Article
Open access
ESEric Sturzinger
Eric Sturzinger
JHJan Harkes
Jan Harkes
PPPadmanabhan Pillai
Padmanabhan Pillai
MSMahadev Satyanarayanan
Mahadev Satyanarayanan
We introduce survival-critical machine learning (SCML), in which a robot encounters dynamically evolving threats that it recognizes via machine learning (ML), and then neutralizes. We model survivability in SCML, and show the value of the recently developed approach of Live Learning. This edge-based ML technique embodies an iterative human-in-the-loop workflow that concurrently enlarges the training set, trains the next model in a sequence of “best-so-far” models, and performs inferencing for both threat detection and pseudo-labeling. We present experimental results using datasets from the domains of drone surveillance, planetary exploration, and underwater sensing to quantify the effectiveness of Live Learning as a mechanism for SCML.

21 July 2022 in IEEE Micro
Verified
Journal Article
Open access
MSMahadev Satyanarayanan
Mahadev Satyanarayanan
ZFZiqiang Feng
Ziqiang Feng
SGShilpa George
Shilpa George
JHJan Harkes
Jan Harkes
RIRoger Iyengar
Roger Iyengar
PPPadmanabhan Pillai
Padmanabhan Pillai
We propose hardware acceleration for a new edge computing abstraction called a Silent Witness. This abstraction embodies a severe asymmetry in the ease of write versus read operations. Surveillance data from one or more video cameras is continuously encrypted and recorded, but the decrypting, processing, or transmission of that data only occurs under stringent privacy controls. For the new search workloads of such a system, decode-enabled storage alleviates the scalability bottleneck imposed by frequent decoding of data. Our experiments show throughput improvements up to 3.5x for typical search workloads of a Silent Witness.