21 June 2016 in Science China Information Sciences
13 October 2020 in IEEE Transactions on Parallel and Distributed Systems
The difficulty of deploying various deep learning (DL) models on diverse DL hardware has boosted the research and development of DL compilers in the community. Several DL compilers have been proposed from both industry and academia such as Tensorflow XLA and TVM. Similarly, the DL compilers take the DL models described in different DL frameworks as input, and then generate optimized codes for diverse DL hardware as output. However, none of the existing survey has analyzed the unique design architecture of the DL compilers comprehensively. In this paper, we perform a comprehensive survey of existing DL compilers by dissecting the commonly adopted design in details, with emphasis on the DL oriented multi-level IRs, and frontend/backend optimizations. We present detailed analysis on the design of multi-level IRs and illustrate the commonly adopted optimization techniques. Finally, several insights are highlighted as the potential research directions of DL compiler. This is the first survey paper focusing on the design architecture of DL compilers, which we hope can pave the road for future research towards DL compiler.
25 April 2024 in Neural Networks
30 November 2018 in Nature Methods
1 January 2017 in AIP Conference Proceedings
We propose a fast method to automatically pick protein particles in cryo-EM micrographs, which is now completed manually in practice. Our method is based on Fast R-CNN, with sliding window as the regions proposal solution. To reduce the false positive detections, we set a single class for the major contaminant ice, and pick out all the ice particles in the whole datasets. Tests on the recently-published cryo-EM data of three proteins have demonstrated that our approach can automatically accomplish the human-level particle picking task, and we successfully reduce the test time from 1.5 minutes of previous deep learning method to 2 seconds without any recall or precision losses. Our program is available under the MIT License at https://github.com/xiao1fan/FastParticlePicker.