Deep neural networks (DNNs) have been widely applied to various applications, including image classification, text generation, audio recognition, and graph data analysis. However, recent studies have shown that DNNs are vulnerable to adversarial attacks. Though there are several works about adversarial attack and defense strategies on domains such as images and natural language processing, it is still difficult to directly transfer the learned knowledge to graph data due to its representation structure. Given the importance of graph analysis, an increasing number of studies over the past few years have attempted to analyze the robustness of machine learning models on graph data. Nevertheless, existing research considering adversarial behaviors on graph data often focuses on specific types of attacks with certain assumptions. In addition, each work proposes its own mathematical formulation, which makes the comparison among different methods difficult. Therefore, this review is intended to provide an overall landscape of more than 100 papers on adversarial attack and defense strategies for graph data, and establish a unified formulation encompassing most graph adversarial learning models. Moreover, we also compare different graph attacks and defenses along with their contributions and limitations, as well as summarize the evaluation metrics, datasets and future trends. We hope this survey can help fill the gap in the literature and facilitate further development of this promising new field We also have created an online resource to keep track of relevant research on the basis of this survey at https://github.com/safe-graph/graph-adversarial-learning-literature .
17 July 2019 in Proceedings of the AAAI Conference on Artificial Intelligence
The soaring demand for intelligent mobile applications calls for deploying powerful deep neural networks (DNNs) on mobile devices. However, the outstanding performance of DNNs notoriously relies on increasingly complex models, which in turn is associated with an increase in computational expense far surpassing mobile devices’ capacity. What is worse, app service providers need to collect and utilize a large volume of users’ data, which contain sensitive information, to build the sophisticated DNN models. Directly deploying these models on public mobile devices presents prohibitive privacy risk. To benefit from the on-device deep learning without the capacity and privacy concerns, we design a private model compression framework RONA. Following the knowledge distillation paradigm, we jointly use hint learning, distillation learning, and self learning to train a compact and fast neural network. The knowledge distilled from the cumbersome model is adaptively bounded and carefully perturbed to enforce differential privacy. We further propose an elegant query sample selection method to reduce the number of queries and control the privacy loss. A series of empirical evaluations as well as the implementation on an Android mobile device show that RONA can not only compress cumbersome models efficiently but also provide a strong privacy guarantee. For example, on SVHN, when a meaningful (9.83,10−6)-differential privacy is guaranteed, the compact model trained by RONA can obtain 20× compression ratio and 19× speed-up with merely 0.97% accuracy loss.
13 October 2022 in ACM Transactions on Intelligent Systems and Technology
With the development of smart devices, the computing capabilities of portable end devices such as mobile phones have been greatly enhanced. Meanwhile, traditional cloud computing faces great challenges caused by privacy-leakage and time-delay problems, there is a trend to push models down to edges and end devices. However, due to the limitation of computing resource, it is difficult for end devices to complete complex computing tasks alone. Therefore, this article divides the model into two parts and deploys them on multiple end devices and edges, respectively. Meanwhile, an early exit is set to reduce computing resource overhead, forming a hierarchical distributed architecture. In order to enable the distributed model to continuously evolve by using new data generated by end devices, we comprehensively consider various data distributions on end devices and edges, proposing a hierarchical federated learning framework FLEE , which can realize dynamical updates of models without redeploying them. Through image and sentence classification experiments, we verify that it can improve model performances under all kinds of data distributions, and prove that compared with other frameworks, the models trained by FLEE consume less global computing resource in the inference stage.
7 August 2018 in IEEE Transactions on Software Engineering
Bounded model checking is among the most efficient techniques for the automatic verification of concurrent programs. However, due to the nondeterministic thread interleavings, a huge and complex formula is usually required to give an exact encoding of all possible behaviors, which significantly limits the salability. Observing that the huge formula is usually dominated by the exact encoding of the scheduling constraint, this paper proposes a novel scheduling constraint based abstraction refinement method for multi-threaded C program verification. Our method is both efficient in practice and complete in theory, which is challenging for existing techniques. To achieve this, we first proposed an effective and powerful technique which works well for nearly all examples in practice. We have proposed the notion of Event Order Graph (EOG), and have devised two graph-based algorithms over EOG for counterexample validation and refinement generation, which can always obtain a small yet effective refinement constraint. Then, to ensure the completeness, our method was enhanced with two constraint-based algorithms for counterexample validation and refinement generation. Experimental results on SV-COMP 2017 benchmarks and two real-world server systems indicate that our method is promising and significantly outperforms the existing state-of-the-art tools.
10 May 2023 in IEEE Transactions on Automatic Control
In this paper we propose novel sufficient conditions for verifying reach-avoid properties of continuous-time systems modelled by ordinary differential equations (ODEs). Given a system, an initial set, a safe set and a target set of states, we say that the reach-avoid property holds, if for all initial conditions in the initial set, any trajectory of the system starting at them will eventually, i.e. in unbounded yet finite time, enter the target set while remaining inside the safe set until that first target hit (that is, if the system starting from the initial set can reach the target set safely). Based on a discount value function, two sets of quantified constraints are derived for verifying the reach-avoid property via the computation of exponential/asymptotic guidance-barrier functions (they form a barrier escorting the system to the target set safely at an exponential or asymptotic rate). It is interesting to find that one set of constraints whose solution is termed exponential guidance-barrier functions is just a simplified version of the existing one derived from the moment based method, while the other one whose solution is termed asymptotic guidance-barrier functions is completely new. Furthermore, built upon this new set of constraints, we derive a set of more expressive constraints, which includes the aforementioned two sets of constraints as special instances, providing more chances for verifying the reach-avoid property successfully. Finally, several examples demonstrate the theoretical developments and performance of proposed sufficient conditions using semi-definite programming methods.
14 February 2022 in IEEE Internet of Things Journal
With the continuous expansion of the Internet of Things (IoT) application scope, there are growing IoT scenarios that lack the coverage of wireless communication networks have the demand for data offloading. Efficient data transmission has been the main concern of these applications. Thus, data offloading within the limited communication environment has become a hotspot in both industry and academia. Since unmanned aerial vehicles (UAVs) can move across regions to make up for the communication gap caused by the loss of wireless communication networks, a lot of in-depth studies on UAV-enabled data offloading have been conducted. Nevertheless, few studies to date consider the uncertain user status and the heterogeneous UAV capabilities, which is however more practical and needs more attention. In this article, we propose an innovative framework to dynamically estimate user status information and determine the UAV scheduling strategy. On this basis, the heterogeneous UAV-enabled data offloading is modeled as a constrained multiobjective optimization problem, whose purpose is to lower the user data queue length while extending the working time of the UAV. Moreover, a differential evolution-based dynamic objective approximation method—RUDDER is proposed to solve the constrained multiobjective optimization problem. Through rigorous mathematical proof, we prove that RUDDER can consistently guide the population to approach the optimization solution with polynomial-level time complexity. To verify the effectiveness of the proposed RUDDER, extensive experiments are conducted to compare it with five comparison algorithms. The experimental results demonstrate the superiority of the RUDDER in terms of energy saving, time efficiency, and adaptability.