TY - GEN
T1 - Graph Convolutional Network Robustness Verification Algorithm Based on Dual Approximation
AU - An, Dongdong
AU - Zhang, Hao
AU - Zhao, Qin
AU - Liu, Jing
AU - Shi, Jianqi
AU - Huang, Yanhong
AU - Yang, Yang
AU - Liu, Xu
AU - Qin, Shengchao
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.
PY - 2024
Y1 - 2024
N2 - With the continuous development of Graph Neural Network (GNN) technologies, securing their robustness is crucial for their broad adoption in practical applications. Although various verification methods for training GNNs have been proposed, studies indicate that Graph Convolutional Networks (GCNs) remain vulnerable to adversarial attacks affecting both graph structure and node attributes. We propose a novel approach to verify the robustness of GCNs against perturbations in node attributes by employing a dual approximation technique to convexify nonlinear activation functions. This transformation changes the original non-convex problem into a more manageable convex forms. We start by applying linear relaxation to convert fixed-value features in each GCN layer into variables suitable for optimization. Next, we reframe the task of identifying the worst-case margin for a graph as a linear problem, which we solve using linear programming techniques. Given the discrete nature of graph data, we define a perturbation space that extends the data domain from discrete to continuous values. To improve the accuracy of the convex relaxation, we use a dual approximation algorithm to set bounds on the optimizable variables. Our method certifies the robustness of nodes against perturbations within a specified range and significantly improves verification accuracy compared to previous approaches. This method surpasses previous work in verification accuracy and is distinctively tailored to address the S-curve, an aspect less explored in prior research. Experimental results show that our method significantly refines the precision of robustness verification for GCNs.
AB - With the continuous development of Graph Neural Network (GNN) technologies, securing their robustness is crucial for their broad adoption in practical applications. Although various verification methods for training GNNs have been proposed, studies indicate that Graph Convolutional Networks (GCNs) remain vulnerable to adversarial attacks affecting both graph structure and node attributes. We propose a novel approach to verify the robustness of GCNs against perturbations in node attributes by employing a dual approximation technique to convexify nonlinear activation functions. This transformation changes the original non-convex problem into a more manageable convex forms. We start by applying linear relaxation to convert fixed-value features in each GCN layer into variables suitable for optimization. Next, we reframe the task of identifying the worst-case margin for a graph as a linear problem, which we solve using linear programming techniques. Given the discrete nature of graph data, we define a perturbation space that extends the data domain from discrete to continuous values. To improve the accuracy of the convex relaxation, we use a dual approximation algorithm to set bounds on the optimizable variables. Our method certifies the robustness of nodes against perturbations within a specified range and significantly improves verification accuracy compared to previous approaches. This method surpasses previous work in verification accuracy and is distinctively tailored to address the S-curve, an aspect less explored in prior research. Experimental results show that our method significantly refines the precision of robustness verification for GCNs.
KW - Graph Neural Networks
KW - Linear Programming
KW - Robustness Verification
UR - https://www.scopus.com/pages/publications/85211444764
U2 - 10.1007/978-981-96-0617-7_9
DO - 10.1007/978-981-96-0617-7_9
M3 - 会议稿件
AN - SCOPUS:85211444764
SN - 9789819606160
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 146
EP - 161
BT - Formal Methods and Software Engineering - 25th International Conference on Formal Engineering Methods, ICFEM 2024, Proceedings
A2 - Ogata, Kazuhiro
A2 - Mery, Dominique
A2 - Sun, Meng
A2 - Liu, Shaoying
PB - Springer Science and Business Media Deutschland GmbH
T2 - 25th International Conference on Formal Engineering Methods, ICFEM 2024
Y2 - 2 December 2024 through 6 December 2024
ER -