Publications
This page lists my publications on quantum software engineering and selected publications on quality assurance for AI systems, software engineering, and programming languages. For a more complete and up-to-date record, please see my Google Scholar or DBLP profile.
Perspectives on Software Engineering and Quantum Computing
These two papers outline the research landscape and future directions at the intersection of software engineering and quantum computing, covering both software engineering for quantum computing (SE4QC) and quantum computing for software engineering (QC4SE).
Quantum Software Engineering: Landscapes and Horizons
Jianjun Zhao.
arXiv:2007.07047 (2020).
Jianjun Zhao.
arXiv:2007.07047 (2020).
Perspective: Software Engineering for Quantum Computing (SE4QC).
Quantum-Based Software Engineering
Jianjun Zhao.
arXiv:2505.23674 (2025).
Jianjun Zhao.
arXiv:2505.23674 (2025).
Perspective: Quantum Computing for Software Engineering (QC4SE).
Quantum Software Engineering
2026
Large Language Models for Quantum Code Translation: An Exploratory Study
Xiyuan Li, Yuechen Li, and Jianjun Zhao.
arXiv:2610.34841 (2026).
Xiyuan Li, Yuechen Li, and Jianjun Zhao.
arXiv:2610.34841 (2026).
QDoctor: Probe-Based Testing for Quantum Programs
Qichen Wang, Shangzhou Xia, Xiaoyu Guo, and Jianjun Zhao.
41st IEEE/ACM International Conference on Automated Software Engineering (ASE 2026).
Qichen Wang, Shangzhou Xia, Xiaoyu Guo, and Jianjun Zhao.
41st IEEE/ACM International Conference on Automated Software Engineering (ASE 2026).
Toward Entanglement Dependence Metrics for Quantum Software Complexity
Haibo Yu and Jianjun Zhao.
20th International Symposium on Empirical Software Engineering and Measurement (ESEM 2026), LIPIcs 394, Article 79:1-79:13.
Haibo Yu and Jianjun Zhao.
20th International Symposium on Empirical Software Engineering and Measurement (ESEM 2026), LIPIcs 394, Article 79:1-79:13.
Large Language Models for Quantum Software Engineering: Opportunities and Challenges in Modeling, Generation, Testing, and Repair
Jiaming Ye, Qiang Hu, Fuyuan Zhang, Shangzhou Xia, Xiaoyu Guo, Xiongfei Wu, Yongqiang Lyu, and Jianjun Zhao.
ACM Transactions on Software Engineering and Methodology, 35(9), Article 273.
Jiaming Ye, Qiang Hu, Fuyuan Zhang, Shangzhou Xia, Xiaoyu Guo, Xiongfei Wu, Yongqiang Lyu, and Jianjun Zhao.
ACM Transactions on Software Engineering and Methodology, 35(9), Article 273.
StabQ: Quantum Program Analysis via Weighted Stabilizer Representations
Shangzhou Xia, Junjie Luo, and Jianjun Zhao.
arXiv:2608.24144 (2026).
Shangzhou Xia, Junjie Luo, and Jianjun Zhao.
arXiv:2608.24144 (2026).
QuanForge: A Mutation Testing Framework for Quantum Neural Networks
Minqi Shao, Shangzhou Xia, and Jianjun Zhao.
Proceedings of the ACM on Software Engineering, Vol. 3 (34th ACM International Conference on the Foundations of Software Engineering, FSE 2026), 2882-2904.
Minqi Shao, Shangzhou Xia, and Jianjun Zhao.
Proceedings of the ACM on Software Engineering, Vol. 3 (34th ACM International Conference on the Foundations of Software Engineering, FSE 2026), 2882-2904.
Benchmarking Quantum Software Testing with Scalable Quantum Programs
Yuechen Li, Minqi Shao, Xiyuan Li, Jianjun Zhao, and Kai-Yuan Cai.
arXiv:2607.02029 (2026).
Yuechen Li, Minqi Shao, Xiyuan Li, Jianjun Zhao, and Kai-Yuan Cai.
arXiv:2607.02029 (2026).
A Methodological Analysis of Empirical Studies in Quantum Software Testing
Yuechen Li, Minqi Shao, Jianjun Zhao, and Qichen Wang.
ACM Transactions on Software Engineering and Methodology (2026).
Yuechen Li, Minqi Shao, Jianjun Zhao, and Qichen Wang.
ACM Transactions on Software Engineering and Methodology (2026).
QEMI: A Quantum Software Stacks Testing Framework via Equivalence Modulo Inputs
Junjie Luo, Shangzhou Xia, Fuyuan Zhang, and Jianjun Zhao.
29th International Conference on Fundamental Approaches to Software Engineering (FASE 2026), LNCS 16504, 149-169.
Junjie Luo, Shangzhou Xia, Fuyuan Zhang, and Jianjun Zhao.
29th International Conference on Fundamental Approaches to Software Engineering (FASE 2026), LNCS 16504, 149-169.
QSolver: A Quantum Constraint Solver
Shangzhou Xia, Haitao Fu, and Jianjun Zhao.
48th IEEE/ACM International Conference on Software Engineering (ICSE 2026), New Ideas and Emerging Results (NIER), 71–75.
Shangzhou Xia, Haitao Fu, and Jianjun Zhao.
48th IEEE/ACM International Conference on Software Engineering (ICSE 2026), New Ideas and Emerging Results (NIER), 71–75.
Software Testing in the Quantum World
Rui Abreu, Shaukat Ali, Paolo Arcaini, José Campos, Michael Felderer, Claude Gravel, Fuyuki Ishikawa, Stefan Klikovits, Andriy Miranskyy, Anila Mjeda, Mohammad Reza Mousavi, Masaomi Yamaguchi, Lei Zhang, and Jianjun Zhao.
IEEE Computer, 59(4), 135–138.
Rui Abreu, Shaukat Ali, Paolo Arcaini, José Campos, Michael Felderer, Claude Gravel, Fuyuki Ishikawa, Stefan Klikovits, Andriy Miranskyy, Anila Mjeda, Mohammad Reza Mousavi, Masaomi Yamaguchi, Lei Zhang, and Jianjun Zhao.
IEEE Computer, 59(4), 135–138.
QSPE: Enumerating Skeletal Quantum Programs for Quantum Library Testing
Jiaming Ye, Fuyuan Zhang, Shangzhou Xia, Xiaoyu Guo, Xiongfei Wu, Jianjun Zhao, and Yinxing Xue.
arXiv:2602.00024 (2026).
Jiaming Ye, Fuyuan Zhang, Shangzhou Xia, Xiaoyu Guo, Xiongfei Wu, Jianjun Zhao, and Yinxing Xue.
arXiv:2602.00024 (2026).
2025
QMon: Monitoring the Execution of Quantum Circuits with Mid-Circuit Measurement and Reset
Ning Ma, Jianjun Zhao, Foutse Khomh, Shaukat Ali, and Heng Li.
arXiv:2512.13422 (2025).
Ning Ma, Jianjun Zhao, Foutse Khomh, Shaukat Ali, and Heng Li.
arXiv:2512.13422 (2025).
QuanBench: Benchmarking Quantum Code Generation with Large Language Models
Xiaoyu Guo, Minggu Wang, and Jianjun Zhao.
40th IEEE/ACM International Conference on Automated Software Engineering (ASE 2025), Research Papers, 2657-2669.
Xiaoyu Guo, Minggu Wang, and Jianjun Zhao.
40th IEEE/ACM International Conference on Automated Software Engineering (ASE 2025), Research Papers, 2657-2669.
NovaQ: Improving Quantum Program Testing through Diversity-Guided Test Case Generation
Tiancheng Jin, Shangzhou Xia, and Jianjun Zhao.
40th IEEE/ACM International Conference on Automated Software Engineering (ASE 2025), NIER, 3881-3885.
Tiancheng Jin, Shangzhou Xia, and Jianjun Zhao.
40th IEEE/ACM International Conference on Automated Software Engineering (ASE 2025), NIER, 3881-3885.
Is Measurement Enough? Rethinking Output Validation in Quantum Program Testing
Jiaming Ye, Xiongfei Wu, Shangzhou Xia, Fuyuan Zhang, and Jianjun Zhao.
40th IEEE/ACM International Conference on Automated Software Engineering (ASE 2025), NIER, 3824-3828.
Jiaming Ye, Xiongfei Wu, Shangzhou Xia, Fuyuan Zhang, and Jianjun Zhao.
40th IEEE/ACM International Conference on Automated Software Engineering (ASE 2025), NIER, 3824-3828.
When Abstraction Breaks Physics: Rethinking Modular Design in Quantum Software
Jianjun Zhao.
40th IEEE/ACM International Conference on Automated Software Engineering (ASE 2025), NIER, 3886-3890.
Jianjun Zhao.
40th IEEE/ACM International Conference on Automated Software Engineering (ASE 2025), NIER, 3886-3890.
M2QCode: A Model-Driven Framework for Generating Multi-Platform Quantum Programs
Xiaoyu Guo, Shinobu Saito, and Jianjun Zhao.
40th IEEE/ACM International Conference on Automated Software Engineering (ASE 2025), Industry Showcase, 3639-3649.
Xiaoyu Guo, Shinobu Saito, and Jianjun Zhao.
40th IEEE/ACM International Conference on Automated Software Engineering (ASE 2025), Industry Showcase, 3639-3649.
QIRopt: An Optimization Method for Quantum Intermediate Representation
Junjie Luo, Haoyu Zhang, and Jianjun Zhao.
IEEE International Conference on Quantum Computing and Engineering (QCE 2025), 459-469.
Junjie Luo, Haoyu Zhang, and Jianjun Zhao.
IEEE International Conference on Quantum Computing and Engineering (QCE 2025), 459-469.
QuanUML: Towards A Modeling Language for Model-Driven Quantum Software Development
Xiaoyu Guo, Shinobu Saito, and Jianjun Zhao.
49th IEEE Annual Computers, Software, and Applications Conference (COMPSAC 2025), 1344-1349.
Xiaoyu Guo, Shinobu Saito, and Jianjun Zhao.
49th IEEE Annual Computers, Software, and Applications Conference (COMPSAC 2025), 1344-1349.
Quantum Concolic Testing
Shangzhou Xia, Jianjun Zhao, Fuyuan Zhang, and Xiaoyu Guo.
Proceedings of the ACM on Software Engineering, Vol. 2 (ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2025), Article ISSTA051, 1146-1166.
Shangzhou Xia, Jianjun Zhao, Fuyuan Zhang, and Xiaoyu Guo.
Proceedings of the ACM on Software Engineering, Vol. 2 (ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2025), Article ISSTA051, 1146-1166.
A Black-box Testing Framework for Oracle Quantum Programs
Peixun Long and Jianjun Zhao.
arXiv:2505.07243 (2025; revised 2026).
Peixun Long and Jianjun Zhao.
arXiv:2505.07243 (2025; revised 2026).
Quantum Software Engineering: Roadmap and Challenges Ahead
Juan Manuel Murillo, Jose Garcia-Alonso, Enrique Moguel, Johanna Barzen, Frank Leymann, Shaukat Ali, Tao Yue, Paolo Arcaini, Ricardo Pérez-Castillo, Ignacio García-Rodríguez de Guzmán, Mario Piattini, Antonio Ruiz-Cortés, Antonio Brogi, Jianjun Zhao, Andriy Miranskyy, and Manuel Wimmer.
ACM Transactions on Software Engineering and Methodology, 34(5), Article 154.
Juan Manuel Murillo, Jose Garcia-Alonso, Enrique Moguel, Johanna Barzen, Frank Leymann, Shaukat Ali, Tao Yue, Paolo Arcaini, Ricardo Pérez-Castillo, Ignacio García-Rodríguez de Guzmán, Mario Piattini, Antonio Ruiz-Cortés, Antonio Brogi, Jianjun Zhao, Andriy Miranskyy, and Manuel Wimmer.
ACM Transactions on Software Engineering and Methodology, 34(5), Article 154.
The Quantum Program Dependence Graph and Its Uses in Quantum Software Development
Haibo Yu and Jianjun Zhao.
6th IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2025), 48–55.
Haibo Yu and Jianjun Zhao.
6th IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2025), 48–55.
Unveiling Code Clones in Quantum Programming: An Empirical Study with Qiskit
Kenta Manoku and Jianjun Zhao.
arXiv:2501.06420 (2025).
Kenta Manoku and Jianjun Zhao.
arXiv:2501.06420 (2025).
Formalization of Quantum Intermediate Representations for Code Safety
Junjie Luo and Jianjun Zhao.
Journal of Systems and Software, 219, Article 112236.
Junjie Luo and Jianjun Zhao.
Journal of Systems and Software, 219, Article 112236.
2024
A Coverage-Guided Testing Framework for Quantum Neural Networks
Minqi Shao and Jianjun Zhao.
arXiv:2411.02450 (2024).
Minqi Shao and Jianjun Zhao.
arXiv:2411.02450 (2024).
Testing Multi-Subroutine Quantum Programs: From Unit Testing to Integration Testing
Peixun Long and Jianjun Zhao.
ACM Transactions on Software Engineering and Methodology, 33(6), Article 147.
Peixun Long and Jianjun Zhao.
ACM Transactions on Software Engineering and Methodology, 33(6), Article 147.
Towards an Architecture Description Language for Hybrid Quantum-Classical Systems
Jianjun Zhao.
IEEE International Conference on Quantum Software (QSW 2024), 19–23.
Jianjun Zhao.
IEEE International Conference on Quantum Software (QSW 2024), 19–23.
Quantum Circuit Ansatz: Patterns of Abstraction and Reuse of Quantum Algorithm Design
Xiaoyu Guo, Takahiro Muta, and Jianjun Zhao.
IEEE International Conference on Quantum Software (QSW 2024), 69–80.
Xiaoyu Guo, Takahiro Muta, and Jianjun Zhao.
IEEE International Conference on Quantum Software (QSW 2024), 69–80.
Equivalence, Identity, and Unitarity Checking in Black-Box Testing of Quantum Programs
Peixun Long and Jianjun Zhao.
Journal of Systems and Software, 211, Article 112000.
Peixun Long and Jianjun Zhao.
Journal of Systems and Software, 211, Article 112000.
On Repairing Quantum Programs Using ChatGPT
Xiaoyu Guo, Jianjun Zhao, and Pengzhan Zhao.
5th IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2024), 9–16.
Xiaoyu Guo, Jianjun Zhao, and Pengzhan Zhao.
5th IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2024), 9–16.
2023
Bugs4Q: A Benchmark of Existing Bugs to Enable Controlled Testing and Debugging Studies for Quantum Programs
Pengzhan Zhao, Zhongtao Miao, Shuhan Lan, and Jianjun Zhao.
Journal of Systems and Software, 205, Article 111805.
Pengzhan Zhao, Zhongtao Miao, Shuhan Lan, and Jianjun Zhao.
Journal of Systems and Software, 205, Article 111805.
Earlier version: Bugs4Q: A Benchmark of Real Bugs for Quantum Programs.
Pengzhan Zhao, Jianjun Zhao, Zhongtao Miao, and Shuhan Lan. 36th IEEE/ACM International Conference on Automated Software Engineering (ASE 2021), New Ideas and Emerging Results (NIER), 1373-1376.
Pengzhan Zhao, Jianjun Zhao, Zhongtao Miao, and Shuhan Lan. 36th IEEE/ACM International Conference on Automated Software Engineering (ASE 2021), New Ideas and Emerging Results (NIER), 1373-1376.
QuraTest: Integrating Quantum Specific Features in Quantum Program Testing
Jiaming Ye, Shangzhou Xia, Fuyuan Zhang, Paolo Arcaini, Lei Ma, Jianjun Zhao, and Fuyuki Ishikawa.
38th IEEE/ACM International Conference on Automated Software Engineering (ASE 2023), 1149–1161.
Jiaming Ye, Shangzhou Xia, Fuyuan Zhang, Paolo Arcaini, Lei Ma, Jianjun Zhao, and Fuyuki Ishikawa.
38th IEEE/ACM International Conference on Automated Software Engineering (ASE 2023), 1149–1161.
Enhancing Code Safety in Quantum Intermediate Representation
Junjie Luo and Jianjun Zhao.
38th IEEE/ACM International Conference on Automated Software Engineering (ASE 2023), New Ideas and Emerging Results (NIER), 1771–1775.
Junjie Luo and Jianjun Zhao.
38th IEEE/ACM International Conference on Automated Software Engineering (ASE 2023), New Ideas and Emerging Results (NIER), 1771–1775.
On Refactoring Quantum Programs in Q#
Jianjun Zhao.
IEEE International Conference on Quantum Computing and Engineering (QCE 2023), 169–172.
Jianjun Zhao.
IEEE International Conference on Quantum Computing and Engineering (QCE 2023), 169–172.
ScaffML: A Quantum Behavioral Interface Specification Language for Scaffold
Tiancheng Jin and Jianjun Zhao.
IEEE International Conference on Quantum Software (QSW 2023), 128–137.
Tiancheng Jin and Jianjun Zhao.
IEEE International Conference on Quantum Software (QSW 2023), 128–137.
Best Paper Award (QSW 2023)
An Empirical Study of Bugs in Quantum Machine Learning Frameworks
Pengzhan Zhao, Xiongfei Wu, Junjie Luo, Zhuo Li, and Jianjun Zhao.
IEEE International Conference on Quantum Software (QSW 2023), 68-75.
Pengzhan Zhao, Xiongfei Wu, Junjie Luo, Zhuo Li, and Jianjun Zhao.
IEEE International Conference on Quantum Software (QSW 2023), 68-75.
Best Student Paper Award (QSW 2023)
QChecker: Detecting Bugs in Quantum Programs via Static Analysis
Pengzhan Zhao, Xiongfei Wu, Zhuo Li, and Jianjun Zhao.
4th IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2023), 50-57.
Pengzhan Zhao, Xiongfei Wu, Zhuo Li, and Jianjun Zhao.
4th IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2023), 50-57.
Static Entanglement Analysis of Quantum Programs
Shangzhou Xia and Jianjun Zhao.
4th IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2023).
Shangzhou Xia and Jianjun Zhao.
4th IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2023).
2022
Automated Synthesis of Quantum Circuits Using Neural Network
Kentaro Murakami and Jianjun Zhao.
22nd IEEE International Conference on Software Quality, Reliability and Security (QRS 2022), 694-702.
Kentaro Murakami and Jianjun Zhao.
22nd IEEE International Conference on Software Quality, Reliability and Security (QRS 2022), 694-702.
A Comprehensive Study of Bug Fixes in Quantum Programs
Junjie Luo, Pengzhan Zhao, Zhongtao Miao, Shuhan Lan, and Jianjun Zhao.
1st International Workshop on Quantum Software Analysis, Evolution and Reengineering (Q-SANER 2022), co-located with the IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2022), 1239-1246.
Junjie Luo, Pengzhan Zhao, Zhongtao Miao, Shuhan Lan, and Jianjun Zhao.
1st International Workshop on Quantum Software Analysis, Evolution and Reengineering (Q-SANER 2022), co-located with the IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2022), 1239-1246.
2021
Some Size and Structure Metrics for Quantum Software
Jianjun Zhao.
2nd IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2021), 22–27.
Jianjun Zhao.
2nd IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2021), 22–27.
Identifying Bug Patterns in Quantum Programs
Pengzhan Zhao, Jianjun Zhao, and Lei Ma.
2nd IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2021), 16–21.
Pengzhan Zhao, Jianjun Zhao, and Lei Ma.
2nd IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE 2021), 16–21.
2020
Current Status of Quantum Software Engineering
Jianjun Zhao.
IPSJ SIG Technical Report, Vol. 2020-QS-1, No. 1, pp. 1–9 (2020). (In Japanese).
Jianjun Zhao.
IPSJ SIG Technical Report, Vol. 2020-QS-1, No. 1, pp. 1–9 (2020). (In Japanese).
Quality Assurance for AI Systems (Selected)
2026
Precise Verification of Transformers Through ReLU-Catalyzed Abstraction Refinement
Hengjie Liu, Zhenya Zhang, and Jianjun Zhao.
38th International Conference on Computer Aided Verification (CAV 2026), 527–550.
Hengjie Liu, Zhenya Zhang, and Jianjun Zhao.
38th International Conference on Computer Aided Verification (CAV 2026), 527–550.
A Comprehensive Study of Deep Learning Model Fixing Approaches
Hanmo You, Zan Wang, Zishuo Dong, Luanqi Mo, Jianjun Zhao, and Junjie Chen.
48th IEEE/ACM International Conference on Software Engineering (ICSE 2026).
Hanmo You, Zan Wang, Zishuo Dong, Luanqi Mo, Jianjun Zhao, and Junjie Chen.
48th IEEE/ACM International Conference on Software Engineering (ICSE 2026).
ACM SIGSOFT Distinguished Paper Award (ICSE 2026)
META²V2V: Revealing Behavioural Deviations under Mutual Perception in Multi-Vehicle Autonomous Driving
Lejin Li, Xiao-Yi Zhang, Shuncheng Tang, Zhenya Zhang, and Jianjun Zhao.
48th IEEE/ACM International Conference on Software Engineering (ICSE 2026).
Lejin Li, Xiao-Yi Zhang, Shuncheng Tang, Zhenya Zhang, and Jianjun Zhao.
48th IEEE/ACM International Conference on Software Engineering (ICSE 2026).
2025
Automated Generation of Benchmarks for Falsification of STL Specifications
Yipei Yan, Deyun Lyu, Zhenya Zhang, Paolo Arcaini, Jianjun Zhao.
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol. 44, No. 10, 4004-4017, October 2025.
Yipei Yan, Deyun Lyu, Zhenya Zhang, Paolo Arcaini, Jianjun Zhao.
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol. 44, No. 10, 4004-4017, October 2025.
SpectAcle: Fault Localisation of AI-Enabled CPS by Exploiting Sequences of DNN Controller Inferences
Deyun Lyu, Zhenya Zhang, Paolo Arcaini, Xiao-Yi Zhang, Fuyuki Ishikawa, and Jianjun Zhao.
ACM Transactions on Software Engineering and Methodology, 34(4), Article 110, 1-35.
Deyun Lyu, Zhenya Zhang, Paolo Arcaini, Xiao-Yi Zhang, Fuyuki Ishikawa, and Jianjun Zhao.
ACM Transactions on Software Engineering and Methodology, 34(4), Article 110, 1-35.
Efficient Incremental Verification of Neural Networks Guided by Counterexample Potentiality
Guanqin Zhang, Zhenya Zhang, Dilum Bandara, Shiping Chen, Jianjun Zhao, Yulei Sui.
Proceedings of the ACM on Programming Languages, 9(OOPSLA1), Article 83, 85-112.
Guanqin Zhang, Zhenya Zhang, Dilum Bandara, Shiping Chen, Jianjun Zhao, Yulei Sui.
Proceedings of the ACM on Programming Languages, 9(OOPSLA1), Article 83, 85-112.
2024
LRR: Language-Driven Resamplable Continuous Representation against Adversarial Tracking Attacks
Jianlang Chen, Xuhong Ren, Qing Guo, Felix Juefei-Xu, Di Lin, Wei Feng, Lei Ma, Jianjun Zhao.
12th International Conference on Learning Representations (ICLR 2024).
Jianlang Chen, Xuhong Ren, Qing Guo, Felix Juefei-Xu, Di Lin, Wei Feng, Lei Ma, Jianjun Zhao.
12th International Conference on Learning Representations (ICLR 2024).
2023
DeepRover: A Query-efficient Blackbox Attack for Deep Neural Networks
Fuyuan Zhang, Xinwen Hu, Lei Ma, and Jianjun Zhao.
31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2023), 1384–1394.
Fuyuan Zhang, Xinwen Hu, Lei Ma, and Jianjun Zhao.
31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2023), 1384–1394.
Generative Model-Based Testing on Decision-Making Policies
Zhuo Li, Xiongfei Wu, Derui Zhu, Mingfei Cheng, Siyuan Chen, Fuyuan Zhang, Xiaofei Xie, Lei Ma, Jianjun Zhao.
38th IEEE/ACM International Conference on Automated Software Engineering (ASE 2023), 243-254.
Zhuo Li, Xiongfei Wu, Derui Zhu, Mingfei Cheng, Siyuan Chen, Fuyuan Zhang, Xiaofei Xie, Lei Ma, Jianjun Zhao.
38th IEEE/ACM International Conference on Automated Software Engineering (ASE 2023), 243-254.
ArchRepair: Block-Level Architecture-Oriented Repairing for Deep Neural Networks
Hua Qi, Zhijie Wang, Qing Guo, Jianlang Chen, Felix Juefei-Xu, Fuyuan Zhang, Lei Ma, and Jianjun Zhao.
ACM Transactions on Software Engineering and Methodology, Vol. 32, No. 5, 1-31, July 2023.
Hua Qi, Zhijie Wang, Qing Guo, Jianlang Chen, Felix Juefei-Xu, Fuyuan Zhang, Lei Ma, and Jianjun Zhao.
ACM Transactions on Software Engineering and Methodology, Vol. 32, No. 5, 1-31, July 2023.
GenCoG: A DSL-Based Approach to Generating Computation Graphs for TVM Testing
Zihan Wang, Pengbo Nie, Xinyuan Miao, Yuting Chen, Chengcheng Wan, Lei Bu, and Jianjun Zhao.
32nd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2023), 904-916.
Zihan Wang, Pengbo Nie, Xinyuan Miao, Yuting Chen, Chengcheng Wan, Lei Bu, and Jianjun Zhao.
32nd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2023), 904-916.
Evading DeepFake Detectors via Adversarial Statistical Consistency
Yang Hou, Qing Guo, Yihao Huang, Xiaofei Xie, Lei Ma, Jianjun Zhao.
IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR 2023), 12271-12280.
Yang Hou, Qing Guo, Yihao Huang, Xiaofei Xie, Lei Ma, Jianjun Zhao.
IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR 2023), 12271-12280.
FalsifAI: Falsification of AI-Enabled Hybrid Control Systems Guided by Time-Aware Coverage Criteria
Zhenya Zhang, Deyun Lyu, Paolo Arcaini, Lei Ma, Ichiro Hasuo, Jianjun Zhao.
IEEE Transactions on Software Engineering, Vol. 49, No. 4, 1842-1859, April 2023.
Zhenya Zhang, Deyun Lyu, Paolo Arcaini, Lei Ma, Ichiro Hasuo, Jianjun Zhao.
IEEE Transactions on Software Engineering, Vol. 49, No. 4, 1842-1859, April 2023.
2021
Learning to Adversarially Blur Visual Object Tracking
Qing Guo, Ziyi Cheng, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Yang Liu, Jianjun Zhao.
IEEE/CVF International Conference on Computer Vision (ICCV 2021), 10839-10848.
Qing Guo, Ziyi Cheng, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Yang Liu, Jianjun Zhao.
IEEE/CVF International Conference on Computer Vision (ICCV 2021), 10839-10848.
Effective Hybrid System Falsification Using Monte Carlo Tree Search Guided by QB-Robustness
Zhenya Zhang, Deyun Lyu, Paolo Arcaini, Lei Ma, Ichiro Hasuo, and Jianjun Zhao.
33rd International Conference on Computer-Aided Verification (CAV 2021), 595-618.
Zhenya Zhang, Deyun Lyu, Paolo Arcaini, Lei Ma, Ichiro Hasuo, and Jianjun Zhao.
33rd International Conference on Computer-Aided Verification (CAV 2021), 595-618.
2020
An Empirical Study on Robustness of DNNs with Out-of-Distribution Awareness
Lingjun Zhou, Bing Yu, David Berend, Xiaofei Xie, Xiaohong Li, Jianjun Zhao, and Xusheng Liu.
27th Asia-Pacific Software Engineering Conference (APSEC 2020), 266-275.
Lingjun Zhou, Bing Yu, David Berend, Xiaofei Xie, Xiaohong Li, Jianjun Zhao, and Xusheng Liu.
27th Asia-Pacific Software Engineering Conference (APSEC 2020), 266-275.
Best Paper Award (APSEC 2020)
DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Hua Qi, Qing Guo, Felix Juefei-Xu, Xiaofei Xie, Lei Ma, Wei Feng, Yang Liu, and Jianjun Zhao.
The 28th ACM International Conference on Multimedia (ACM MM 2020), 4318-4327.
Hua Qi, Qing Guo, Felix Juefei-Xu, Xiaofei Xie, Lei Ma, Wei Feng, Yang Liu, and Jianjun Zhao.
The 28th ACM International Conference on Multimedia (ACM MM 2020), 4318-4327.
Marble: Model-Based Robustness Analysis of Stateful Deep Learning Systems
Xiaoning Du, Yi Li, Xiaofei Xie, Lei Ma, Yang Liu, Jianjun Zhao.
35th IEEE/ACM International Conference on Automated Software Engineering (ASE 2020), 423-435.
Xiaoning Du, Yi Li, Xiaofei Xie, Lei Ma, Yang Liu, Jianjun Zhao.
35th IEEE/ACM International Conference on Automated Software Engineering (ASE 2020), 423-435.
Cats Are Not Fish: Deep Learning Testing Calls for Out-Of-Distribution Awareness
David Berend, Xiaofei Xie, Lei Ma, Lingjun Zhou, Yang Liu, Chi Xu, and Jianjun Zhao.
35th IEEE/ACM International Conference on Automated Software Engineering (ASE 2020), 1041-1052.
David Berend, Xiaofei Xie, Lei Ma, Lingjun Zhou, Yang Liu, Chi Xu, and Jianjun Zhao.
35th IEEE/ACM International Conference on Automated Software Engineering (ASE 2020), 1041-1052.
Towards Characterizing Adversarial Defects of Deep Learning Software from the Lens of Uncertainty
Xiyue Zhang, Xiaofei Xie, Lei Ma, Xiaoning Du, Qiang Hu, Yang Liu, Jianjun Zhao, and Meng Sun.
42nd International Conference on Software Engineering (ICSE 2020).
Xiyue Zhang, Xiaofei Xie, Lei Ma, Xiaoning Du, Qiang Hu, Yang Liu, Jianjun Zhao, and Meng Sun.
42nd International Conference on Software Engineering (ICSE 2020).
2019
An Empirical Study towards Characterizing Deep Learning Development and Deployment across Different Frameworks and Platforms
Qianyu Guo, Sen Chen, Xiaofei Xie, Lei Ma, Qiang Hu, Hongtao Liu, Yang Liu, Jianjun Zhao, Xiaohong Li.
34th IEEE/ACM Conference on Automated Software Engineering (ASE 2019), 810-822.
Qianyu Guo, Sen Chen, Xiaofei Xie, Lei Ma, Qiang Hu, Hongtao Liu, Yang Liu, Jianjun Zhao, Xiaohong Li.
34th IEEE/ACM Conference on Automated Software Engineering (ASE 2019), 810-822.
DeepStellar: Model-Based Quantitative Analysis of Stateful Deep Learning Systems
Xiaoning Du, Xiaofei Xie, Yi Li, Lei Ma, Yang Liu and Jianjun Zhao.
27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2019), 477-487.
Xiaoning Du, Xiaofei Xie, Yi Li, Lei Ma, Yang Liu and Jianjun Zhao.
27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2019), 477-487.
DeepHunter: A Coverage-Guided Fuzz Testing Framework for Deep Neural Networks
Xiaofei Xie, Lei Ma, Felix Juefei-Xu, Minhui Xue, Hongxu Chen, Yang Liu, Jianjun Zhao, Bo Li, Jianxiong Yin, and Simon See.
ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2019), 146–157.
Xiaofei Xie, Lei Ma, Felix Juefei-Xu, Minhui Xue, Hongxu Chen, Yang Liu, Jianjun Zhao, Bo Li, Jianxiong Yin, and Simon See.
ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2019), 146–157.
2018
DeepMutation: Mutation Testing of Deep Learning Systems
Lei Ma, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Felix Juefei-Xu, Chao Xie, Li Li, Yang Liu, Jianjun Zhao, and Yadong Wang.
29th IEEE International Symposium on Software Reliability Engineering (ISSRE 2018), 100–111.
Lei Ma, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Felix Juefei-Xu, Chao Xie, Li Li, Yang Liu, Jianjun Zhao, and Yadong Wang.
29th IEEE International Symposium on Software Reliability Engineering (ISSRE 2018), 100–111.
DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems
Lei Ma, Felix Juefei-Xu, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Chunyang Chen, Ting Su, Li Li, Yang Liu, Jianjun Zhao, and Yadong Wang.
33rd IEEE/ACM International Conference on Automated Software Engineering (ASE 2018), 120–131.
Lei Ma, Felix Juefei-Xu, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Chunyang Chen, Ting Su, Li Li, Yang Liu, Jianjun Zhao, and Yadong Wang.
33rd IEEE/ACM International Conference on Automated Software Engineering (ASE 2018), 120–131.
ACM SIGSOFT Distinguished Paper Award (ASE 2018)
Software Engineering and Programming Languages (Selected)
2016
Efficient and Precise Dynamic Slicing for Client-Side JavaScript Programs
Jiabin Ye, Cheng Zhang, Lei Ma, Haibo Yu, and Jianjun Zhao.
23rd IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2016), 449-459.
Jiabin Ye, Cheng Zhang, Lei Ma, Haibo Yu, and Jianjun Zhao.
23rd IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2016), 449-459.
Best Paper Candidate Award (SANER 2016)
2014
AspectBreeze: Integrating Trustworthiness Aspects into Graph Grammar Supported Architecture Description Language
Jingzhou Liu, Yuting Chen, Chen Li, and Jianjun Zhao.
6th Asia-Pacific Symposium on Internetware (Internetware 2014), 80-88.
Jingzhou Liu, Yuting Chen, Chen Li, and Jianjun Zhao.
6th Asia-Pacific Symposium on Internetware (Internetware 2014), 80-88.
A Constraint-weaving Approach to Points-to Analysis for AspectJ
Qiang Sun, Yuting Chen, and Jianjun Zhao.
Frontiers of Computer Science, 8(1), 52-68 (2014).
Qiang Sun, Yuting Chen, and Jianjun Zhao.
Frontiers of Computer Science, 8(1), 52-68 (2014).
2009
Incremental Call Graph Reanalysis for AspectJ Software
Yu Lin, Sai Zhang, and Jianjun Zhao.
25th IEEE International Conference on Software Maintenance (ICSM 2009), 301-315.
Yu Lin, Sai Zhang, and Jianjun Zhao.
25th IEEE International Conference on Software Maintenance (ICSM 2009), 301-315.
Identifying Semantic Differences in AspectJ Programs
Martin Gorg and Jianjun Zhao.
ACM SIGSOFT International Conference on Software Testing and Analysis (ISSTA 2009), 25-36.
Martin Gorg and Jianjun Zhao.
ACM SIGSOFT International Conference on Software Testing and Analysis (ISSTA 2009), 25-36.
2008
AutoFlow: An Automatic Debugging tool for AspectJ Software
Sai Zhang, Zhongxian Gu, Yu Lin, and Jianjun Zhao.
24th IEEE International Conference on Software Maintenance (ICSM 2008), 470-471. Poster Track.
Sai Zhang, Zhongxian Gu, Yu Lin, and Jianjun Zhao.
24th IEEE International Conference on Software Maintenance (ICSM 2008), 470-471. Poster Track.
XFindBugs: eXtended FindBugs for AspectJ
Haihao Shen, Sai Zhang, Jianjun Zhao, Jianhong Fang, and Shiyuan Rao.
8th ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering (PASTE 2008), 70-76.
Haihao Shen, Sai Zhang, Jianjun Zhao, Jianhong Fang, and Shiyuan Rao.
8th ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering (PASTE 2008), 70-76.
Change Impact Analysis for AspectJ Programs
Sai Zhang, Zhongxian Gu, Yu Lin, and Jianjun Zhao.
24th IEEE International Conference on Software Maintenance (ICSM 2008), 87-96.
Sai Zhang, Zhongxian Gu, Yu Lin, and Jianjun Zhao.
24th IEEE International Conference on Software Maintenance (ICSM 2008), 87-96.
Aspect-Aware Points-to Analysis
Qiang Sun and Jianjun Zhao.
8th IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM 2008), 143-152.
Qiang Sun and Jianjun Zhao.
8th IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM 2008), 143-152.
Maintenance Support for Aspect-oriented Programs: Opportunities and Challenges
Jianjun Zhao.
24th IEEE International Conference on Software Maintenance (ICSM 2008), 482-483. Short paper.
Jianjun Zhao.
24th IEEE International Conference on Software Maintenance (ICSM 2008), 482-483. Short paper.
An Empirical Study of Maintainability in Aspect-Oriented System Evolution Using Coupling Metrics
Haihao Shen, Sai Zhang, and Jianjun Zhao.
2nd IFIP/IEEE International Symposium on Theoretical Aspects of Software Engineering (TASE 2008), 233-236.
Haihao Shen, Sai Zhang, and Jianjun Zhao.
2nd IFIP/IEEE International Symposium on Theoretical Aspects of Software Engineering (TASE 2008), 233-236.
Celadon: A Change Impact Analysis Tool for Aspect-Oriented Programs
Sai Zhang, Zhongxian Gu, Yu Lin, and Jianjun Zhao.
30th International Conference on Software Engineering (ICSE 2008), 913-914. Informal Demonstration Track.
Sai Zhang, Zhongxian Gu, Yu Lin, and Jianjun Zhao.
30th International Conference on Software Engineering (ICSE 2008), 913-914. Informal Demonstration Track.
Flota: A Programmer Assistant for Locating Faulty Changes in AspectJ Software Evolution
Sai Zhang, Zhongxian Gu, Yu Lin, and Jianjun Zhao.
4th International Linking Aspect Technology and Evolution Workshop (LATE 2008).
Sai Zhang, Zhongxian Gu, Yu Lin, and Jianjun Zhao.
4th International Linking Aspect Technology and Evolution Workshop (LATE 2008).
2007
On Identifying Bug Patterns in Aspect-Oriented Programs
Sai Zhang and Jianjun Zhao.
31st IEEE Annual International Computer Software and Applications Conference (COMPSAC 2007), Vol. 1, 431-438.
Sai Zhang and Jianjun Zhao.
31st IEEE Annual International Computer Software and Applications Conference (COMPSAC 2007), Vol. 1, 431-438.
Specifying Pointcuts in AspectJ
Yi Wang and Jianjun Zhao.
31st IEEE Annual International Computer Software and Applications Conference (COMPSAC 2007), Vol. 2, 5-10.
Yi Wang and Jianjun Zhao.
31st IEEE Annual International Computer Software and Applications Conference (COMPSAC 2007), Vol. 2, 5-10.
Perspectives on Automated Testing of Aspect-Oriented Programs
Tao Xie and Jianjun Zhao.
3rd Workshop on Testing Aspect-Oriented Programs (WTAOP 2007), 7-12.
Tao Xie and Jianjun Zhao.
3rd Workshop on Testing Aspect-Oriented Programs (WTAOP 2007), 7-12.
2006
Detecting Redundant Unit Tests for AspectJ Programs
Tao Xie, Jianjun Zhao, Darko Marinov, and David Notkin.
17th IEEE International Conference on Software Reliability Engineering (ISSRE 2006), 179-188.
Tao Xie, Jianjun Zhao, Darko Marinov, and David Notkin.
17th IEEE International Conference on Software Reliability Engineering (ISSRE 2006), 179-188.
Control-Flow Analysis and Representation of Aspect-Oriented Programs
Jianjun Zhao.
6th International Conference on Quality Software (QSIC 2006), 38-48.
Jianjun Zhao.
6th International Conference on Quality Software (QSIC 2006), 38-48.
Towards Regression Test Selection for Aspect-Oriented Programs
Jianjun Zhao, Tao Xie, and Nan Li.
2nd Workshop on Testing Aspect-Oriented Programs (WTAOP 2006).
Jianjun Zhao, Tao Xie, and Nan Li.
2nd Workshop on Testing Aspect-Oriented Programs (WTAOP 2006).
A Framework and Tool Supports for Generating Test Inputs of AspectJ Programs
Tao Xie and Jianjun Zhao.
5th International Conference on Aspect-Oriented Software Development (AOSD 2006), 190-201.
Tao Xie and Jianjun Zhao.
5th International Conference on Aspect-Oriented Software Development (AOSD 2006), 190-201.
2005
Automated test generation for AspectJ programs
Tao Xie, Jianjun Zhao, Darko Marinov, and David Notkin.
Workshop on Testing Aspect-Oriented Programs (WTAOP 2005), 1-6.
Tao Xie, Jianjun Zhao, Darko Marinov, and David Notkin.
Workshop on Testing Aspect-Oriented Programs (WTAOP 2005), 1-6.
Architectural Slicing in Supporting System Evolution
Jianjun Zhao and Limin Xiang.
Managing Corporate Information Systems Evolution and Maintenance, Chapter 8, 197-210 (2005).
Jianjun Zhao and Limin Xiang.
Managing Corporate Information Systems Evolution and Maintenance, Chapter 8, 197-210 (2005).
2004
Measuring Coupling in Aspect-Oriented Systems
Jianjun Zhao.
10th International Software Metrics Symposium (METRICS 2004). Late Breaking Paper.
Jianjun Zhao.
10th International Software Metrics Symposium (METRICS 2004). Late Breaking Paper.
Complexity Metrics for Software Architectures
Jianjun Zhao.
IEICE Transactions 87-D(8): 2152-2156 (2004).
Jianjun Zhao.
IEICE Transactions 87-D(8): 2152-2156 (2004).
Measuring Aspect Cohesion
Jianjun Zhao and Baowen Xu.
Fundamental Approaches to Software Engineering (FASE 2004), 54-68.
Jianjun Zhao and Baowen Xu.
Fundamental Approaches to Software Engineering (FASE 2004), 54-68.
2003
Data-Flow-Based Unit Testing of Aspect-Oriented Programs
Jianjun Zhao.
27th Annual International Computer Software and Applications Conference (COMPSAC 2003), 188–197.
Jianjun Zhao.
27th Annual International Computer Software and Applications Conference (COMPSAC 2003), 188–197.
Refactoring Aspect-Oriented Programs
Masanori Iwamoto and Jianjun Zhao.
4th AOSD Modeling with UML Workshop, co-located with UML 2003.
Masanori Iwamoto and Jianjun Zhao.
4th AOSD Modeling with UML Workshop, co-located with UML 2003.
Pipa: A Behavioral Interface Specification Language for AspectJ
Jianjun Zhao and Martin Rinard.
Fundamental Approaches to Software Engineering (FASE 2003), 150-165.
Jianjun Zhao and Martin Rinard.
Fundamental Approaches to Software Engineering (FASE 2003), 150-165.
2002
Tool Support for Unit Testing of Aspect-oriented Software
Jianjun Zhao.
Workshop on Tools for Aspect-Oriented Software Development, co-located with OOPSLA 2002.
Jianjun Zhao.
Workshop on Tools for Aspect-Oriented Software Development, co-located with OOPSLA 2002.
Change Impact Analysis to Support Architectural Evolution
Jianjun Zhao, Hongji Yang, Limin Xiang, and Baowen Xu.
Journal of Software Maintenance and Evolution: Research and Practice, Vol. 14, No. 5, 317-333, 2002, John Wiley & Sons.
Jianjun Zhao, Hongji Yang, Limin Xiang, and Baowen Xu.
Journal of Software Maintenance and Evolution: Research and Practice, Vol. 14, No. 5, 317-333, 2002, John Wiley & Sons.
Slicing Aspect-Oriented Software
Jianjun Zhao.
10th IEEE International Workshop on Program Comprehension (IWPC 2002), 251-260.
Jianjun Zhao.
10th IEEE International Workshop on Program Comprehension (IWPC 2002), 251-260.
Change Impact Analysis for Aspect-Oriented Software Evolution
Jianjun Zhao.
5th International Workshop on Principles of Software Evolution (IWPSE 2002), 108-112.
Jianjun Zhao.
5th International Workshop on Principles of Software Evolution (IWPSE 2002), 108-112.
2001
Architectural-level Metrics for Software Systems
Jianjun Zhao.
6th International Conference for Young Computer Scientists (ICYCS 2001), 29-33.
Jianjun Zhao.
6th International Conference for Young Computer Scientists (ICYCS 2001), 29-33.
Change Impact Analysis for Architectural Evolution
Jianjun Zhao.
Workshop on Formal Foundations for Software Evolution (2001).
Jianjun Zhao.
Workshop on Formal Foundations for Software Evolution (2001).
2000
A Slicing-Based Approach to Extracting Reusable Software Architectures
Jianjun Zhao.
4th European Conference on Software Maintenance and Reengineering (CSMR 2000), 215-223.
Jianjun Zhao.
4th European Conference on Software Maintenance and Reengineering (CSMR 2000), 215-223.
1999
Dependence Analysis at the Architectural Level
Jianjun Zhao.
Chinese Journal of Advanced Software Research, Vol. 6, No. 2, 164-168, Allerton Press Inc., December 1999.
Jianjun Zhao.
Chinese Journal of Advanced Software Research, Vol. 6, No. 2, 164-168, Allerton Press Inc., December 1999.
Slicing Concurrent Java Programs
Jianjun Zhao.
IEEE International Workshop on Program Comprehension (IWPC 1999), 126–133.
Jianjun Zhao.
IEEE International Workshop on Program Comprehension (IWPC 1999), 126–133.
1998
On Assessing the Complexity of Software Architectures
Jianjun Zhao.
3rd International Software Architecture Workshop (ISAW 1998), 163-166.
Jianjun Zhao.
3rd International Software Architecture Workshop (ISAW 1998), 163-166.
Applying Slicing Technique to Software Architectures
Jianjun Zhao.
IEEE International Conference on Engineering of Complex Computer Systems (ICECCS 1998), 87–98.
Jianjun Zhao.
IEEE International Conference on Engineering of Complex Computer Systems (ICECCS 1998), 87–98.
1997
Using Dependence Analysis to Support Software Architecture Understanding
Jianjun Zhao.
New Technologies on Computer Software, 135-142 (1997).
Jianjun Zhao.
New Technologies on Computer Software, 135-142 (1997).
