Da Song

song_da[at]sdu[dot]edu[dot]cn

prof_pic_color.jpg

I am currently a Research-track Assistant Professor at School of Cryptologic Science and Engineering, Shandong University, based in Jinan, Shandong, China.

My research primarily focuses on the Security and Quality Assurance of AI Agents. I investigate methods to ensure LLMs reliability and safety in dynamic environments. My work emphasizes testing, evaluation, and alignment verification for agentic workflows. I am dedicated to building trustworthy agent systems that can operate securely in complex, real-world scenarios. I have published papers at top-tier venues, including TSE, ICSE, ASE, and CHI. Meanwhile, I have been invited to serve on the program committees for FSE’26.

Previously, I was a CIFAR AI Safety Postdoctoral Fellow at Mila, supervised by Dr. Foutse Khomh, with Dr. Lei Ma and Dr. Randy Goebel as co-supervisors. I obtained my Ph.D. from the University of Alberta in 2025, and earned my B.S. in Computer Science from the University of Minnesota. I have also collaborated extensively with Dr. Tianyi Zhang on topics bridging SE and HCI.

I am always open to discussing new research ideas and collaborations. Feel free to reach out via email or connect with me on LinkedIn.

NEWS

Jan 01, 2026 I am excited to announce that I have joined the School of Cryptologic Science and Engineering at Shandong University as a Research-track Assistant Professor based in Jinan, China.
Sep 11, 2025 One paper was accepted by ASE 2025 Demo track! Congratulations to Ruoyu.
Jul 28, 2025 I have joined Mila as a Postdoctoral Fellow to continue my research on trustworthy and reliable AI systems.
Jun 26, 2025 I have successfully passed my Ph.D. Final Defense! Feel free to call me Dr. Song now 😉.
Jan 30, 2025 Two papers were accepted by ICSE 2025. See you in Ottawa 🇨🇦!

SELECTED PUBLICATIONS

  1. trustvis.png
    TRUSTVIS: A Multi-Dimensional Trustworthiness Evaluation Framework for Large Language Models
    Ruoyu Sun, Da Song†, Jiayang Song, Yuheng Huang, and Lei Ma
    ASE 2025 Tool Demonstration Track, 2025
  2. code_error.png
    Towards Understanding the Characteristics of Code Generation Errors Made by Large Language Models
    Zhijie Wang*, Zijie Zhou*, Da Song*, Yuheng Huang, Shengmai Chen, Lei Ma, and Tianyi Zhang
    In 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE), 2025
  3. luna.png
    Luna: A model-based universal analysis framework for large language models
    Da Song, Xuan Xie, Jiayang Song, Derui Zhu, Yuheng Huang, Felix Juefei-Xu, and Lei Ma
    IEEE Transactions on Software Engineering, 2024
  4. deeplens.png
    DeepLens: interactive out-of-distribution data detection in NLP models
    Da Song, Zhijie Wang, Yuheng Huang, Lei Ma, and Tianyi Zhang
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023