Selected Publications

You can also find a full list of my articles on my Google Scholar profile.

Chasing Shadows: Pitfalls in LLM Security Research

✍️ Jonathan Evertz*, Niklas Risse*, Nicolai Neuer, Andreas Müller, Philipp Normann, Gaetano Sapia, Srishti Gupta, David Pape, Soumya Shaw, Devansh Srivastav, Christian Wressnegger, Erwin Quiring, Thorsten Eisenhofer, Daniel Arp, Lea Schönherr

📕 Network and Distributed System Security Symposium 2026 (NDSS'26)

💡 We uncover nine pitfalls in LLM Security research that can compromise the validity of the research.

Paper | arXiv | Bibtex | Code

Top Score on the Wrong Exam: On Benchmarking in Machine Learning for Vulnerability Detection

✍️ Niklas Risse, Jing Liu, Marcel Böhme

🏆 ACM SIGSOFT Distinguished Paper Award

📕 ACM SIGSOFT International Symposium on Software Testing and Analysis 2025 (ISSTA'25)

💡 The most prevalent problem statement of ML4VD as function-level binary classification problem is ill-defined.

Paper | arXiv | Bibtex | Code

Uncovering the Limits of Machine Learning for Automatic Vulnerability Detection

✍️ Niklas Risse, Marcel Böhme

📕 USENIX Security Symposium 2024 (USENIX Sec'24)

💡 Are machine learning models for vulnerability detection as good as they seem?

Paper | arXiv | Bibtex | Code | Dataset

How to Compare Adversarial Robustness of Classifiers From a Global Perspective

✍️ Niklas Risse, Christina Göpfert, Jan Philip Göpfert

📕 International Conference on Artificial Neural Networks 2021 (ICANN'21)

💡 An alternative for point-wise measures of adversarial robustness.

Paper | arXiv | Bibtex | Code