HateBench: Benchmarking Hate Speech Detectors on LLM-Generated Content and Hate Campaigns

To Appear in the USENIX Security 2025
Xinyue Shen1, Yixin Wu1, Yiting Qu1, Michael Backes1, Savvas Zannettou2, Yang Zhang1
1CISPA Helmholtz Center for Information Security, 2TU Delft
PDF arXiv Code 🤗 Data

34 Identity Groups Covered in Our Study

The list is adopted from the Measuring Hate Speech project.


BibTeX

If you find this useful in your research, please consider citing:

@inproceedings{SWQBZZ25,
  author = {Xinyue Shen and Yixin Wu and Yiting Qu and Michael Backes and Savvas Zannettou and Yang Zhang},
  title = {{HateBench: Benchmarking Hate Speech Detectors on LLM-Generated Content and Hate Campaigns}},
  booktitle = {{USENIX Security Symposium (USENIX Security)}},
  publisher = {USENIX},
  year = {2025}
}