Repositories list

• DecodingTrust-Agent-Platform

  Public
  Python

  •

  Apache License 2.0

  •1717 forks in AI-secure/DecodingTrust-Agent-Platform•104104 stars in AI-secure/DecodingTrust-Agent-Platform•44 issues in AI-secure/DecodingTrust-Agent-Platform•1010 pull requests in AI-secure/DecodingTrust-Agent-Platform•Updated Nov 14, 2026Nov 14, 2026

• AgentPoison

  Public
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"

  red-teamllm-agentretrieval-augmented-generation

  red-teamllm-agentretrieval-augmented-generation

  Python

  •

  MIT License

  •3535 forks in AI-secure/AgentPoison•256256 stars in AI-secure/AgentPoison•33 issues in AI-secure/AgentPoison•00 pull requests in AI-secure/AgentPoison•Updated Oct 23, 2026Oct 23, 2026

• RedCode

  Public
  [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents

  Python

  •

  MIT License

  •1010 forks in AI-secure/RedCode•9292 stars in AI-secure/RedCode•00 issues in AI-secure/RedCode•00 pull requests in AI-secure/RedCode•Updated Oct 20, 2026Oct 20, 2026

• SafeAuto

  Public
  [ICML 2025] SafeAuto: Knowledge-Enhanced Safe Autonomous Driving with Multimodal Foundation Models

  Python

  •22 forks in AI-secure/SafeAuto•3030 stars in AI-secure/SafeAuto•77 issues in AI-secure/SafeAuto•00 pull requests in AI-secure/SafeAuto•Updated Aug 2, 2026Aug 2, 2026

• ShieldNet

  Public
  JavaScript

  •00 forks in AI-secure/ShieldNet•00 stars in AI-secure/ShieldNet•00 issues in AI-secure/ShieldNet•00 pull requests in AI-secure/ShieldNet•Updated Mar 16, 2026Mar 16, 2026

• UDora

  Public
  [ICML 2025] UDora: A Unified Red Teaming Framework against LLM Agents

  Python

  •77 forks in AI-secure/UDora•4141 stars in AI-secure/UDora•11 issue in AI-secure/UDora•00 pull requests in AI-secure/UDora•Updated Jun 24, 2025Jun 24, 2025

• PolyGuard

  Public
  Python

  •33 forks in AI-secure/PolyGuard•2626 stars in AI-secure/PolyGuard•33 issues in AI-secure/PolyGuard•00 pull requests in AI-secure/PolyGuard•Updated Jun 18, 2025Jun 18, 2025

• AdvAgent

  Public
  Jupyter Notebook

  •00 forks in AI-secure/AdvAgent•2626 stars in AI-secure/AdvAgent•66 issues in AI-secure/AdvAgent•00 pull requests in AI-secure/AdvAgent•Updated May 28, 2025May 28, 2025

• MMDT

  Public
  Comprehensive Assessment of Trustworthiness in Multimodal Foundation Models

  Jupyter Notebook

  •22 forks in AI-secure/MMDT•2929 stars in AI-secure/MMDT•11 issue in AI-secure/MMDT•00 pull requests in AI-secure/MMDT•Updated Mar 15, 2025Mar 15, 2025

• aug-pe

  Public
  [ICML 2024 Spotlight] Differentially Private Synthetic Data via Foundation Model APIs 2: Text

  language-modeldifferential-privacyai-privacy+ 2

  language-modeldifferential-privacyai-privacylarge-language-modelsprompt-engineering

  Python

  •

  Apache License 2.0

  •2020 forks in AI-secure/aug-pe•6262 stars in AI-secure/aug-pe•11 issue in AI-secure/aug-pe•00 pull requests in AI-secure/aug-pe•Updated Jan 11, 2025Jan 11, 2025

• FedGame

  Public
  Official implementation for paper "FedGame: A Game-Theoretic Defense against Backdoor Attacks in Federated Learning" (NeurIPS 2023).

  Python

  •

  MIT License

  •00 forks in AI-secure/FedGame•1313 stars in AI-secure/FedGame•11 issue in AI-secure/FedGame•00 pull requests in AI-secure/FedGame•Updated Oct 25, 2024Oct 25, 2024

• VFL-ADMM

  Public
  Improving Privacy-Preserving Vertical Federated Learning by Efficient Communication with ADMM (SaTML 2024)

  Python

  •

  Apache License 2.0

  •11 fork in AI-secure/VFL-ADMM•55 stars in AI-secure/VFL-ADMM•00 issues in AI-secure/VFL-ADMM•00 pull requests in AI-secure/VFL-ADMM•Updated Oct 21, 2024Oct 21, 2024

• DecodingTrust

  Public
  A Comprehensive Assessment of Trustworthiness in GPT Models

  Python

  •

  Creative Commons Attribution Share Alike 4.0 International

  •6262 forks in AI-secure/DecodingTrust•320320 stars in AI-secure/DecodingTrust•1313 issues in AI-secure/DecodingTrust•22 pull requests in AI-secure/DecodingTrust•Updated Sep 16, 2024Sep 16, 2024

• helm

  Public
  Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).

  Python

  •

  Apache License 2.0

  •436436 forks in AI-secure/helm•00 stars in AI-secure/helm•00 issues in AI-secure/helm•22 pull requests in AI-secure/helm•Updated Jun 12, 2024Jun 12, 2024

• DPFL-Robustness

  Public
  [CCS 2023] Unraveling the Connections between Privacy and Certified Robustness in Federated Learning Against Poisoning Attacks

  Python

  •00 forks in AI-secure/DPFL-Robustness•66 stars in AI-secure/DPFL-Robustness•00 issues in AI-secure/DPFL-Robustness•00 pull requests in AI-secure/DPFL-Robustness•Updated Feb 15, 2024Feb 15, 2024

• hf-blog

  Public
  Public repo for HF blog posts

  Jupyter Notebook

  •1.1k1.1k forks in AI-secure/hf-blog•00 stars in AI-secure/hf-blog•00 issues in AI-secure/hf-blog•00 pull requests in AI-secure/hf-blog•Updated Jan 26, 2024Jan 26, 2024

• DecodingTrust-Data-Legacy

  Public
  Python

  •00 forks in AI-secure/DecodingTrust-Data-Legacy•00 stars in AI-secure/DecodingTrust-Data-Legacy•00 issues in AI-secure/DecodingTrust-Data-Legacy•00 pull requests in AI-secure/DecodingTrust-Data-Legacy•Updated Dec 25, 2023Dec 25, 2023

• TextGuard

  Public
  TextGuard: Provable Defense against Backdoor Attacks on Text Classification

  Python

  •11 fork in AI-secure/TextGuard•1515 stars in AI-secure/TextGuard•00 issues in AI-secure/TextGuard•00 pull requests in AI-secure/TextGuard•Updated Nov 7, 2023Nov 7, 2023

• InfoBERT

  Public
  [ICLR 2021] "InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective" by Boxin Wang, Shuohang Wang, Yu Cheng, Zhe Gan, Ruoxi…

  information-theorylanguage-modelsbert+ 4

  information-theorylanguage-modelsbertadversarial-attacksrobertaadversarial-defenseadversarial-robustness

  Python

  •1010 forks in AI-secure/InfoBERT•8585 stars in AI-secure/InfoBERT•11 issue in AI-secure/InfoBERT•00 pull requests in AI-secure/InfoBERT•Updated Oct 25, 2023Oct 25, 2023

• Robustness-Against-Backdoor-Attacks

  Public
  RAB: Provable Robustness Against Backdoor Attacks

  Python

  •88 forks in AI-secure/Robustness-Against-Backdoor-Attacks•4040 stars in AI-secure/Robustness-Against-Backdoor-Attacks•22 issues in AI-secure/Robustness-Against-Backdoor-Attacks•55 pull requests in AI-secure/Robustness-Against-Backdoor-Attacks•Updated Oct 3, 2023Oct 3, 2023

• semantic-randomized-smoothing

  Public
  [CCS 2021] TSS: Transformation-specific smoothing for robustness certification

  securitydeep-learningrobustness-verification

  securitydeep-learningrobustness-verification

  Roff

  •33 forks in AI-secure/semantic-randomized-smoothing•2626 stars in AI-secure/semantic-randomized-smoothing•00 issues in AI-secure/semantic-randomized-smoothing•55 pull requests in AI-secure/semantic-randomized-smoothing•Updated Oct 3, 2023Oct 3, 2023

• FLBenchmark-toolkit

  Public
  Federated Learning Framework Benchmark (UniFed)

  benchmarkmachine-learningfederated-learning

  benchmarkmachine-learningfederated-learning

  Python

  •

  Apache License 2.0

  •77 forks in AI-secure/FLBenchmark-toolkit•4848 stars in AI-secure/FLBenchmark-toolkit•55 issues in AI-secure/FLBenchmark-toolkit•00 pull requests in AI-secure/FLBenchmark-toolkit•Updated Jun 14, 2023Jun 14, 2023

• SecretGen

  Public
  A general model inversion attack against large pre-trained models.

  machine-learningprivacy

  machine-learningprivacy

  Python

  •

  MIT License

  •33 forks in AI-secure/SecretGen•66 stars in AI-secure/SecretGen•00 issues in AI-secure/SecretGen•00 pull requests in AI-secure/SecretGen•Updated Apr 22, 2023Apr 22, 2023

• adversarial-glue

  Public
  [NeurIPS 2021] "Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models" by Boxin Wang*, Chejian Xu*, Shuohang Wang, Zhe Gan, Yu C…

  nlpmachine-learningnlp-library+ 2

  nlpmachine-learningnlp-libraryadversarial-examplesadversarial-attacks

  Python

  •22 forks in AI-secure/adversarial-glue•1313 stars in AI-secure/adversarial-glue•00 issues in AI-secure/adversarial-glue•00 pull requests in AI-secure/adversarial-glue•Updated Apr 3, 2023Apr 3, 2023

• VeriGauge

  Public
  A united toolbox for running major robustness verification approaches for DNNs. [S&P 2023]

  deep-learningrobustnessverfication

  deep-learningrobustnessverfication

  C

  •88 forks in AI-secure/VeriGauge•9090 stars in AI-secure/VeriGauge•33 issues in AI-secure/VeriGauge•44 pull requests in AI-secure/VeriGauge•Updated Mar 24, 2023Mar 24, 2023

• Certified-Fairness

  Public
  [NeurIPS 2022] Code for Certifying Some Distributional Fairness with Subpopulation Decomposition

  Python

  •00 forks in AI-secure/Certified-Fairness•55 stars in AI-secure/Certified-Fairness•00 issues in AI-secure/Certified-Fairness•00 pull requests in AI-secure/Certified-Fairness•Updated Jan 3, 2023Jan 3, 2023

• CoPur

  Public
  CoPur: Certifiably Robust Collaborative Inference via Feature Purification (NeurIPS 2022)

  Python

  •11 fork in AI-secure/CoPur•1111 stars in AI-secure/CoPur•00 issues in AI-secure/CoPur•00 pull requests in AI-secure/CoPur•Updated Dec 7, 2022Dec 7, 2022

• transferability-versus-robustness

  Public
  Python

  •00 forks in AI-secure/transferability-versus-robustness•00 stars in AI-secure/transferability-versus-robustness•00 issues in AI-secure/transferability-versus-robustness•00 pull requests in AI-secure/transferability-versus-robustness•Updated Dec 6, 2022Dec 6, 2022

• DMLW2022

  Public
  HTML

  •11 fork in AI-secure/DMLW2022•11 star in AI-secure/DMLW2022•00 issues in AI-secure/DMLW2022•00 pull requests in AI-secure/DMLW2022•Updated Dec 3, 2022Dec 3, 2022

• Certified-Robustness-SoK-Oldver

  Public
  This repo keeps track of popular provable training and verification approaches towards robust neural networks, including leaderboards on popular datasets and pa…

  1010 forks in AI-secure/Certified-Robustness-SoK-Oldver•9797 stars in AI-secure/Certified-Robustness-SoK-Oldver•00 issues in AI-secure/Certified-Robustness-SoK-Oldver•00 pull requests in AI-secure/Certified-Robustness-SoK-Oldver•Updated Oct 18, 2022Oct 18, 2022