This repository is a WIP for EasyEdit, a wrapper extending MEMIT that combines document-level joint-entity and relation extraction with MEMIT so users can edit models directly from unstructured text.
The repository is a fork of SpecificityPlus [1], which is a fork of MEMIT [2]. MEMIT implements the model editing algorithms MEMIT (Mass Editing Memory in a Transformer) and ROME (Rank-One Model Editing). Specificity+ extends this code by additional evaluation scripts implementing the CounterFact+ benchmark.
TBD
TBD
[1] Hoelscher-Obermaier, Jason, et al. "Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmark." Findings of ACL (2023)
[2] Meng, Kevin, et al. "Mass-editing memory in a transformer." arXiv preprint arXiv:2210.07229 (2022).