Skip to content

Reproducing Evaluation #9

Description

@song1248

thank you very much for your excellent work and for sharing it.

I’m currently using your project for research purposes and attempted to evaluate the model using the HIVAU-70k/instruction/merge_instruction_test_final.jsonl file along with pycocoevalcap, as described in your paper. However, I was not able to reproduce the evaluation scores reported in the paper.

Could you kindly clarify how the evaluation was performed in your setup?

If possible, sharing any relevant evaluation code or additional details would be greatly appreciated.
Thank you again for your valuable contribution, and I look forward to your response.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions