[maybe a bug?] Could you make sure the following codes work fine? I can't find the tabeval package anywhere. File: docext/benchmark/metrics/tables.py Line 4

[linboyang]

from __future__ import annotations

import numpy as np
from tabeval.grits import grits_from_df

from docext.benchmark.vlm_datasets.ds import Prediction


def get_table_metrics(pred_with_gt: list[Prediction]):
    metrics_list = []
    for prediction in pred_with_gt:
        gt = prediction.gt
        pred = prediction.pred
        gt_answer = (
            gt.tables[0].table if gt is not None and gt.tables is not None else ""
        )
        pred_answer = (
            pred.tables[0].table if pred is not None and pred.tables is not None else ""
        )
        metrics = grits_from_df(gt_answer, pred_answer)
        metrics_list.append(metrics)
    return np.mean(metrics_list)

I need your help!

[github-actions]

👋 Welcome! Thanks for opening your first issue. If you'd like to take a crack at fixing it, feel free to open a pull request — otherwise, we'll take a look as soon as we can!

[mandalsouvik3333]

Yeah, nice catch. That's an internal package. I will add the required code.

[mandalsouvik3333]

Should be fixed @linboyang . Can you check with the latest code?

[linboyang]

Should be fixed @linboyang . Can you check with the latest code?

It works fine. Thank you !