add sample mistral results/renders

Author: MHindermann

docs/archive/overview.md

@@ -43,6 +43,14 @@ This page provides an overview of all benchmark tests.Click on the test name to
 
   </tr></thead>
   <tbody>
+<tr>
+    <td>2025-04-02</td>
+    <td></td>
+    <td><a href='/archive/2025-04-02/T22'><span class='test-square' style='background-color: #2980b9;'>T22</span></a>&nbsp;</td>
+    <td><a href='/archive/2025-04-02/T23'><span class='test-square' style='background-color: #ff0066;'>T23</span></a>&nbsp;</td>
+    <td></td>
+    <td></td>
+</tr>
 <tr>
     <td>2025-04-01</td>
     <td><a href='/archive/2025-04-01/T07'><span class='test-square' style='background-color: #ff99cc;'>T07</span></a>&nbsp;<a href='/archive/2025-04-01/T08'><span class='test-square' style='background-color: #ffcc33;'>T08</span></a>&nbsp;<a href='/archive/2025-04-01/T09'><span class='test-square' style='background-color: #ff0066;'>T09</span></a>&nbsp;</td>

docs/index.md

@@ -56,7 +56,11 @@ results, and comparisons.
 </tr>
 <tr>
     <td>metadata_extraction</td>
-    <td><a href='archive/2025-04-01/T10'><span class='test-square' style='background-color: #ff6600;'>T10</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.52045159194282-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.5231788079470199-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T11'><span class='test-square' style='background-color: #ff6600;'>T11</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.5502508051447442-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.5793103448275863-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T12'><span class='test-square' style='background-color: #6633ff;'>T12</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.5085154955123995-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.511326860841424-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T13'><span class='test-square' style='background-color: #ff6600;'>T13</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.46274808931963324-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.4585987261146497-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T14'><span class='test-square' style='background-color: #34495e;'>T14</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.554063932353406-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.5704225352112676-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T15'><span class='test-square' style='background-color: #ff0099;'>T15</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.3694170771756979-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.3701298701298701-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T16'><span class='test-square' style='background-color: #33ffcc;'>T16</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.43630472577841-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.43278688524590164-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T17'><span class='test-square' style='background-color: #9b59b6;'>T17</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.42966944328105855-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.43934426229508194-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T18'><span class='test-square' style='background-color: #99ff33;'>T18</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.42007290954659376-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.42996742671009774-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T19'><span class='test-square' style='background-color: #0099ff;'>T19</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.5612242959703547-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.5774647887323944-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T20'><span class='test-square' style='background-color: #ff5050;'>T20</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.4940796180052578-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.49504950495049505-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T21'><span class='test-square' style='background-color: #9933ff;'>T21</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.5516959064327486-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.5655172413793104-brightgreen" alt="f1_micro"><br></td>
+    <td><a href='archive/2025-04-01/T10'><span class='test-square' style='background-color: #ff6600;'>T10</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.52045159194282-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.5231788079470199-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T11'><span class='test-square' style='background-color: #ff6600;'>T11</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.5502508051447442-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.5793103448275863-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T12'><span class='test-square' style='background-color: #6633ff;'>T12</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.5085154955123995-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.511326860841424-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T13'><span class='test-square' style='background-color: #ff6600;'>T13</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.46274808931963324-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.4585987261146497-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T14'><span class='test-square' style='background-color: #34495e;'>T14</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.554063932353406-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.5704225352112676-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T15'><span class='test-square' style='background-color: #ff0099;'>T15</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.3694170771756979-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.3701298701298701-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T16'><span class='test-square' style='background-color: #33ffcc;'>T16</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.43630472577841-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.43278688524590164-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T17'><span class='test-square' style='background-color: #9b59b6;'>T17</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.42966944328105855-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.43934426229508194-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T18'><span class='test-square' style='background-color: #99ff33;'>T18</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.42007290954659376-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.42996742671009774-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T19'><span class='test-square' style='background-color: #0099ff;'>T19</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.5612242959703547-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.5774647887323944-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T20'><span class='test-square' style='background-color: #ff5050;'>T20</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.4940796180052578-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.49504950495049505-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-01/T21'><span class='test-square' style='background-color: #9933ff;'>T21</span></a>: 2025-04-01 <img src="https://img.shields.io/badge/f1_macro-0.5516959064327486-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.5655172413793104-brightgreen" alt="f1_micro"><br><a href='archive/2025-04-02/T23'><span class='test-square' style='background-color: #ff0066;'>T23</span></a>: 2025-04-02 <img src="https://img.shields.io/badge/f1_macro-0.32800204394481347-brightgreen" alt="f1_macro"> <img src="https://img.shields.io/badge/f1_micro-0.3264094955489614-brightgreen" alt="f1_micro"><br></td>
+</tr>
+<tr>
+    <td>fraktur</td>
+    <td><a href='archive/2025-04-02/T22'><span class='test-square' style='background-color: #2980b9;'>T22</span></a>: 2025-04-02 <img src="https://img.shields.io/badge/score-niy-brightgreen" alt="score"><br></td>
 </tr>
 
   </tbody>

docs/tests.md

@@ -239,7 +239,7 @@ This page provides an overview of all tests. Click on the test name to see the d
     <td><span class='test-rectangle' style='background-color: #ff5050;'>anthropic</span></td>
     <td><span class='test-rectangle' style='background-color: #cc6699;'>claude-3-5-sonnet-20241022</span></td>
     <td>Document</td>
-add    <td>0.0</td>
+    <td>0.0</td>
     <td>You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history</td>
     <td>prompt.txt</td>
     <td>false</td>
@@ -277,6 +277,28 @@ add    <td>0.0</td>
     <td>prompt.txt</td>
     <td>false</td>
 </tr>
+<tr>
+    <td><a href='tests/T22'><span class='test-square' style='background-color: #2980b9;'>T22</span></a></td>
+    <td><a href="/benchmarks/fraktur/">fraktur</a></td>
+    <td><span class='test-rectangle' style='background-color: #ffcc33;'>genai</span></td>
+    <td><span class='test-rectangle' style='background-color: #e74c3c;'>gemini-2.5-pro-exp-03-25</span></td>
+    <td></td>
+    <td>0.0</td>
+    <td>You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history</td>
+    <td>prompt.txt</td>
+    <td>false</td>
+</tr>
+<tr>
+    <td><a href='tests/T23'><span class='test-square' style='background-color: #ff0066;'>T23</span></a></td>
+    <td><a href="/benchmarks/metadata_extraction/">metadata_extraction</a></td>
+    <td><span class='test-rectangle' style='background-color: #f1c40f;'>mistral</span></td>
+    <td><span class='test-rectangle' style='background-color: #34495e;'>pixtral-large-latest</span></td>
+    <td>Document</td>
+    <td>0.0</td>
+    <td>You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history. You only return valid JSON an no other text.</td>
+    <td>prompt.txt</td>
+    <td>false</td>
+</tr>
 
   </tbody>
 </table>

mkdocs.yml

@@ -36,6 +36,8 @@ nav:
     - T19: tests/T19.md
     - T20: tests/T20.md
     - T21: tests/T21.md
+    - T22: tests/T22.md
+    - T23: tests/T23.md
 
   - Benchmarks:
     - bibliographic_data: benchmarks/bibliographic_data.md
@@ -45,6 +47,9 @@ nav:
     - test_benchmark2: benchmarks/test_benchmark2.md
   - Archive:
     - Overview: archive/overview.md
+    - 2025-04-02:
+        - T22: archive/2025-04-02/T22.md
+        - T23: archive/2025-04-02/T23.md
     - 2025-04-01:
         - T01: archive/2025-04-01/T01.md
         - T02: archive/2025-04-01/T02.md

renders/2025-04-02/T22/image_1.md

@@ -0,0 +1,3 @@
+### Result for image: {image_name}
+
+no details available

renders/2025-04-02/T22/image_2.md

@@ -0,0 +1,3 @@
+### Result for image: {image_name}
+
+no details available

renders/2025-04-02/T23/letter01.md

@@ -0,0 +1,16 @@
+### Result for letter01
+| Category          | Ground Truth | Prediction | TP | FP | FN |
+|------------------|--------------|------------|----|----|----|
+| `send_date`        | 1926-02-16 | 1926-02-16 | 1 | 0 | 0 |
+| `sender_persons`  | Groschupf-Jaeger, Louis<br>Ritter-Dreier, Fritz | Herr Dr. Max Vischer<br>Herr Dr. Krasting | 0 | 2 | 2 |
+| `receiver_persons` | Christ-Wackernagel, Paul | Herrn Christ<br>Herrn Christ, Paravicini, Christ & Co. | 1 | 1 | 0 |
+
+| Name | Alternate Names |
+| --- | --- |
+| Groschupf-Jaeger, Louis | Groschopf<br>Groschupf<br>Herr Groschupf<br>Herrn Groschupf |
+| Ritter-Dreier, Fritz | Fritz Ritter<br>Herr Fritz Ritter<br>Herr Ritter<br>Herrn Fritz Ritter<br>J.A. Ritter<br>J.A.Ritter<br>Ritter |
+| Christ-Wackernagel, Paul | Christ<br>Christ-Wackernagel<br>Herr Christ<br>Herr P. Christ<br>Herr P. Christ - Wackernagel<br>Herr Vice- präsident Christ<br>Herren Christ<br>Herrn Christ<br>Herrn P. Christ<br>Herrn P. Christ - Wackernagel<br>Herrn P. Christ-Wackernagel<br>Herrn Paul Christ<br>Herrn Vizepräsidenten Christ<br>P. Christ - Wackernagel<br>P. Christ-Wackernagel<br>Paul Christ<br>Paul Christ-Wackernagel |
+
+`inferred_from_function`: False
+
+`inferred_from_correspondence`: False

renders/2025-04-02/T23/letter02.md

@@ -0,0 +1,15 @@
+### Result for letter02
+| Category          | Ground Truth | Prediction | TP | FP | FN |
+|------------------|--------------|------------|----|----|----|
+| `send_date`        | 1926-03-04 | 1926-03-04 | 1 | 0 | 0 |
+| `sender_persons`  | Ritter-Wehrle, Oskar | K.D. Schippang-Aktiengesellschaft<br>C. Rütti | 0 | 2 | 1 |
+| `receiver_persons` | Christ-Wackernagel, Paul | Herrn E. Christ<br>Herrn E. Christ - Wassermagel | 0 | 2 | 1 |
+
+| Name | Alternate Names |
+| --- | --- |
+| Ritter-Wehrle, Oskar | <br>Herren Direktor Ritter<br>O. Ritter |
+| Christ-Wackernagel, Paul | Christ<br>Christ-Wackernagel<br>Herr Christ<br>Herr P. Christ<br>Herr P. Christ - Wackernagel<br>Herr Vice- präsident Christ<br>Herren Christ<br>Herrn Christ<br>Herrn P. Christ<br>Herrn P. Christ - Wackernagel<br>Herrn P. Christ-Wackernagel<br>Herrn Paul Christ<br>Herrn Vizepräsidenten Christ<br>P. Christ - Wackernagel<br>P. Christ-Wackernagel<br>Paul Christ<br>Paul Christ-Wackernagel |
+
+`inferred_from_function`: False
+
+`inferred_from_correspondence`: False

renders/2025-04-02/T23/letter03.md

@@ -0,0 +1,16 @@
+### Result for letter03
+| Category          | Ground Truth | Prediction | TP | FP | FN |
+|------------------|--------------|------------|----|----|----|
+| `send_date`        | 1926-03-24 | 1926-03-24 | 1 | 0 | 0 |
+| `sender_persons`  | Ritter-Dreier, Fritz<br>Kachelhofer-Gerber, Frederick Charles | Basler Rheinschiffahrt-Aktiengesellschaft | 0 | 1 | 2 |
+| `receiver_persons` | Christ-Wackernagel, Paul | Herrn P. Christ - Waagarnagel<br>Paravicini, Christ & Co. | 0 | 2 | 1 |
+
+| Name | Alternate Names |
+| --- | --- |
+| Ritter-Dreier, Fritz | Fritz Ritter<br>Herr Fritz Ritter<br>Herr Ritter<br>Herrn Fritz Ritter<br>J.A. Ritter<br>J.A.Ritter<br>Ritter |
+| Kachelhofer-Gerber, Frederick Charles | None |
+| Christ-Wackernagel, Paul | Christ<br>Christ-Wackernagel<br>Herr Christ<br>Herr P. Christ<br>Herr P. Christ - Wackernagel<br>Herr Vice- präsident Christ<br>Herren Christ<br>Herrn Christ<br>Herrn P. Christ<br>Herrn P. Christ - Wackernagel<br>Herrn P. Christ-Wackernagel<br>Herrn Paul Christ<br>Herrn Vizepräsidenten Christ<br>P. Christ - Wackernagel<br>P. Christ-Wackernagel<br>Paul Christ<br>Paul Christ-Wackernagel |
+
+`inferred_from_function`: False
+
+`inferred_from_correspondence`: False

renders/2025-04-02/T23/letter04.md

@@ -0,0 +1,15 @@
+### Result for letter04
+| Category          | Ground Truth | Prediction | TP | FP | FN |
+|------------------|--------------|------------|----|----|----|
+| `send_date`        | 1926-03-26 | 1926-03-26 | 1 | 0 | 0 |
+| `sender_persons`  | Krasting, Wilhelm | W. W. Mann | 0 | 1 | 1 |
+| `receiver_persons` | Christ-Wackernagel, Paul | Herr Christ<br>C/O. Faravicini, Christ & Co. | 1 | 1 | 0 |
+
+| Name | Alternate Names |
+| --- | --- |
+| Krasting, Wilhelm | Dr. Krasting<br>Dr. W. Krasting<br>Herr Dr. Krasting<br>Herrn Dr. Krasting<br>Herrn Dr. W.Krasting |
+| Christ-Wackernagel, Paul | Christ<br>Christ-Wackernagel<br>Herr Christ<br>Herr P. Christ<br>Herr P. Christ - Wackernagel<br>Herr Vice- präsident Christ<br>Herren Christ<br>Herrn Christ<br>Herrn P. Christ<br>Herrn P. Christ - Wackernagel<br>Herrn P. Christ-Wackernagel<br>Herrn Paul Christ<br>Herrn Vizepräsidenten Christ<br>P. Christ - Wackernagel<br>P. Christ-Wackernagel<br>Paul Christ<br>Paul Christ-Wackernagel |
+
+`inferred_from_function`: False
+
+`inferred_from_correspondence`: False