|
| 1 | +# Generic Document Evaluation Tool |
| 2 | + |
| 3 | +🔍 **Evaluate PDFs against custom business criteria** |
| 4 | + |
| 5 | +A simple, adaptable solution for analyzing and categorizing transactional documents using predefined evaluation criteria. Perfect for analysts, auditors, or developers seeking to automate document review in enterprise, finance, education, or public sector scenarios and more. |
| 6 | + |
| 7 | +Reviewed: 22.07.2025 |
| 8 | + |
| 9 | +## Overview |
| 10 | + |
| 11 | +**Document Evaluation Tool** lets you upload one or more documents (PDF), define your evaluation criteria in a CSV format or manual entry, and receive a professional markdown report categorizing each document as appropriate, with a rationale for each decision. With the option to add additional input to the prompt, making sure it's easy to customize for all sorts of scenarios where documents and criteria is involved. |
| 12 | + |
| 13 | +**What's Included:** |
| 14 | + |
| 15 | + **Frontend**: Modern React interface |
| 16 | +- **Backend**: Oracle GenAI Service integration |
| 17 | + |
| 18 | +--- |
| 19 | + |
| 20 | + |
| 21 | +# When to use this asset? |
| 22 | + |
| 23 | +Analysts, compliance teams, auditors, or operational staff would use this asset whenever they need to systematically evaluate, validate, or categorize documents—such as visa applications, insurance claims, or student financial aid requests—based on well-defined criteria. |
| 24 | + |
| 25 | +Developers and solution architects may also use this asset to rapidly prototype or demo document analysis workflows, including LLM-driven or human-in-the-loop review scenarios. |
| 26 | + |
| 27 | +# How to use this asset? |
| 28 | + |
| 29 | +Collect the Documents: Gather one or more PDFs containing the applications or claims to be evaluated. |
| 30 | + |
| 31 | +Define Evaluation Criteria: Prepare a CSV file listing the evaluation criteria and descriptions tailored for the specific use case (e.g., insurance claim completeness, income eligibility for student aid). Optionally, you can give the criteria in a free-format in the front-end including additional requirements that may not be criteria. |
| 32 | + |
| 33 | +Run the Tool: Upload the documents and relevant criterion. |
| 34 | + |
| 35 | +Automated Evaluation: The tool analyzes the content of each document, evaluating and categorizing them according to your criteria. |
| 36 | + |
| 37 | +Review the Results: Receive a professional, human-readable markdown report showing the outcome for each document (Ready to Admit, Conditional, Rejected), along with explanations and a summary table. |
| 38 | + |
| 39 | +Take Action: Use the evaluation output to make operational decisions (e.g., approve/reject applications, flag items for manual review, generate audit trails). |
| 40 | + |
| 41 | + |
| 42 | +--- |
| 43 | + |
| 44 | +## Architecture |
| 45 | + |
| 46 | +The solution consists of two complementary components: |
| 47 | + |
| 48 | +### Frontend (React/Next.js) |
| 49 | + |
| 50 | +- Multi-tenant chat interface |
| 51 | +- Multiple input option allows flexibility for use-case |
| 52 | + |
| 53 | +### Backend (Node.js/Express) |
| 54 | + |
| 55 | +- Oracle GenAI Services |
| 56 | +- Embedding documents in local qdrant vector store |
| 57 | + |
| 58 | + |
| 59 | +--- |
| 60 | + |
| 61 | +## Quick Start |
| 62 | + |
| 63 | +### Full Stack |
| 64 | + |
| 65 | +Complete setup with Oracle GenAI Service: |
| 66 | +#TO-DO |
| 67 | +```bash |
| 68 | +# Start backend |
| 69 | +cd backend/ |
| 70 | +# Install dependencies |
| 71 | +pip install -r requirements.txt |
| 72 | + |
| 73 | +# Set up environment variables |
| 74 | +cp .env.example .env.local |
| 75 | +# Edit .env.local with your Configure Oracle Credentials |
| 76 | + |
| 77 | +# Start main.py |
| 78 | +python main.py |
| 79 | + |
| 80 | +# Start frontend (in new terminal) |
| 81 | +cd files/frontend/ |
| 82 | +npm install |
| 83 | +cp .env.example .env.local |
| 84 | +# Configure Oracle Digital Assistant + Speech Service URL |
| 85 | +npm run dev |
| 86 | +``` |
| 87 | + |
| 88 | +--- |
| 89 | +## Example Use Cases |
| 90 | + |
| 91 | +- Visa application processing |
| 92 | +- Insurance claim validation |
| 93 | +- Student financial aid and scholarship assessment |
| 94 | +- RFP evaluation |
| 95 | +- Resume evaluation |
| 96 | +- ESG Document review |
| 97 | +- Any transactional document requiring multi-criteria analysis |
| 98 | + |
| 99 | + |
| 100 | + |
| 101 | +--- |
| 102 | +## Example Criteria |
| 103 | + |
| 104 | + |
| 105 | + |
| 106 | +### Insurance Claim (CSV) |
| 107 | + |
| 108 | +| Criteria | Description | |
| 109 | +|------------------------|------------------------------------------------------------------------------------------| |
| 110 | +| Completeness | All required fields are filled out and information is provided for each section. | |
| 111 | +| Incident Clarity | Incident details are clearly described, dates and type of incident are consistent. | |
| 112 | +| Cost Breakdown Accuracy| All claimed expenses are itemized, reasonable, and total matches the sum of items. | |
| 113 | +| Supporting Evidence | Incident verification is provided (e.g., police report, doctor’s note). | |
| 114 | +| Policy Coverage Check | Total claimed amount is within the policy coverage limit. | |
| 115 | +| Contact Validity | Contact information for the claimant is complete and plausible. | |
| 116 | + |
| 117 | +### Visa Application (CSV) |
| 118 | + |
| 119 | +| Criteria | Description | |
| 120 | +|-----------------------------|-----------------------------------------------------------------------------| |
| 121 | +| Completeness | All required fields are filled and accurate. | |
| 122 | +| Financial Sufficiency | Applicant has sufficient bank balance (e.g., minimum €3,000). | |
| 123 | +| Passport Validity | Passport expiration is at least 6 months after intended departure. | |
| 124 | +| Employment/Sponsorship Info | Clear and valid employment or sponsorship details provided. | |
| 125 | + |
| 126 | +### Student Financial Aid (CSV) |
| 127 | + |
| 128 | +| Criteria | Description | |
| 129 | +|--------------------|--------------------------------------------------------------------| |
| 130 | +| Completeness | All fields filled and supporting docs present. | |
| 131 | +| Income Eligibility | Household income and size match program limits. | |
| 132 | +| Academic Merit | If required: grades, honors, awards, or other evidence provided. | |
| 133 | +| Loan Co-signer | If loan: co-signer details are complete and income is sufficient. | |
| 134 | + |
| 135 | +--- |
| 136 | + |
| 137 | +## Example Outcome Categories |
| 138 | + |
| 139 | +- **Ready to Admit**: Document is fully verified, consistent, and meet all criteria |
| 140 | +- **Conditional**: Document is mostly satisfactory but missing minor details or require further clarification |
| 141 | +- **Rejected**: Documents are clearly incomplete, falsified, or contain highly inconsistent information |
| 142 | + |
| 143 | +--- |
| 144 | + |
| 145 | +## Quick Start |
| 146 | + |
| 147 | +1. Upload your document(s) as PDF. |
| 148 | +2. Provide a CSV listing your evaluation criteria (see templates above). |
| 149 | +3. Add any additional requirements you have such as asking for a scoring over hundred for each criteria. |
| 150 | + |
| 151 | +--- |
| 152 | + |
| 153 | + |
| 154 | +# Components |
| 155 | + |
| 156 | +- **Frontend**: [`files/frontend/`](files/frontend/) - Complete React interface |
| 157 | +- **Backend**: [`files/backend/`](files/backend/) - Oracle Generative AI Service integration |
| 158 | + |
| 159 | +## Technology Stack |
| 160 | + |
| 161 | +**Frontend**: Next.js 15, React 19, Material-UI, Framer Motion, Oracle WebSDK |
| 162 | +**Backend**: Node.js, Express, WebSocket, Oracle GenAI, FFmpeg #TO-DO update this |
| 163 | + |
| 164 | +# Browser Requirements |
| 165 | + |
| 166 | +- Modern browser with WebSocket support |
| 167 | +- LocalStorage for project persistence |
| 168 | + |
| 169 | +--- |
| 170 | + |
| 171 | +Copyright (c) 2025 Oracle and/or its affiliates. |
| 172 | + |
| 173 | +Licensed under the Universal Permissive License (UPL), Version 1.0. |
| 174 | + |
| 175 | +See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details. |
0 commit comments