Bilingual Voice-Enabled Medication Adherence Platform

📌 Overview

This project is a bilingual healthcare platform that helps rural patients communicate with doctors.
Patients can record voice messages in their local language (e.g., Hindi), upload images, and chat with doctors.
The system uses Google Speech-to-Text, Translate API, and Firebase to enable cross-language communication.
It also verifies prescriptions against a dataset and generates reminders for patients.

---

⚙️ Technology Used

• Frontend → React.js (with Hooks & Components)
• Backend / Cloud → Firebase (Auth, Firestore, Storage), Google Cloud Functions
• APIs → Google Speech-to-Text, Google Translate, Google Text-to-Speech
• Database → Firebase Firestore (patients, doctors, cases, prescriptions)
• Storage → Firebase Storage / Google Cloud Storage (voice, images)
• Deployment → Vercel (serverless hosting)
• Notification → Firebase Cloud Messaging (chat alerts, reminders)

---

🔄 Process

1. Patient Registration / Login

   • First-time: enter name, age, sex, passcode.
   • Returning: login with name + passcode.

2. Chat Request (Handshake)

   • Patient selects specialty → picks doctor → request sent.
   • Admin approves → chat channel opens.

3. Voice Notes

   • Patient records audio → React component uploads to Firebase Storage.
   • Cloud Function triggers:
     • Speech-to-Text → transcription in source language
     • Translate API → English version for doctor
     • Firestore updated → doctor notified in real time.

4. Image Uploads & Text Messages

   • Patients can send supporting files or text.
   • Stored securely in Firebase and delivered to doctor.

5. Doctor Workflow

   • Reads/listens to patient messages.
   • Sends diagnosis and prescription.
   • Prescription verified against a CSV dataset using PapaParse.
   • If mismatch → flagged red + Admin notified.

6. Admin Role

   • Approves chat requests.
   • Monitors Patient, Doctor, Case tables.
   • Receives alerts for invalid prescriptions.

7. Reminders & Notifications

   • Verified prescriptions create reminder docs in Firestore.
   • Push notifications scheduled for patients via FCM.

---

✅ Outcome

• Enabled rural patients to communicate with doctors in their native language.
• Doctors receive transcriptions and translations seamlessly.
• Prescriptions are validated automatically to improve safety.
• Reminder notifications improve adherence to medication.
• Admin oversight ensures secure and controlled workflow.

---

🖥️ Vercel/ UI Interface

• Vercel is a cloud platform for deployment
• Fully pledged working application is deployed.