From 1c48914547bace8aa09a3c6470ad8ad8138a8222 Mon Sep 17 00:00:00 2001 From: Nick Lamb Date: Wed, 6 Aug 2025 09:00:55 +0100 Subject: [PATCH 1/2] Add PosterLens to Perplexity Cookbook showcase --- docs/showcase/posterlens.mdx | 40 ++++++++++++++++++++++++++++++++++++ 1 file changed, 40 insertions(+) create mode 100644 docs/showcase/posterlens.mdx diff --git a/docs/showcase/posterlens.mdx b/docs/showcase/posterlens.mdx new file mode 100644 index 0000000..d370818 --- /dev/null +++ b/docs/showcase/posterlens.mdx @@ -0,0 +1,40 @@ +--- +title: PosterLens +description: Turn static scientific posters into interactive research insights +--- + +## 🔍 What is PosterLens? + +**PosterLens** is a mobile app that transforms static scientific posters into interactive, explorable insights using OCR and AI. + +Created for the Perplexity Hackathon 2025, it allows researchers, MSLs, and medical writers to: + +- Scan posters using device camera + Apple Vision OCR +- Ask natural-language questions about the content +- Find semantically related studies using **Sonar Pro** +- Auto-generate research questions & future directions +- Validate citations with PubMed E-utilities + +--- + +## 📸 Screenshots + +![PosterLens Screenshot](https://cdn.prod.website-files.com/66d49e8555a289120a81ec3e/68930ad938e072c05d1be0b9_PosterLens.png) + +--- + +## 🔗 Links + +- 🧠 GitHub Repo: [PosterLens](https://github.com/nickjlamb/PosterLens) +- 📲 App Store: [PosterLens on iOS](https://apps.apple.com/us/app/posterlens-research-scanner/id6745453368) + +--- + +## 🧠 How PosterLens Uses Sonar Pro + +PosterLens integrates **Sonar Pro** for: +- Semantic understanding of OCR-extracted poster text +- Factual Q&A grounded in scientific literature +- Retrieval of related studies and citation-backed content + +Sonar Pro is essential for turning a static scan into a dynamic research experience. \ No newline at end of file From 35095314b896611e7fc41afec2605f93a4ebe27d Mon Sep 17 00:00:00 2001 From: Kesku Date: Sun, 17 Aug 2025 17:11:16 +0100 Subject: [PATCH 2/2] Unify PosterLens showcase page structure to match standard format --- docs/showcase/posterlens.mdx | 83 +++++++++++++++++++++++++----------- 1 file changed, 59 insertions(+), 24 deletions(-) diff --git a/docs/showcase/posterlens.mdx b/docs/showcase/posterlens.mdx index d370818..d802165 100644 --- a/docs/showcase/posterlens.mdx +++ b/docs/showcase/posterlens.mdx @@ -1,40 +1,75 @@ --- -title: PosterLens -description: Turn static scientific posters into interactive research insights +title: PosterLens | Scientific Poster Scanner & Research Assistant +description: An iOS app that transforms static scientific posters into interactive insights using OCR and Perplexity's Sonar Pro API for semantic search and context +sidebar_position: 21 +keywords: [PosterLens, iOS, OCR, scientific posters, research, Apple Vision, Sonar Pro, semantic search, medical research] --- -## 🔍 What is PosterLens? +**PosterLens** is an iOS app that transforms static scientific posters into interactive, explorable insights using OCR and AI. Created for the Perplexity Hackathon 2025, it allows researchers, MSLs, and medical writers to scan posters and explore them interactively using natural language, extracting meaning and surfacing related studies instantly. -**PosterLens** is a mobile app that transforms static scientific posters into interactive, explorable insights using OCR and AI. +![PosterLens Screenshot](https://cdn.prod.website-files.com/66d49e8555a289120a81ec3e/68930ad938e072c05d1be0b9_PosterLens.png) -Created for the Perplexity Hackathon 2025, it allows researchers, MSLs, and medical writers to: +## Features -- Scan posters using device camera + Apple Vision OCR -- Ask natural-language questions about the content -- Find semantically related studies using **Sonar Pro** -- Auto-generate research questions & future directions -- Validate citations with PubMed E-utilities +* **Scientific Poster Scanning** using device camera and Apple Vision OCR +* **Natural Language Q&A** about poster content with AI-powered responses +* **Semantic Search Integration** using Perplexity Sonar Pro for related studies +* **Citation Validation** with PubMed E-utilities for academic accuracy +* **Auto-Generated Research Questions** and future research directions +* **On-Device Processing** for privacy and performance +* **Interactive Research Experience** transforming static content into dynamic insights ---- +## Prerequisites -## 📸 Screenshots +* iOS 17+ device with camera +* Xcode 15+ for development +* Apple Developer account for App Store distribution +* Perplexity API key (Sonar Pro) +* OpenAI API key (GPT-3.5) +* PubMed E-utilities access -![PosterLens Screenshot](https://cdn.prod.website-files.com/66d49e8555a289120a81ec3e/68930ad938e072c05d1be0b9_PosterLens.png) +## Installation ---- +```bash +# Clone the repository +git clone https://github.com/nickjlamb/PosterLens.git +cd PosterLens -## 🔗 Links +# Open in Xcode +open PosterLens.xcodeproj +``` -- 🧠 GitHub Repo: [PosterLens](https://github.com/nickjlamb/PosterLens) -- 📲 App Store: [PosterLens on iOS](https://apps.apple.com/us/app/posterlens-research-scanner/id6745453368) +## Configuration ---- +Add your API keys to the project configuration: + +```swift +// API Configuration +PERPLEXITY_API_KEY=your_sonar_pro_api_key +OPENAI_API_KEY=your_gpt_api_key +PUBMED_API_KEY=your_pubmed_api_key +``` + +## Usage + +1. **Install from App Store**: Download PosterLens from the iOS App Store +2. **Scan Poster**: Point your camera at a scientific poster +3. **OCR Processing**: Apple Vision automatically extracts text content +4. **Ask Questions**: Use natural language to query the poster content +5. **Explore Related Research**: Discover semantically related studies via Sonar Pro +6. **Validate Citations**: Check academic references with PubMed integration + +## Code Explanation -## 🧠 How PosterLens Uses Sonar Pro +* **Frontend**: Native iOS app built with SwiftUI for modern UI/UX +* **OCR Processing**: Apple Vision framework for text extraction from images +* **AI Integration**: Perplexity Sonar Pro API for semantic search and context understanding +* **Natural Language**: GPT-3.5 for Q&A and content interpretation +* **Academic Validation**: PubMed E-utilities for citation verification +* **On-Device Processing**: Local OCR and processing for privacy and performance +* **Research Enhancement**: Auto-generation of research questions and future directions -PosterLens integrates **Sonar Pro** for: -- Semantic understanding of OCR-extracted poster text -- Factual Q&A grounded in scientific literature -- Retrieval of related studies and citation-backed content +## Links -Sonar Pro is essential for turning a static scan into a dynamic research experience. \ No newline at end of file +- [GitHub Repository](https://github.com/nickjlamb/PosterLens) +- [App Store](https://apps.apple.com/us/app/posterlens-research-scanner/id6745453368) \ No newline at end of file