Skip to content

Repository files navigation

🖤 VANTABLACK RESEARCH

Global Strategic Intelligence Platform — AI-powered multi-agent research system generating cutting-edge analysis on frontier technologies, geopolitics, and critical systems.


🎯 What It Does

Vantablack Research is an automated research pipeline that:

  1. Generates original research articles on strategic topics (quantum computing, supply chains, neuro-sovereignty, etc.) using AI agents
  2. Publishes to a beautiful web portal with search, filtering, and social media sharing
  3. Maintains a metadata database (data.json) tracking all published work
  4. Auto-deploys via Git + GitHub + Netlify with CI/CD integration
  5. Creates social media content (Twitter/LinkedIn posts) for each article

The system uses a multi-agent architecture where specialized AI agents collaborate to research, synthesize, write, review, and optimize content.


🏗️ Architecture

Backend (Python + CrewAI)

main.py
├── Brainstorm Agent → Generates novel research topics
├── Research Agent   → Gathers intelligence & evidence
├── Writer Agent     → Composes article content
├── Reviewer Agent   → QA & fact-checking
├── Domain Agent     → Categorizes & tags content
└── Social Agent     → Creates marketing posts

Flow:

  1. Agents brainstorm a new topic (avoiding existing articles)
  2. Research agent compiles evidence and narrative arc
  3. Writer produces structured HTML with embedded CSS
  4. Reviewer validates quality & logic
  5. Article is saved + data.json updated
  6. Social content generated for distribution
  7. Git push → GitHub → Netlify automatic deploy

Frontend (HTML + Vanilla JS)

index.html
├── Dark-theme UI (cyan accent #00e5ff)
├── Search & filtering by topic/keyword
├── Sort by date (newest/oldest)
├── Domain tags (Research, Analysis, etc.)
├── Responsive grid layout
└── Full-text search across titles/summaries

Data Model (data.json)

{
  "title": "Article title",
  "summary": "Brief overview",
  "topic": "Research category",
  "file": "path/to/article.html",
  "date": "Publication date",
  "created_at": "Timestamp (YYYYMMDD_HHMMSS)"
}

🚀 Setup & Installation

Prerequisites

  • Python 3.9+
  • Ollama (running on localhost:11434)
  • Git (for automated deployment)
  • CrewAI (AI agent orchestration framework)

Installation

# Clone the repo
git clone <your-repo-url>
cd vantablack-research

# Install dependencies
pip install crewai python-dotenv requests beautifulsoup4

# Ensure Ollama is running
ollama serve  # Run in a separate terminal

# Run the research pipeline
python main.py

First Run

python main.py

Output:

  • ✅ New article generated: articles/[topic].html
  • ✅ Metadata added to data.json
  • ✅ Social content saved: articles/[topic]_social.txt
  • ✅ Homepage updated with new entry
  • ✅ Pushed to GitHub → Netlify deployed

📊 Key Features

🤖 Multi-Agent Research Pipeline

  • Brainstorm Agent: Generates novel topics (excludes existing work)
  • Research Agent: Compiles evidence, expert perspectives, and narrative arcs
  • Writer Agent: Produces publication-ready HTML with proper structure
  • Reviewer Agent: Validates facts, identifies red flags, quality control
  • Domain Agent: Categorizes by field (Quantum, Security, Economics, etc.)
  • Social Agent: Generates shareable content for Twitter/LinkedIn

🎨 Beautiful Web Portal

  • Dark theme with cyan accent (#00e5ff)
  • Real-time search across 1000+ articles
  • Filter by research domain/topic
  • Sort by date (newest/oldest)
  • Fully responsive (mobile + desktop)
  • Self-contained (no external CDN dependencies)

📈 SEO & Discovery

  • Automatic sitemap.xml generation
  • robots.txt for search engine crawlers
  • Meta tags for social sharing (OG tags)
  • Structured article metadata

🔄 CI/CD Integration

  • Automatic Git commit after each article
  • GitHub push triggers Netlify deploy
  • Zero-downtime updates

📝 Article Structure

Each generated article includes:

  • Executive Summary — high-level overview
  • Thesis Statement — central argument
  • Narrative Arc — context & setup
  • Evidence Types — sources cited
  • Quality Standards — methodology rigor
  • Red Flags — limitations & biases
  • Foresight Signals — emerging trends
  • Conclusion — key findings
  • Recommendations — actionable insights

💻 Usage

Generate a Single Article

python main.py

Generates one research article with full pipeline.

Customize Research Topics

Edit the Brainstorm Agent prompt in main.py (lines ~100-150) to focus on specific domains:

brainstorm_prompt = """
Generate a novel research topic about:
- Quantum computing & cryptography
- AI governance frameworks
- Space security
- Supply chain resilience
...
"""

Modify the Frontend

Edit the CSS in index.html (lines 16-24) to customize:

  • Color scheme (:root variables)
  • Font family
  • Layout spacing
  • Card styling

Deploy Manually

git add .
git commit -m "Vantablack Research: publish '[article-title]'"
git push origin main

🛠️ Tech Stack

Component Technology
Backend Python 3.9+, CrewAI
LLM Runtime Ollama (llama3)
Frontend HTML5, CSS3, Vanilla JS
Data JSON (metadata store)
Deployment Git + GitHub + Netlify
SEO XML Sitemaps, Meta tags

📁 File Structure

vantablack-research/
├── main.py                 # Core research pipeline
├── index.html              # Homepage & portal
├── data.json              # Article metadata
├── robots.txt             # SEO
├── sitemap.xml            # SEO
├── articles/              # Generated articles
│   ├── quantum-computing-2026.html
│   ├── neuro-sovereignty-2026.html
│   └── supply-chains-2026.html
└── README.md              # This file

🔧 Configuration

LLM Settings (main.py, lines 21-24)

LLM_CONFIG = LLM(
    model="ollama/llama3",           # Change model here
    base_url="http://localhost:11434",
    temperature=0.1,                 # Lower = more focused
    max_tokens=4096,                 # Max response length
)

Ollama Models

ollama pull llama3         # Default (7B parameters)
ollama pull mistral        # Faster, less capable
ollama pull neural-chat    # Optimized for dialogue

🎓 Research Domains

The system generates articles across:

  • Quantum Computing — cryptography, entanglement, quantum supremacy
  • AI & Governance — safety, alignment, policy frameworks
  • Supply Chains — resilience, logistics, geopolitical risks
  • Neuro-Technology — BCIs, cognitive security, sovereignty
  • Space Security — orbital dynamics, debris, geopolitics
  • Economic Warfare — sanctions, trade, currency systems

🚨 Troubleshooting

❌ "Connection refused: localhost:11434"

# Start Ollama in a separate terminal
ollama serve
ollama pull llama3

❌ "ModuleNotFoundError: No module named 'crewai'"

pip install --upgrade crewai

❌ Articles not deploying to Netlify

  • Verify GitHub repo is connected to Netlify
  • Check Git is configured: git config --global user.name & git config --global user.email
  • Ensure push permissions: git push -u origin main

❌ Duplicate topics being generated

  • Check data.json for existing titles
  • Brainstorm agent will auto-exclude them
  • To reset: backup data.json, delete old entries

📊 Performance & Scaling

Metric Performance
Article generation time 3-8 min (llama3 on CPU)
Portal load time <1s
Search latency <10ms (client-side)
Max articles 10,000+ (tested)

Tips for faster generation:

  • Use ollama pull mistral for 3x faster inference
  • Reduce max_tokens to 2048
  • Disable reviewer agent for drafts

📝 Example Article Output

Each article is a self-contained HTML file with:

  • Embedded CSS (no external stylesheets)
  • Structured sections (thesis, narrative, evidence, recommendations)
  • Ready to publish or email
  • Dark theme optimized for reading

Sample article structure:

Executive Summary        → Problem overview
Thesis Statement        → Central claim
Narrative Arc           → Context & history
Evidence Types          → Source credibility
Quality Standards       → Methodology rigor
Red Flags              → Limitations & biases
Foresight Signals      → Trends & implications
Conclusion             → Key findings
Recommendations        → Actionable next steps

🤝 Contributing

Want to extend Vantablack Research?

  1. Add new research domains — Edit brainstorm agent prompts
  2. Improve article quality — Modify reviewer agent criteria
  3. Customize frontend — Adjust CSS/JS in index.html
  4. Integrate new LLMs — Change LLM_CONFIG model parameter
  5. Add export formats — Generate PDF, Markdown, or DOCX versions

📜 License

Built by Asmit
Research framework: CrewAI
LLM Runtime: Ollama / Meta Llama3


🔮 Roadmap

  • Real-time article streaming to frontend
  • Multi-model ensemble (llama3 + mistral + neural-chat)
  • PDF export pipeline
  • Citation & reference auto-generation
  • Fact-checking via external APIs
  • Advanced analytics dashboard
  • Email newsletter distribution
  • API for programmatic access

Questions? Check the CrewAI docs or Ollama guide.


Generated with clarity. Deployed with precision. Maintained with purpose.

About

Multi-agent AI research pipeline — generates and publishes original strategic-intelligence articles on frontier tech, geopolitics, and emerging systems. Built with CrewAI + Ollama.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages