Daily Job Scraper & Matcher

A personalized job hunting bot that scrapes LinkedIn jobs via Apify, matches them against your resume using keyword scoring and experience filtering, and emails you the top results.

Features

• Smart Filtering: Automatically removes jobs requiring high years of experience (customizable).
• Keyword Scoring: Boosts jobs that match your skills (Python, SQL, etc.) and prioritizes fresh grad/entry-level roles.
• Context Aware: Distinguishes between "2 years experience" (filtered) vs "within 2 years" (kept).
• Daily Reporting: Emails you a summary of the top 10 matches.

Apify Setup

This project uses Apify to scrape data from LinkedIn.

1. Create an Account: Go to Apify and sign up.
2. Get API Token: Go to Settings > Integrations and copy your Personal API Token.
3. Choose an Actor:
   • By default, this project uses the actor curious_coder/linkedin-jobs-scraper.
   • You need to "Rent" or "Start" this actor in your Apify console at least once to ensure it's active (or just rely on the API call).
   • Note: You are free to swap this for any other LinkedIn scraper actor on Apify. If you do, update line 32 in daily_bot.py with the new Actor ID/URL structure.

Setup

1. Install Dependencies

   pip install -r requirements.txt

2. Environment Variables Create a .env file in the root directory:

   APIFY_TOKEN=your_apify_token_here
   EMAIL_USER=your_email@gmail.com
   EMAIL_PASSWORD=your_app_password

3. Resume Place your resume PDF in the project folder and update config.json with its filename.

Customization

All settings are managed in config.json.

• settings:
  • max_experience_years: Filter out jobs requiring more than this (e.g., set to 3 to keep 1-2 year roles).
  • top_results_limit: How many jobs to email you (e.g., 10, 20).
  • fresh_grad_boost_score: Bonus points for "fresh grad" / "junior" roles.
  • resume_path: Path to your PDF resume.
• apify:
  • max_items: How many jobs to fetch from LinkedIn (e.g. 100).
• job_queries: Add or remove LinkedIn search URLs.
  • Tip: In the URL, f_TPR=r86400 means "Past 24 Hours".
  • f_TPR=r604800 means "Past Week".
  • f_TPR=r2592000 means "Past Month".
• keywords: Add skills you want to match (e.g., "React", "AWS").

Usage

Run the script manually:

python3 daily_bot.py

Cloud Automation (Best for "Always On")

To run this without keeping your laptop on, use GitHub Actions.

1. Push the code to a GitHub repository.
2. Add Secrets: Go to your Repo Settings > Secrets and variables > Actions.
   • Click New repository secret (do NOT use "Variables" or "Environment secrets").
   • Add APIFY_TOKEN
   • Add EMAIL_USER
   • Add EMAIL_PASSWORD
3. Done! The bot is pre-configured (in .github/workflows/daily_job.yml) to run every day at 09:00 AM Singapore Time (01:00 UTC).

Local Automation (Cron)

If you prefer to run it on your own computer:

1. Run crontab -e.
2. Add:

   0 9 * * * cd "/path/to/project" && /usr/bin/python3 daily_bot.py >> cron_log.txt 2>&1