-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
Description
Description
Implement a job fetcher agent that can scrape or fetch job listings from at least one job platform (e.g., LinkedIn, Indeed, or similar).
Acceptance Criteria
- Choose target job platform (LinkedIn, Indeed, or similar)
- Implement scraper or API client for the chosen platform
- Extract key job fields (title, company, location, description, URL)
- Handle pagination to fetch multiple job listings
- Implement rate limiting and error handling
- Add configurable search parameters (keywords, location, etc.)
- Return jobs in standardized format (dict/dataclass)
- Add logging for debugging and monitoring
- Write unit tests for the fetcher module
- Document API usage limits and authentication requirements
Technical Notes
- Consider using
requests+BeautifulSoupfor scraping or official APIs where available - Respect robots.txt and platform terms of service
- Store API keys/credentials securely (environment variables)