Liepin Scraper is a production-ready tool for collecting structured job listing data from Liepin, one of China’s largest recruitment platforms. It helps teams turn raw job postings into clean, usable datasets for analysis, research, and business decisions. Built for reliability and scale, it focuses on accuracy, coverage, and real-world usability.
Created by Bitbash, built to showcase our approach to Scraping and Automation!
If you are looking for liepin-scraper you've just found your team — Let’s Chat. 👆👆
Liepin Scraper extracts detailed job and company information from Liepin search results and converts it into structured data formats. It solves the problem of manually tracking jobs, salaries, and hiring trends across a fast-moving Chinese job market. This project is designed for developers, analysts, recruiters, and data teams who need consistent, high-quality recruitment data.
- Collects rich job, recruiter, and company metadata in one run
- Normalizes salary, experience, and education requirements
- Works across roles, locations, and experience levels
- Outputs analysis-ready datasets without manual cleanup
| Feature | Description |
|---|---|
| Job listing extraction | Captures job titles, descriptions, tags, and posting metadata. |
| Company profiling | Extracts company name, industry, size, and branding assets. |
| Recruiter insights | Collects recruiter names, roles, and related identifiers. |
| Salary normalization | Preserves salary ranges and compensation structures. |
| Flexible filtering | Supports keywords, locations, and experience-based searches. |
| Analytics-ready output | Exports clean JSON or CSV suitable for BI and ML pipelines. |
| Field Name | Field Description |
|---|---|
| title | Job title as listed on the platform. |
| company | Hiring company name. |
| salary | Salary range and payment structure. |
| dq | Job location or district. |
| requireWorkYears | Required work experience. |
| requireEduLevel | Minimum education level. |
| industry | Company industry classification. |
| compScale | Company size range. |
| recruiterName | Recruiter or HR contact name. |
| recruiterTitle | Recruiter job title. |
| jobLabels | Benefits and perks associated with the role. |
| refreshTime | Last job refresh timestamp. |
| jobId | Unique job identifier. |
| companyId | Unique company identifier. |
[
{
"title": "艺术总监",
"company": "上海博盟文化发展有限公司",
"salary": "15-18k·13薪",
"dq": "上海-航华",
"requireWorkYears": "2年以上",
"requireEduLevel": "本科",
"industry": "文化艺术业",
"compScale": "1-49人",
"recruiterName": "李女士",
"recruiterTitle": "HR",
"jobLabels": [
"五险一金",
"年终奖金",
"绩效奖金",
"年底双薪"
],
"refreshTime": "20241212103929",
"jobId": 69563751,
"companyId": 13008417
}
]
Liepin Scraper/
├── src/
│ ├── runner.py
│ ├── extractors/
│ │ ├── job_parser.py
│ │ ├── company_parser.py
│ │ └── recruiter_parser.py
│ ├── outputs/
│ │ ├── exporters.py
│ │ └── schema.py
│ └── config/
│ └── settings.example.json
├── data/
│ ├── inputs.sample.json
│ └── output.sample.json
├── requirements.txt
└── README.md
- Market analysts use it to track salary ranges and role demand, so they can identify hiring trends across regions.
- Recruitment teams use it to monitor competitor hiring activity, helping them adjust sourcing strategies.
- HR researchers use it to build structured datasets for workforce studies and reporting.
- Business developers use it to identify fast-growing companies and industries for outreach.
- Data scientists use it to train models on real-world recruitment and labor market data.
Does this scraper support multiple job categories and locations? Yes. It is designed to handle diverse search combinations, including different roles, cities, and experience levels, without additional configuration.
What output formats are supported? The scraper exports structured data in JSON and CSV formats, making it easy to integrate with analytics tools or databases.
Is the data suitable for machine learning workflows? Absolutely. Fields are normalized and consistently structured, reducing preprocessing effort for ML pipelines.
How stable is it against platform changes? The extraction logic is modular, allowing quick updates if page structures evolve.
Primary Metric: Processes an average of 1,200–1,500 job listings per hour under standard network conditions.
Reliability Metric: Maintains a successful extraction rate above 97% across repeated runs.
Efficiency Metric: Uses incremental requests and lightweight parsing to minimize memory and CPU usage.
Quality Metric: Delivers over 95% field completeness for core job, company, and recruiter attributes.
"Bitbash is a top-tier automation partner, innovative, reliable, and dedicated to delivering real results every time." Nathan Pennington
|
"Bitbash delivers outstanding quality, speed, and professionalism, truly a team you can rely on." Eliza
|
"Exceptional results, clear communication, and flawless delivery. Syed
|