🦞 Ciggies Crawler

A web crawler for ciggies.app to scrape Chinese tobacco product data and images.

Data Overview

• Brands: 218
• Products: 3,220
• Fields: Product name, specifications, barcodes, prices, images, etc.

Requirements

pip install requests beautifulsoup4

Usage

python crawler.py

Output

All data is saved to the ciggies_data/ directory:

• brands.json - Brand list
• products.json - Product details
• images/ - Product images
• report.json - Crawl report

Data Structure

Brand (brands.json)

{
  "id": 319,
  "name": "云烟",
  "product_count": 96,
  "url": "https://www.ciggies.app/brand/319"
}

Product Detail (products.json)

{
  "sku_id": 3686,
  "name": "云烟（细支醇萃）",
  "name_en": "YunYan Pure Extraction Slim",
  "brand": "云烟",
  "description": "口味特征：本香为基，焦甜辅韵...",
  "region": "大陆 · Mainland China",
  "image": "https://www.ciggies.app/api/img/products/xxx.jpg",
  "specifications": {
    "Tobacco Type": "烤烟型",
    "Tar": "7 mg",
    "Nicotine": "0.7 mg",
    "CO": "6 mg",
    "Length": "100 mm",
    "Format": "细支"
  },
  "barcodes": {
    "Box barcode": "6901028319089",
    "Carton barcode": "6901028319096"
  }
}

License

MIT