🚀 Crawl free Proxies from list of URLs 🚀
🏗 Use for your own Projects or Modify if needed 🏗
📌 Ver. 1.0 📌
🤖 Full Proxy Scraper 🤖
- Scrape proxies from HTML code from URLs
- Save scraped proxies to seperate text file
- Check all scraped proxies on definded url
- Save checked and working proxies into seperate text file
This script can Scrape free Proxies of the Internet.
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.
Any problems with running the script and any questions please cantact me via Twitter @hendrik_bgr
- Python 3.6+
Let's Get Started:
Get a copy of the Project. Open your Terminal and enter:
git clone https://github.com/hendrikbgr/Proxy-Scraper
(Work in progress) To install all needed requirements run the following command in the project directory:
pip install -r requirements.txt
After that you can proceed to start the Script.
To run this script open your Terminal in the project directory.
To start the Account Creator Script enter:
python3 main.py
You will find all scraped proxies in:
proxies.txt
You will find all checked & working proxies in:
checked.txt
Made by @byomartin
- Open Start and search for Microsoft Store
- Find "python" and install Python 3.10
- Download proxy scraper source code and unzip to any folder
- Open source folder, on the file explorer address bar now type "cmd" to open command line terminal
- Now type "pip install requests-html" to install requests-html module
- Type "pip install aiohttp" to install aiohttp module
- Now type "python3 main.py" the program will start
- Wait till it finishes you will get fresh working proxies
- Hendrik Bgr - Initial work - HendrikBgr
- Hat tip to anyone whose code was used
- Thanks to @byomartin for creating the beginners guide
This code is for educational use only.