This project implements a Load Balancer System for managing backend servers efficiently. It supports automatic server scaling, health checking, and request distribution using a Round-Robin, Least Connection, Resource Based Strategy. The system is built using C++ with gRPC for inter-service communication and Crow for HTTP-based management.
- Load Balancing: Distributes incoming requests among active backend servers.
- Server Management: Allows dynamic addition and removal of backend servers.
- Health Monitoring: Periodically checks server health and replaces unhealthy instances.
- Scale Up: Adds a new server if CPU usage exceeds 80%
- Failure Handling: Adds a new server if an existing one is unresponsive.
- Scale Down: Removes servers when they are no longer needed to optimize resource usage.
- Admin API: Provides gRPC-based server administration.
- HTTP API: Enables interaction with the system using RESTful endpoints.
- Strategy Pattern: Supports different load-balancing algorithms (e.g., Round-Robin) that can be easily added or configured, making the system scalable.
- Factory Pattern: Provides an abstraction for OS-specific process management, enabling support for both Windows and Linux to create, terminate processes, and retrieve resource details.
- C++17 or later
- gRPC and Protobuf
- Crow HTTP frameowrk
- CMake
- Click here to view instructions.txt
- Download vcpkg
git clone https://github.com/Microsoft/vcpkg.git
cd vcpkg
.\bootstrap-vcpkg.bat- Install gRPC and protobuf
.\vcpkg install grpc:x64-windows
.\vcpkg install protobuf:x64-windows
.\vcpkg integrate install./load_balancer --backend-path ./server --port 50050 --min-servers 2 --max-servers 5 --start-port 50051./health_checker 127.0.0.1:50050- GET /api/status - Returns a list of active servers.
- POST /api/add_server - Adds a new backend server.
- POST /api/remove_server - Removes a server by ID.
Feel free to contribute by submitting pull requests or feature requests.
