Proxy Forge is a free, open-source, and extensible platform designed to help you set up and manage OSI level 4 proxies with rotating IPs across various cloud providers. It is a powerful and innovative solution that addresses one of the most pressing challenges faced by developers and businesses in today's digital landscape: IP throttling and blacklisting. Proxy Forge empowers you to conquer these obstacles by providing a seamless, reliable, and easy-to-deploy management dashboard.
Unlike simple scripts or static configurations, Proxy Forge provides a full-fledged web interface and an automated engine to continuously rotate proxies and ensure uninterrupted access to the resources you need.
When scraping websites, running automated tests, or accessing region-locked content, IP throttling and bans are huge roadblocks. For instance, if an eCommerce website only allows traffic from specific regions and actively throttles requests, a single static IP or a conventional load balancer without IP rotation will eventually get blocked.
Proxy Forge solves this by creating a dynamic pool of proxy instances (slaves). As instances get throttled or banned, Proxy Forge can automatically replace them with fresh ones, providing you with a continuously rotating set of clean IP addresses.
- Intuitive Dashboard: A user-friendly web interface to manage your proxies, monitor instances, and track system health.
- Automatic IP Replacement: Seamlessly rotates and replaces older droplet/instance IPs with new ones to avoid detection and IP blacklisting.
- User Management & Authentication: Easily add, remove, and manage access for various users directly from the dashboard.
- Extensible Cloud Provider Integration: Built with extensibility in mind. Developers can easily implement and plug in their own custom cloud service providers (e.g., AWS, GCP, DigitalOcean, Linode) to spin up proxies anywhere.
- IP Throttling Avoidance: Effectively bypass IP throttling mechanisms used by websites and services.
- Scalability: Easily scale your proxy fleet up or down to handle your specific needs.
- Open Source: Proxy Forge is open-source, allowing for community contributions and complete customization.
For comprehensive information on technical architecture, deployment guides, and developer documentation, please refer to our Project Wiki.
Proxy Forge leverages powerful open-source technologies under the hood:
- Django: The robust Python web framework powering the backend, orchestrator, and dashboard.
- Squid Cache: A highly performant proxy caching server that handles the OSI level 4 traffic routing.
- Fluentd: An open-source data collector for unified logging, providing comprehensive monitoring and troubleshooting capabilities.
I originally had to find a solution for a client where certain eCommerce websites were supposed to be scraped but only allowed IP addresses from the UK region. I purchased a VPC from a cloud provider in the UK, but later discovered that the target website implements strict IP throttling, which temporarily disables access. As a result, I built this solution to orchestrate multiple proxies and handle the IP rotation automatically, saving countless hours of manual infrastructure management.
We welcome contributions! Because Proxy Forge is designed to be extensible, we highly encourage developers to add support for new cloud providers. If you want to contribute, please fork the repository, create a feature branch, and submit a Pull Request.
Proxy Forge is licensed under the MIT License. See the LICENSE file for details.
Thank you for choosing Proxy Forge! I hope this tool helps you overcome IP throttling and blacklisting challenges, making your web-related tasks smoother and more efficient. If you have any questions or encounter issues, feel free to reach out. Happy proxying!
Website: https://tbhaxor.com, and @tbhaxor on all the social platform.