1. No Filtering
https://requestb.in/ is a great website for easily capturing HTTP requests.
If you need specific response type, use https://httpbin.org/.
In the case that the server visiting your IP is network restricted or needs a specific HTTP response, you can set-up your own cookie catcher using cookie_catcher.py or as follows:
virtualenv -p python3 venv
These are some of the interesting HTTP headers and what they do. A full list can be found here: https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers
|X-Forwarded-For||Identifies originating IP address of a client connecting to a web server through an HTTP proxy or load balancer. Brute force WAF with waf_bypass.py||X-Forwarded-For: 192.168.101.13|
|X-Remote-IP||Identifies originating IP address of a client connecting to a web server through an HTTP proxy or load balancer.||X-remote-IP: 192.168.101.13|
|X-Originating-IP||Identifies originating IP address of a client connecting to a web server through an HTTP proxy or load balancer.||X-originating-IP: 192.168.101.13|
|X-Client-IP||Identifies originating IP address of a client connecting to a web server through an HTTP proxy or load balancer.||X-Client-IP: 192.168.101.13|
|X-Forwarded-Host||Identifies the original host requested by the client in the HOST header.||X-Forwarded-Host: id42.example-cdn.com|
|Cookie||User cookies||Cookie: key1=value1; key2=value2;|
|Host||The website trying to be reached. Needed because the requested page may be different from the load balancer / root IP address.||Ex: cnn.com|
|Origin||Discloses where a fetch came from. Doesn’t disclose the whole path.||Origin: https://developer.mozilla.org|
|From||If a human creates a bot to scrape something, they should make the bot include a From header in its requests, containing the human’s email. This way, a website owner can contact the human if the bot is destructive.||From: firstname.lastname@example.org|
Here is a handy website to deobfuscate JavScript code.
Remember, you can also set breakpoints in JS via Chrome’s developer tools console.
Using this, you can dump a publicly exposed git repository from a website locally.
Sometimes, you want to run a tool like SQLMap on a URL but the URL keeps changing due to some dynamic variables (like maybe the current time). You can use a proxy script to act as the web server, which translates a request into the dynamically generated URL, and set that proxy server to be the target of SQLMap.
Check out this simple Flask proxy server I made here where the URL depended on the time.