Proxy pool first step, sweep the whole network nodes

Fofa syntax：

1
protocol=="socks5" && "Version:5 Method:No Authentication(0x00)"

Quake Syntax：

xxxxxxxxxx
1
1
service:"socks5" and response:"Accepted Auth Method: 0x0"

Fofa sweeps pools built by others, derived from the github project proxypool (find it, URL+all to see bulk proxies))

xxxxxxxxxx
1
1
body="Welcome to Proxy Pool System"

--> after sweep fetch --> All interface fetch:

​x
1
# -*- coding: utf-8 -*-
2

3
# @Features : # Enter feature name here
4
# Enter feature description here
5

6
import requests
7
import random
8
import telnetlib
9
import socket
10
from multiprocessing import Pool
11
from pprint import pprint
12
from tqdm import tqdm
13

14
def get_proxy_pool(ipport):
15
    if False:
16
        proxies = {
17
            "http": "http://192.168.0.68:7890",
18
            "https": "http://192.168.0.68:7890",
19
        }
20
    else:
21
        proxies = {}
22
    url = f'http://{ipport}/all'
23
    resp = requests.get(url, proxies=proxies, timeout=5)
24
    resp.raise_for_status() 
25

26
    return resp.text
27

28

29
def telnet(ipport):
30
    try:
31
        host, port = ipport.split(':')
32
        tn = telnetlib.Telnet(host, port, timeout=5)
33
        tn.close()
34
        return True
35
    except (socket.timeout, ConnectionRefusedError, OSError):
36
        return False
37

38

39
def process_ipport(_ipport):
40
    if not telnet(_ipport):
41
        return None
42
    try:
43
        proxy_pool = get_proxy_pool(_ipport)
44
        return proxy_pool.split("\n")
45
    except Exception as e:
46
        print(e)
47
        return None
48

49
def main():
50
    _file = r'ipport.txt'
51
    lst_server = []
52
    with open(_file, 'r', encoding='utf-8') as f:
53
        lst_server = [ipport.strip() for ipport in f if ipport.strip()]
54

55
    lst_server = list(set(lst_server))
56
    # lst_server = random.sample(lst_server, min(5, len(lst_server)))
57

58
    lst_proxies = []
59

60
    with Pool(5) as pool:
61
        results = list(tqdm(pool.imap(process_ipport, lst_server), total=len(lst_server), mininterval=5, ncols=120))
62

63
    lst_proxies = [proxy for result in results if result for proxy in result]
64

65
    lst_proxies = list(set(lst_proxies))
66
    lst_proxies = list(filter(None, lst_proxies))
67
    with open("./out_proxies.txt", "w") as f_out:
68
        f_out.write("\n".join(lst_proxies))
69

70
    print("[*] Done")
71

72
if __name__ == '__main__':
73
    main()

https://github.com/sh1yan/Sppmagic（GO language，pass，I won't.） https://github.com/honmashironeko/ProxyCat（PY-->Utilization tools）

xxxxxxxxxx
1
1
python ProxyCat-V1.7.py -h

Both support local as well as cyberspace search engine use, the environment can be started, the project itself also explains how to use.

Other codes and their tools for detecting whether an IP is alive or not:

xxxxxxxxxx
15
1
# 响应200测活
2
proxies=(
3
  "47.96.176.130:59394"
4
  "178.48.68.61:18080"
5
  "91.148.127.162:8080"
6
)
7
url="http://www.baidu.com"
8
for proxy in "${proxies[@]}"; do
9
  response=$(curl -s -o /dev/null -w "%{http_code}" -x "$proxy" "$url")
10
  if [ "$response" -eq 200 ]; then
11
    echo "Proxy $proxy is valid."
12
  else
13
    echo "Proxy $proxy is invalid."
14
  fi
15
done

xxxxxxxxxx
25
1
# 脚本py200，一个道理，没啥难度，甚至不具有价值。
2
import requests
3

4
proxies = [
5
    "45.90.218.85:4444",
6
    "34.81.160.132:80",
7
    "193.162.143.222:4444"
8
]
9

10
def check_proxy(proxy):
11
    try:
12
        response = requests.get('http://www.google.com', proxies={"http": "http://" + proxy, "https": "https://" + proxy}, timeout=5)
13
        if response.status_code == 200:
14
            print(f"代理 {proxy} 可用。")
15
        # else:
16
            # print(f"代理 {proxy} 不可用。")
17
    except requests.RequestException as e:
18
        # print(f"代理 {proxy} 请求失败，错误信息: {e}")
19
        pass
20
def main():
21
    for proxy in proxies:
22
        check_proxy(proxy)
23

24
if __name__ == "__main__":
25
    main()

Other:

Description:

• Proxy Latency: All returned proxies have a latency of less than 5000 milliseconds to ensure a faster response.

• Proxy Number Recommendation: It is not recommended to get all the proxies as some of them may be valid for only a few minutes and may expire before use.

• IP Geolocation: GeoIP is used for differentiation, although there may be some errors, it is accurate in most cases.

• Server Configuration: Currently running on a 2core 1GB RAM server (don't go crazy with requests).

• Access Restrictions: Supports direct domestic access without additional settings.

<OVER~>