Налаштування проксі в Python

Both address types in one client

Our residential pool and our static addresses authenticate the same way, by login and password. The difference lives in the host and in what you put after the login:

SOCKS5 needs an extra package. Run pip install requests[socks] first, then use socks5h:// so that DNS resolves on our side rather than on yours.

Rotating without a rotation library

You do not need middleware to change addresses. Rotating residential gives you a new IP on every request by default, and a session id pins one when you need it to hold:

Python: a session per worker, rotation everywhere else

import requests

BASE = "proxy.sotaproxy.com:10000"
USER, PWD = "login", "password"

def proxy(country=None, session=None, ttl="15m"):
    login = USER
    if country:
        login += f"_c_{country}"
    if session:
        login += f"_s_{session}_ttl_{ttl}"
    url = f"http://{login}:{PWD}@{BASE}"
    return {"http": url, "https": url}

# new IP per request
requests.get(url, proxies=proxy(), timeout=30)

# same IP for a multi-step flow
s = requests.Session()
s.proxies.update(proxy(country="US", session=7))
s.get(login_url); s.post(login_url, data=creds)

• Reuse a Session object per worker. It keeps the connection to our endpoint alive and cuts the handshake from every request.
• Set timeout on every call. Without it requests waits forever, and a stalled residential route will hang a worker for the rest of the run.
• Send Accept-Encoding: gzip. Residential is billed per gigabyte and an HTML page compresses three to four times.
• Do not put credentials in HTTP_PROXY environment variables on shared machines. Every subprocess inherits them.

What breaks in requests specifically