Skip to content

Tags: kevinnft/unblock-web

Tags

v0.2.3

Toggle v0.2.3's commit message
v0.2.3: fix version sync, add CHANGELOG

v0.2.2

Toggle v0.2.2's commit message
v0.2.2: first PyPI publish via Trusted Publishing

v0.2.1

Toggle v0.2.1's commit message
v0.2.1: friendlier install (one-liner, gated PyPI publish)

v0.2.0

Toggle v0.2.0's commit message
v0.2.0 — Globally installable: PyPI + Docker + i18n

The repo is now usable by anyone in the world without cloning.

  pip install 'unblock-web[stealth]'                           # PyPI
  docker run --rm ghcr.io/kevinnft/unblock-web fetch URL       # Docker

  unblock-web verify [-v]      # 3-tier health canary
  unblock-web heal             # cross-OS Chromium installer
  unblock-web fetch URL ...    # smart fetch with auto tier selection

  from unblock_web import fetch
  page = fetch('https://x.com/<user>/status/<id>')

- PyPI: published via Trusted Publishing (no token needed in CI)
- Docker: ghcr.io/kevinnft/unblock-web (auto-published on tag)
- README: English + Bahasa Indonesia (README.id.md)

- Ubuntu × Python 3.10/3.11/3.12: ✓
- macOS × Python 3.10/3.11/3.12: ✓
- Cross-OS Playwright cache detection (Linux/macOS/Windows)
- Auto platform-override (Ubuntu 25+ only, no false-positive on macOS)

- Standalone scripts/ moved to /src/unblock_web/ as proper Python package
- requirements.txt deprecated (pip install [stealth] is canonical)
- Old scripts/ kept under scripts/ with README explaining migration
- Library API: fetch() with auto tier selection + FetchResult dataclass

v0.1.0

Toggle v0.1.0's commit message
v0.1.0 — Anti-blok web scraping stack

Initial public release of the 4-tier decision tree:

Tier 1: Scrapling + Patchright (local Chromium, Cloudflare Turnstile, x.com bypass)
Tier 2: TinyFish API (geo-proxy, ISP DNS bypass — free unlimited)
Tier 3: xcancel + Nitter mirrors (X reply trees)
Tier 4: xurl + bearer (authenticated API)

Verified targets (May 2026):
- x.com tweet body without authentication
- nowsecure.nl Cloudflare anti-bot test
- xcancel.com Cloudflare-protected mirror
- web3.okx.com from Indonesian Internet Positif
- GitHub README, plain SPAs

Tooling:
- scripts/verify-stack.py: 3-tier health canary, CI-ready
- scripts/heal-chromium.sh: Ubuntu 26.04+ Patchright install fix
- scripts/tinyfish_fetch.py: Tier 2 wrapper

Documentation:
- 5 docs files (per-tier + Ubuntu 26.04 fix + known targets)
- 4 runnable examples
- Issue templates (bug, blocked-target)
- PR template with verification checklist
- Security policy

CI: Canary workflow, weekly + on-push, all 3 tiers green on Ubuntu 24.04 GitHub Actions runner.