TheGeneralist 51d03f12e2 http: realistic UA; fall back to WebPage on probe failure ... Replace bare 'archivr/0.1' user agent with a full Chrome 131 UA string (archivr/0.1 token retained at the end) in both probe_url_kind and download. More importantly, stop hard-failing when probe_url_kind returns an error. Sites behind Cloudflare's managed JS challenge (e.g. Medium) return 403 before any header tuning can help — a plain HTTP client cannot pass the challenge. Instead, log a warning and fall back to Source::WebPage so that the SingleFile/Chromium path gets a chance; a real browser can solve the challenge transparently.		2026-07-11 14:07:56 +02:00
..
src	http: realistic UA; fall back to WebPage on probe failure	2026-07-11 14:07:56 +02:00
Cargo.toml	feat(singlefile): add SaveResult, favicon extraction, wait for networkidle2	2026-06-24 19:16:21 +02:00