Document Lightpanda learnings and proxy notes

This commit is contained in:
Chen Gu
2026-08-13 17:00:21 +08:00
parent f4e354a9ba
commit 691f96e8a6
3 changed files with 77 additions and 0 deletions
+35
View File
@@ -32,3 +32,38 @@ fetch failed
---
## [ERR-20260326-002] lightpanda
**Logged**: 2026-03-26T08:35:04Z
**Priority**: high
**Status**: pending
**Area**: config
### Summary
Lightpanda 当前实例在访问多类站点时存在 SslConnectError、GotNothing 与连接被重置等稳定性问题
### Error
```
Observed failures while driving Lightpanda via CDP on ws://127.0.0.1:9222/:
- Navigation failedReason: SslConnectError
- Navigation failedReason: GotNothing
- ConnectionResetError: [Errno 54] Connection reset by peer
- IncompleteReadError after session dropped during/after navigation
```
### Context
- Operation attempted: 使用自写 CDP 探针连接本地 Lightpanda,访问 example.com、Google、Bing、DuckDuckGo、Wikipedia、lightpanda.io、Hacker News、GitHub、Baidu、Zhihu、Bilibili、docs.python.org、httpbin 等站点
- Successful sample: example.com、cn.bing.com/search?q=lightpanda
- Proxy finding: 本机 127.0.0.1:7890 不通;127.0.0.1:7897 可连接
- Impact: 目前 Lightpanda 仅适合作为受限场景下的实验性浏览器后端,不能默认承担通用网页访问任务
### Suggested Fix
检查 Lightpanda 启动参数、代理设置、TLS/证书处理与日志输出;优先确认浏览器实例是否显式走 127.0.0.1:7897,并改为串行站点测试后再逐步扩大兼容范围。
### Metadata
- Reproducible: yes
- Related Files: tmp/lightpanda_probe.py, tmp/lightpanda_nav.py, tmp/lightpanda_search.py, tmp/lightpanda_search_debug.py, tmp/lightpanda_probe_site.py
- See Also: ERR-20260326-001
---
+27
View File
@@ -29,3 +29,30 @@
---
## [LRN-20260326-002] best_practice
**Logged**: 2026-03-26T08:35:04Z
**Priority**: high
**Status**: pending
**Area**: config
### Summary
使用 Lightpanda 做网页自动化时,应优先把它视为“待验证的特定站点浏览器”,而不是默认当作通用浏览器
### Details
在连接本地 9222 端口的 Lightpanda 实例后,已验证其支持基本 CDP 流程:可连接 websocket、创建 target、attach session、打开 example.com,并读取 document.title 与 document.body.innerText。同时也验证到站点兼容性非常不均匀:cn.bing.com 搜索页可正常加载并提取结果;但 Google 搜索会话会中途断开,DuckDuckGo、Wikipedia、lightpanda.io、Hacker News 等站点出现 SslConnectErrorGitHub 及多站点并发探测时还出现 Connection reset by peer。由此可知,当前实例更适合单站点、串行、小范围验证,不适合直接假设为稳定的通用浏览器后端。
### Suggested Action
后续使用 Lightpanda 时,先用一小组目标站点做串行兼容性验证并记录结果;默认优先使用已验证可用的站点(如 Bing),避免一开始并发探测或直接依赖复杂站点。
### Metadata
- Source: conversation
- Related Files: tmp/lightpanda_probe.py, tmp/lightpanda_nav.py, tmp/lightpanda_probe_site.py
- Tags: lightpanda, cdp, browser-automation, compatibility, best-practice
- Pattern-Key: lightpanda.validate_target_sites_before_generalizing
- Recurrence-Count: 1
- First-Seen: 2026-03-26
- Last-Seen: 2026-03-26
---