Document Lightpanda learnings and proxy notes
This commit is contained in:
@@ -32,3 +32,38 @@ fetch failed
|
|||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
|
## [ERR-20260326-002] lightpanda
|
||||||
|
|
||||||
|
**Logged**: 2026-03-26T08:35:04Z
|
||||||
|
**Priority**: high
|
||||||
|
**Status**: pending
|
||||||
|
**Area**: config
|
||||||
|
|
||||||
|
### Summary
|
||||||
|
Lightpanda 当前实例在访问多类站点时存在 SslConnectError、GotNothing 与连接被重置等稳定性问题
|
||||||
|
|
||||||
|
### Error
|
||||||
|
```
|
||||||
|
Observed failures while driving Lightpanda via CDP on ws://127.0.0.1:9222/:
|
||||||
|
- Navigation failedReason: SslConnectError
|
||||||
|
- Navigation failedReason: GotNothing
|
||||||
|
- ConnectionResetError: [Errno 54] Connection reset by peer
|
||||||
|
- IncompleteReadError after session dropped during/after navigation
|
||||||
|
```
|
||||||
|
|
||||||
|
### Context
|
||||||
|
- Operation attempted: 使用自写 CDP 探针连接本地 Lightpanda,访问 example.com、Google、Bing、DuckDuckGo、Wikipedia、lightpanda.io、Hacker News、GitHub、Baidu、Zhihu、Bilibili、docs.python.org、httpbin 等站点
|
||||||
|
- Successful sample: example.com、cn.bing.com/search?q=lightpanda
|
||||||
|
- Proxy finding: 本机 127.0.0.1:7890 不通;127.0.0.1:7897 可连接
|
||||||
|
- Impact: 目前 Lightpanda 仅适合作为受限场景下的实验性浏览器后端,不能默认承担通用网页访问任务
|
||||||
|
|
||||||
|
### Suggested Fix
|
||||||
|
检查 Lightpanda 启动参数、代理设置、TLS/证书处理与日志输出;优先确认浏览器实例是否显式走 127.0.0.1:7897,并改为串行站点测试后再逐步扩大兼容范围。
|
||||||
|
|
||||||
|
### Metadata
|
||||||
|
- Reproducible: yes
|
||||||
|
- Related Files: tmp/lightpanda_probe.py, tmp/lightpanda_nav.py, tmp/lightpanda_search.py, tmp/lightpanda_search_debug.py, tmp/lightpanda_probe_site.py
|
||||||
|
- See Also: ERR-20260326-001
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
|||||||
@@ -29,3 +29,30 @@
|
|||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
|
## [LRN-20260326-002] best_practice
|
||||||
|
|
||||||
|
**Logged**: 2026-03-26T08:35:04Z
|
||||||
|
**Priority**: high
|
||||||
|
**Status**: pending
|
||||||
|
**Area**: config
|
||||||
|
|
||||||
|
### Summary
|
||||||
|
使用 Lightpanda 做网页自动化时,应优先把它视为“待验证的特定站点浏览器”,而不是默认当作通用浏览器
|
||||||
|
|
||||||
|
### Details
|
||||||
|
在连接本地 9222 端口的 Lightpanda 实例后,已验证其支持基本 CDP 流程:可连接 websocket、创建 target、attach session、打开 example.com,并读取 document.title 与 document.body.innerText。同时也验证到站点兼容性非常不均匀:cn.bing.com 搜索页可正常加载并提取结果;但 Google 搜索会话会中途断开,DuckDuckGo、Wikipedia、lightpanda.io、Hacker News 等站点出现 SslConnectError,GitHub 及多站点并发探测时还出现 Connection reset by peer。由此可知,当前实例更适合单站点、串行、小范围验证,不适合直接假设为稳定的通用浏览器后端。
|
||||||
|
|
||||||
|
### Suggested Action
|
||||||
|
后续使用 Lightpanda 时,先用一小组目标站点做串行兼容性验证并记录结果;默认优先使用已验证可用的站点(如 Bing),避免一开始并发探测或直接依赖复杂站点。
|
||||||
|
|
||||||
|
### Metadata
|
||||||
|
- Source: conversation
|
||||||
|
- Related Files: tmp/lightpanda_probe.py, tmp/lightpanda_nav.py, tmp/lightpanda_probe_site.py
|
||||||
|
- Tags: lightpanda, cdp, browser-automation, compatibility, best-practice
|
||||||
|
- Pattern-Key: lightpanda.validate_target_sites_before_generalizing
|
||||||
|
- Recurrence-Count: 1
|
||||||
|
- First-Seen: 2026-03-26
|
||||||
|
- Last-Seen: 2026-03-26
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
|||||||
@@ -38,3 +38,18 @@ Skills are shared. Your setup is yours. Keeping them apart means you can update
|
|||||||
---
|
---
|
||||||
|
|
||||||
Add whatever helps you do your job. This is your cheat sheet.
|
Add whatever helps you do your job. This is your cheat sheet.
|
||||||
|
|
||||||
|
## Network / Proxy
|
||||||
|
|
||||||
|
- Current local HTTP proxy: `127.0.0.1:7897`
|
||||||
|
- `127.0.0.1:7890` was checked on 2026-03-26 and was not accepting connections
|
||||||
|
|
||||||
|
## Lightpanda
|
||||||
|
|
||||||
|
- Local Lightpanda CDP endpoint observed at: `ws://127.0.0.1:9222/`
|
||||||
|
- Current behavior snapshot (2026-03-26):
|
||||||
|
- Basic CDP control works (connect / create target / navigate / evaluate JS)
|
||||||
|
- `example.com` and Bing search were reachable in testing
|
||||||
|
- Many other sites failed with `SslConnectError`, `GotNothing`, or session resets
|
||||||
|
- Treat the current Lightpanda instance as **experimental and site-specific**, not a general-purpose browser by default
|
||||||
|
- Prefer **serial, one-site-at-a-time validation** before depending on it for new browsing tasks
|
||||||
|
|||||||
Reference in New Issue
Block a user