程序员阿江(Relakkes)
6e858c1a00
feat: excel store with other platform
2025-11-28 15:12:36 +08:00
hsparks.codes
324f09cf9f
fix: Update tests to handle openpyxl color format and ContextVar
...
- Fix header color assertion to check only RGB values (not alpha channel)
- Remove ContextVar mock as it cannot be patched in Python 3.11+
- All 17 tests now passing successfully
2025-11-28 05:04:00 +01:00
hsparks.codes
46ef86ddef
feat: Add Excel export functionality and unit tests
...
Features:
- Excel export with formatted multi-sheet workbooks (Contents, Comments, Creators)
- Professional styling: blue headers, auto-width columns, borders, text wrapping
- Smart export: empty sheets automatically removed
- Support for all platforms (xhs, dy, ks, bili, wb, tieba, zhihu)
Testing:
- Added pytest framework with asyncio support
- Unit tests for Excel store functionality
- Unit tests for store factory pattern
- Shared fixtures for test data
- Test coverage for edge cases
Documentation:
- Comprehensive Excel export guide (docs/excel_export_guide.md)
- Updated README.md and README_en.md with Excel examples
- Updated config comments to include excel option
Dependencies:
- Added openpyxl>=3.1.2 for Excel support
- Added pytest>=7.4.0 and pytest-asyncio>=0.21.0 for testing
This contribution adds immediate value for users who need data analysis
capabilities and establishes a testing foundation for future development.
2025-11-28 04:44:12 +01:00
程序员阿江-Relakkes
31a092c653
Merge pull request #782 from NanmiCoder/fix/xhs-sign-20251127
...
feat: xhs sign playwright version
2025-11-27 11:05:24 +08:00
程序员阿江(Relakkes)
f989ce0788
feat: xhs sign playwright version
2025-11-27 10:53:08 +08:00
程序员阿江-Relakkes
15b98fa511
ip proxy expired logic switch
...
Fix/proxy 20251125
2025-11-26 16:05:01 +08:00
程序员阿江(Relakkes)
f1e7124654
fix: proxy extract error
2025-11-26 16:01:54 +08:00
程序员阿江(Relakkes)
6eef02d08c
feat: ip proxy expired check
2025-11-25 12:39:10 +08:00
程序员阿江(Relakkes)
1da347cbf8
docs: update index.md
2025-11-22 09:12:25 +08:00
程序员阿江(Relakkes)
422cc92dd1
docs: update README
2025-11-22 08:20:09 +08:00
程序员阿江(Relakkes)
13d2302c9c
docs: update README
2025-11-18 17:56:55 +08:00
程序员阿江(Relakkes)
ff8c92daad
chore: add copyright to every file
2025-11-18 12:24:02 +08:00
程序员阿江(Relakkes)
5288bddb42
refactor: weibo search #771
2025-11-17 17:24:47 +08:00
程序员阿江(Relakkes)
6dcfd7e0a5
refactor: weibo login
2025-11-17 17:11:35 +08:00
程序员阿江(Relakkes)
e89a6d5781
feat: cdp browser cleanup after crawler done
2025-11-17 12:21:53 +08:00
程序员阿江(Relakkes)
a1c5e07df8
fix: xhs sub comment bugfix #769
2025-11-17 11:47:33 +08:00
程序员阿江(Relakkes)
b6caa7a85e
refactor: add xhs creator params
2025-11-10 21:10:03 +08:00
程序员阿江(Relakkes)
1e3637f238
refactor: update xhs note detail
2025-11-10 18:13:51 +08:00
程序员阿江(Relakkes)
b5dab6d1e8
refactor: 使用 xhshow 替代 playwright 签名方案
...
感谢 @Cloxl/xhshow 开源项目
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-11-10 18:12:45 +08:00
程序员阿江-Relakkes
54f23b8d1c
Merge pull request #768 from yangtao210/main
...
优化mongodb配置获取逻辑，移动存储基类位置。集成测试
2025-11-07 05:44:07 -05:00
yangtao210
58eb89f073
Merge branch 'NanmiCoder:main' into main
2025-11-07 17:44:09 +08:00
yt210
7888f4c6bd
优化mongodb配置获取逻辑，移动存储基类位置。集成测试
2025-11-07 17:42:50 +08:00
yt210
b61ec54a72
优化mongodb配置获取逻辑，移动存储基类位置。
2025-11-07 17:42:28 +08:00
程序员阿江(Relakkes)
60cbb3e37d
fix: weibo container error #568
2025-11-06 19:43:09 +08:00
程序员阿江-Relakkes
05a1782746
Merge pull request #764 from yangtao210/main
...
新增存储到mongoDB
2025-11-06 06:10:49 -05:00
yt210
ef6948b305
新增存储到mongoDB
2025-11-06 10:40:30 +08:00
程序员阿江(Relakkes)
45ec4b433a
docs: update
2025-11-06 00:08:03 +08:00
程序员阿江(Relakkes)
0074e975dd
fix: dy search
2025-11-04 00:14:16 +08:00
程序员阿江(Relakkes)
889fa01466
fix: bili词云图修复
2025-11-02 13:25:31 +08:00
程序员阿江(Relakkes)
3f5925e326
feat: update xhs sign
2025-10-27 19:06:07 +08:00
程序员阿江(Relakkes)
ed6e0bfb5f
refactor: tieba 改为浏览器获取数据
2025-10-19 17:09:55 +08:00
程序员阿江(Relakkes)
26a261bc09
Merge branch 'feature/config-refactor-20251018'
2025-10-19 15:32:42 +08:00
程序员阿江(Relakkes)
03e384bbe2
refactor: cdp模式下移除stealth注入
2025-10-19 15:32:03 +08:00
程序员阿江-Relakkes
56bf5d226f
The configuration file supports URL crawling
...
Feature/config refactor 20251018
2025-10-18 07:42:14 +08:00
程序员阿江(Relakkes)
ae7955787c
feat: kuaishou support url link
2025-10-18 07:40:10 +08:00
程序员阿江(Relakkes)
a9dd08680f
feat: xhs support creator url link
2025-10-18 07:20:09 +08:00
程序员阿江(Relakkes)
cae707cb2a
feat: douyin support url link
2025-10-18 07:00:21 +08:00
程序员阿江(Relakkes)
906c259cc7
feat: bilibili support url link
2025-10-18 06:30:20 +08:00
程序员阿江(Relakkes)
3b6fae8a62
docs: update README.md
2025-10-17 15:30:44 +08:00
程序员阿江-Relakkes
a72504a33d
Merge pull request #739 from callmeiks/add-tikhub-sponsor
...
docs: resize TikHub banner to smaller size
2025-10-16 16:54:18 +08:00
Callmeiks
e177f799df
docs: resize TikHub banner to smaller size
2025-10-16 01:51:55 -07:00
程序员阿江-Relakkes
1a5dcb6db7
Merge pull request #738 from callmeiks/add-tikhub-sponsor
...
docs: add TikHub as sponsor
2025-10-16 16:41:19 +08:00
Callmeiks
2c9eec544d
docs: add TikHub as sponsor
2025-10-16 01:22:40 -07:00
程序员阿江(Relakkes)
d1f73e811c
docs: update README.md
2025-10-12 21:19:11 +08:00
程序员阿江(Relakkes)
2d3e7555c6
docs: update README.md
2025-10-11 16:16:11 +08:00
程序员阿江(Relakkes)
3c5b9e8035
docs: update wechat qrcode
2025-10-02 14:27:10 +08:00
程序员阿江(Relakkes)
e6f3182ed7
Merge branch 'codex/replace-argparse-with-typer-for-cli'
2025-09-26 18:11:02 +08:00
程序员阿江(Relakkes)
2cf143cc7c
fix : #730
2025-09-26 18:10:30 +08:00
程序员阿江-Relakkes
eb625b0b48
Merge pull request #729 from NanmiCoder/codex/replace-argparse-with-typer-for-cli
...
feat(cli): migrate CLI argument parsing to Typer
2025-09-26 18:08:21 +08:00
程序员阿江(Relakkes)
84f6f650f8
fix: typer args bugfix
2025-09-26 18:07:57 +08:00
