jiazhizhong/MediaCrawler
1
0
Fork 0
mirror of https://github.com/NanmiCoder/MediaCrawler.git synced 2026-06-06 18:07:26 +08:00
Code Issues Packages Projects Releases Wiki Activity

添加功能:抖音每个视频抓取评论最大条数限制,抖音评论关键词筛选

Browse Source
This commit is contained in:
peanutsplash
2023-12-05 11:21:47 +08:00
parent 8f04943105
commit ab1a10bac1
3 changed files with 59 additions and 17 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
config/base_config.py
View File

@@ -26,6 +26,14 @@ CRAWLER_MAX_NOTES_COUNT = 20
# 并发爬虫数量控制
MAX_CONCURRENCY_NUM = 10
# 抖音每个视频抓取评论最大条数 (为0则不限制)
DY_MAX_COMMENTS_PER_POST = 10
# 抖音评论关键词筛选(只会留下包含关键词的评论,为空不限制)
DY_COMMENT_KEYWORDS = [
"我"
# ........................
]
# 指定小红书需要爬虫的笔记ID列表
XHS_SPECIFIED_ID_LIST = [