jiazhizhong/MediaCrawler
1
0
Fork 0
mirror of https://github.com/NanmiCoder/MediaCrawler.git synced 2026-06-06 09:57:25 +08:00
Code Issues Packages Projects Releases Wiki Activity

fix(数据库): 修复模型字段类型以支持更广泛的数据格式；

Browse Source 
修复xhs评论存储方法，从批量处理改为单条处理
This commit is contained in:
persist-1
2025-09-07 04:10:49 +08:00
parent b04f5bcd6f
commit 684a16ed9a
3 changed files with 32 additions and 33 deletions
Download Patch File Download Diff File Expand all files Collapse all files

19
store/xhs/_store_impl.py
View File

@@ -143,18 +143,17 @@ class XhsDbStoreImplement(AbstractStore):
result = await session.execute(stmt)
return result.first() is not None
async def store_comments(self, comments: List[Dict]):
if not comments:
async def store_comment(self, comment_item: Dict):
if not comment_item:
return
async with get_session() as session:
for comment_item in comments:
comment_id = comment_item.get("comment_id")
if not comment_id:
continue
if await self.comment_is_exist(session, comment_id):
await self.update_comment(session, comment_item)
else:
await self.add_comment(session, comment_item)
comment_id = comment_item.get("comment_id")
if not comment_id:
return
if await self.comment_is_exist(session, comment_id):
await self.update_comment(session, comment_item)
else:
await self.add_comment(session, comment_item)
async def add_comment(self, session: AsyncSession, comment_item: Dict):
add_ts = int(get_current_timestamp())