TongUI-agent/TongUI-Crawler

Web crawler used in TongUI (For baidu experience and wikihow)

3

stars

4

commits

Python

primary language

Jul 10, 2025

updated

README

TongUI-Crawler

Crawler code for how we get data from wikihow, baidu experience, youtube, bilibili.

For intemediate data generated from crawler, please refer to HF repo.

Contributors

2 commits

2 commits

Similar repos

Bofeee5675/GUI-Net-Crawler

2

HelmiITK/focused-web-crawler-TA

scraping jurnal from seed URLs by Google Scholar

2

FongMi/CatVodSpider

891

js0nwu/webui

132

NanmiCoder/MediaCrawler

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频｜评论爬虫、微博帖子｜评论爬虫、百度贴吧帖子｜百度贴吧评论回复爬虫 | 知乎问答文章｜评论爬虫

64,796

biglab/webui-all

22

i2plus/WikiSeeker-Data

1

yyu/wiki_corpus

0

Languages

Python

100.0%

TongUI-agent/TongUI-Crawler

Web crawler used in TongUI (For baidu experience and wikihow)

3

stars

4

commits

Python

primary language

Jul 10, 2025

updated

README

TongUI-Crawler

Crawler code for how we get data from wikihow, baidu experience, youtube, bilibili.

For intemediate data generated from crawler, please refer to HF repo.

Similar repos

Bofeee5675/GUI-Net-Crawler

2

HelmiITK/focused-web-crawler-TA

scraping jurnal from seed URLs by Google Scholar

2

FongMi/CatVodSpider

891

js0nwu/webui

132

NanmiCoder/MediaCrawler

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频｜评论爬虫、微博帖子｜评论爬虫、百度贴吧帖子｜百度贴吧评论回复爬虫 | 知乎问答文章｜评论爬虫

64,796

biglab/webui-all

22

i2plus/WikiSeeker-Data

1

yyu/wiki_corpus

0

Contributors

2 commits

2 commits

Languages

Python

100.0%