New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请教下大家，通过selenium获取某航空公司的航班搜索结果是否违法 #17

Open

rRemix opened this issue Apr 23, 2023 · 2 comments

rRemix commented Apr 23, 2023

网站不需要登陆，并且获取到的信息都是网页上直接可以看到的，请求量大概每秒钟一次

1078769434 commented Jan 3, 2024

应该没事别爬太快就行

zhaotianff commented Mar 25, 2024 •

edited

我的建议是查看爬虫协议(robots.txt)和用户许可协议。以去哪儿网为例，用户协议中明确了如下：

深圳航空

所以如果你要抓的这个网站，爬虫协议和用户协议中都没有相关说明的话，在不影响网站运行的情况下，是可以抓取的。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment