Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recommend a alternatives project/推荐一个类似的项目:tumblr-crawler-cli #97

Open
tzw0745 opened this issue Sep 28, 2018 · 0 comments

Comments

@tzw0745
Copy link

tzw0745 commented Sep 28, 2018

tumblr-crawler-cli

Please give me your valuable comments!
如果可以的话请提出宝贵意见!

Feature

  • Rich command line parameters support.
  • Multi-threaded Download support.
  • File will be download completely.
  • Different Type of Proxy support.
  • Python2 & Python3 Compatibility.
  • more features coming...

特性

  • 丰富的命令行。
  • 支持多线程下载。
  • 确保文件完整性。
  • 支持不同类型的网络代理。
  • 兼容Python2和Python3。
  • 即将添加更多功能……

Usage/用法

usage: tumblr-crawler.py [-h] [-p] [-v] [-d SAVE_DIR] [-x PROXY]
                         [-n THREAD_NUM] [--min MIN_SIZE] [--overwrite]
                         [--interval INTERVAL] [--retries RETRIES]
                         sites [sites ...]

Crawler Tumblr Photos and Videos

positional arguments:
  sites                 tumblr sites

optional arguments:
  -h, --help            show this help message and exit
  -p, --photo           whether to download photo
  -v, --video           whether to download video
  -d SAVE_DIR, --dir SAVE_DIR
                        download file save directory
  -x PROXY, --proxy PROXY
                        http request agent, support http/socks
  -n THREAD_NUM, --thread THREAD_NUM
                        number of download threads, default is 5
  --min MIN_SIZE        minimum size of downloaded files, default is 0k
                        (unlimited)
  --overwrite           overwrite file (if it exists)
  --interval INTERVAL   http request interval, default is 0.5 (seconds)
  --retries RETRIES     http request retries, default is 3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant