Collects high resolution images(not thumbnails) from google and naver.
All source code is based on scrapy framework.
- naver
pip install -r requirements.txt
- Edit keywords in keywords.txt
- At project root path, run below commands
scrapy crawl googlescrapy crawl naver
- Further options can be set in src/setting.py (ex.num of threads)
- You can also check scrapy official documents. [link]