summaryrefslogtreecommitdiff
path: root/crawler.py
Commit message (Expand)AuthorAgeFilesLines
* rewrite to use shared queue, fixes #36schneefux2017-02-251-64/+24
* use gzip for API requestsschneefux2017-02-251-1/+1
* respect rate limitsschneefux2017-02-251-5/+16
* add VAINSOCIAL_APIKEY env variableschneefux2017-02-251-3/+2
* catch ssl RuntimeError and retry (#24)schneefux2017-02-161-1/+1
* ignore server errorsschneefux2017-02-151-4/+9
* rewrite for better concurrency supportschneefux2017-02-121-2/+0
* use logging moduleschneefux2017-02-081-1/+2
* crawl regions peux a peuxschneefux2017-02-061-4/+16
* api: get new matches more reliably, remove now unused `db.meta`schneefux2017-01-281-2/+1
* api: demo /matches endpointschneefux2017-01-271-0/+7
* api: fix getting new matchesschneefux2017-01-231-0/+2
* api: send requests synchronouslyschneefux2017-01-231-23/+15
* api: rewrite to use asyncschneefux2017-01-221-18/+35
* api: implement crawler and database functionalityschneefux2017-01-221-0/+72