summaryrefslogtreecommitdiff
Commit message (Expand)AuthorAgeFilesLines
...
| * | pass job priority to processorschneefux2017-02-262-3/+4
| |/
* | Merge pull request #39 from vainglorygame/redesignKapil Viren Ahuja2017-02-265-322/+184
|\|
| * rewrite to use shared queue, fixes #36schneefux2017-02-255-322/+184
* | Merge pull request #37 from vainglorygame/ratelimitKapil Viren Ahuja2017-02-251-2/+2
|\ \ | |/ |/|
| * update limits: cannot get more than 5 random matchesschneefux2017-02-251-2/+2
* | Merge pull request #35 from vainglorygame/ratelimitKapil Viren Ahuja2017-02-252-13/+26
|\|
| * use gzip for API requestsschneefux2017-02-251-1/+1
| * respect rate limitsschneefux2017-02-252-7/+18
| * add VAINSOCIAL_APIKEY env variableschneefux2017-02-252-5/+7
|/
* Merge branch 'envvars'schneefux2017-02-251-15/+32
|\
| * specify region and crawl times per env varsschneefux2017-02-201-15/+32
* | Merge pull request #34 from vainglorygame/partitioningKapil Viren Ahuja2017-02-211-18/+53
|\ \ | |/ |/|
| * ghost commit to re-initiate a PRKapil Viren Ahuja2017-02-211-0/+1
| * work around table creation race condition, delete unfinished crawljobs on sta...schneefux2017-02-201-15/+21
| * partition data into tables per day and regionschneefux2017-02-201-10/+38
|/
* catch ssl RuntimeError and retry (#24)schneefux2017-02-161-1/+1
* reduce job length, increase worker count to keep up with blitz data volume (#22)schneefux2017-02-161-2/+2
* Merge pull request #15 from vainglorygame/new_db_tablesKapil Viren Ahuja2017-02-161-48/+34
|\
| * insert objects into dbs by type, upsert players when neededschneefux2017-02-151-48/+34
* | Merge pull request #13 from vainglorygame/hotfix_servererrorKapil Viren Ahuja2017-02-161-4/+9
|\ \
| * | ignore server errorsschneefux2017-02-151-4/+9
| |/
* | Merge pull request #12 from vainglorygame/worker_boredKapil Viren Ahuja2017-02-151-3/+10
|\ \ | |/ |/|
| * fix idling jobs crashingschneefux2017-02-141-1/+1
| * fetch from 2017-02-14 onwardsschneefux2017-02-141-2/+2
| * workers sleep and don't die when they have no jobsschneefux2017-02-141-1/+8
|/
* refactor and optimize storage requirementsschneefux2017-02-121-18/+31
* rewrite for better concurrency supportschneefux2017-02-123-171/+206
* Merge branch 'master' of https://github.com/vainglorygame/apigrabberschneefux2017-02-113-32/+36
|\
| * tolerate connection errorsschneefux2017-02-081-3/+8
| * add all regionsschneefux2017-02-081-2/+2
| * refactor api.pyschneefux2017-02-081-22/+18
| * use logging moduleschneefux2017-02-083-8/+11
* | rm unused Dockerfile, init.pyschneefux2017-02-112-5/+0
|/
* fix api grabber: run foreverschneefux2017-02-071-12/+14
* add gitignoreschneefux2017-02-071-0/+91
* remove code not related to API data fetchingschneefux2017-02-076-109/+9
* db connection params from env, fix early startschneefux2017-02-072-3/+20
* move into Dockerschneefux2017-02-062-2/+8
* crawl regions peux a peuxschneefux2017-02-062-21/+45
* make api.py independentschneefux2017-02-061-3/+2
* move & minimalize requirements.txtschneefux2017-02-061-0/+14
* api: allow to be run from the root directoryschneefux2017-02-051-3/+3
* api: db support parametersschneefux2017-02-051-2/+3
* manually push the earliest match to getschneefux2017-02-051-1/+1
* move gitignore to toplevelschneefux2017-01-291-91/+0
* api: get matches from eu+naschneefux2017-01-281-9/+19
* move venv to top levelschneefux2017-01-281-8/+0
* api: add venv requirementsschneefux2017-01-281-0/+8
* api: get new matches more reliably, remove now unused `db.meta`schneefux2017-01-284-38/+7
* api: removed unused aiohttp_wsgi dependencyschneefux2017-01-271-1/+0