summaryrefslogtreecommitdiff
path: root/api.py
Commit message (Expand)AuthorAgeFilesLines
* create one db connection and cache insert statementschneefux2017-03-091-32/+30
* log: inserts with playernameschneefux2017-03-081-2/+2
* log: be more verboseschneefux2017-03-081-0/+4
* start with only 1 db connectionschneefux2017-03-081-1/+2
* revert crawler import pathschneefux2017-03-081-1/+1
* allow to import apigrabber as a moduleschneefux2017-03-081-15/+16
* run jobs in batches (#57)schneefux2017-03-051-22/+25
* refactor to use joblib worker classschneefux2017-03-041-43/+19
* use proper log paths for Dockerschneefux2017-03-011-1/+4
* log to fileschneefux2017-03-011-2/+13
* reduce default worker idle cooldownschneefux2017-02-281-2/+2
* logs: be more quietschneefux2017-02-281-7/+2
* support multiple threads per workerschneefux2017-02-261-13/+16
* report job fails in queueschneefux2017-02-261-2/+6
* pass requested player name to job queueschneefux2017-02-261-0/+7
* store api data as one json per matchschneefux2017-02-261-23/+6
* pass object type to process job payloadschneefux2017-02-261-6/+11
* pass job priority to processorschneefux2017-02-261-3/+4
* rewrite to use shared queue, fixes #36schneefux2017-02-251-258/+75
* respect rate limitsschneefux2017-02-251-2/+2
* add VAINSOCIAL_APIKEY env variableschneefux2017-02-251-2/+5
* Merge branch 'envvars'schneefux2017-02-251-15/+32
|\
| * specify region and crawl times per env varsschneefux2017-02-201-15/+32
* | ghost commit to re-initiate a PRKapil Viren Ahuja2017-02-211-0/+1
* | work around table creation race condition, delete unfinished crawljobs on sta...schneefux2017-02-201-15/+21
* | partition data into tables per day and regionschneefux2017-02-201-10/+38
|/
* reduce job length, increase worker count to keep up with blitz data volume (#22)schneefux2017-02-161-2/+2
* Merge pull request #15 from vainglorygame/new_db_tablesKapil Viren Ahuja2017-02-161-48/+34
|\
| * insert objects into dbs by type, upsert players when neededschneefux2017-02-151-48/+34
* | fix idling jobs crashingschneefux2017-02-141-1/+1
* | fetch from 2017-02-14 onwardsschneefux2017-02-141-2/+2
* | workers sleep and don't die when they have no jobsschneefux2017-02-141-1/+8
|/
* refactor and optimize storage requirementsschneefux2017-02-121-18/+31
* rewrite for better concurrency supportschneefux2017-02-121-56/+206
* tolerate connection errorsschneefux2017-02-081-3/+8
* add all regionsschneefux2017-02-081-2/+2
* refactor api.pyschneefux2017-02-081-22/+18
* use logging moduleschneefux2017-02-081-5/+6
* fix api grabber: run foreverschneefux2017-02-071-12/+14
* remove code not related to API data fetchingschneefux2017-02-071-32/+8
* db connection params from env, fix early startschneefux2017-02-071-1/+7
* move into Dockerschneefux2017-02-061-2/+3
* crawl regions peux a peuxschneefux2017-02-061-17/+29
* make api.py independentschneefux2017-02-061-3/+2
* api: allow to be run from the root directoryschneefux2017-02-051-3/+3
* manually push the earliest match to getschneefux2017-02-051-1/+1
* api: get matches from eu+naschneefux2017-01-281-9/+19
* api: get new matches more reliably, remove now unused `db.meta`schneefux2017-01-281-7/+5
* api: removed unused aiohttp_wsgi dependencyschneefux2017-01-271-1/+0
* web-dev: first web frontend sampleschneefux2017-01-271-0/+1