| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | kill process when the worker crashesrelease/1.5.0 | schneefux | 2017-03-19 | 1 | -14/+12 |
| | | |||||
| * | log debug to console only | schneefux | 2017-03-15 | 1 | -11/+1 |
| | | |||||
| * | use joblib notifications | schneefux | 2017-03-13 | 1 | -1/+1 |
| | | |||||
| * | do not rollback after API 404 | schneefux | 2017-03-09 | 1 | -1/+2 |
| | | |||||
| * | create one db connection and cache insert statement | schneefux | 2017-03-09 | 1 | -32/+30 |
| | | |||||
| * | log: inserts with playername | schneefux | 2017-03-08 | 1 | -2/+2 |
| | | |||||
| * | log: be more verbose | schneefux | 2017-03-08 | 1 | -0/+4 |
| | | |||||
| * | start with only 1 db connection | schneefux | 2017-03-08 | 1 | -1/+2 |
| | | |||||
| * | revert crawler import path | schneefux | 2017-03-08 | 1 | -1/+1 |
| | | |||||
| * | allow to import apigrabber as a module | schneefux | 2017-03-08 | 1 | -15/+16 |
| | | |||||
| * | run jobs in batches (#57) | schneefux | 2017-03-05 | 1 | -22/+25 |
| | | |||||
| * | refactor to use joblib worker class | schneefux | 2017-03-04 | 1 | -43/+19 |
| | | |||||
| * | use proper log paths for Docker | schneefux | 2017-03-01 | 1 | -1/+4 |
| | | |||||
| * | log to file | schneefux | 2017-03-01 | 1 | -2/+13 |
| | | |||||
| * | reduce default worker idle cooldown | schneefux | 2017-02-28 | 1 | -2/+2 |
| | | |||||
| * | logs: be more quiet | schneefux | 2017-02-28 | 1 | -7/+2 |
| | | |||||
| * | support multiple threads per worker | schneefux | 2017-02-26 | 1 | -13/+16 |
| | | |||||
| * | report job fails in queue | schneefux | 2017-02-26 | 1 | -2/+6 |
| | | |||||
| * | pass requested player name to job queue | schneefux | 2017-02-26 | 1 | -0/+7 |
| | | |||||
| * | store api data as one json per match | schneefux | 2017-02-26 | 1 | -23/+6 |
| | | |||||
| * | pass object type to process job payload | schneefux | 2017-02-26 | 1 | -6/+11 |
| | | |||||
| * | pass job priority to processor | schneefux | 2017-02-26 | 1 | -3/+4 |
| | | |||||
| * | rewrite to use shared queue, fixes #36 | schneefux | 2017-02-25 | 1 | -258/+75 |
| | | |||||
| * | respect rate limits | schneefux | 2017-02-25 | 1 | -2/+2 |
| | | |||||
| * | add VAINSOCIAL_APIKEY env variable | schneefux | 2017-02-25 | 1 | -2/+5 |
| | | |||||
| * | Merge branch 'envvars' | schneefux | 2017-02-25 | 1 | -15/+32 |
| |\ | |||||
| | * | specify region and crawl times per env vars | schneefux | 2017-02-20 | 1 | -15/+32 |
| | | | |||||
| * | | ghost commit to re-initiate a PR | Kapil Viren Ahuja | 2017-02-21 | 1 | -0/+1 |
| | | | |||||
| * | | work around table creation race condition, delete unfinished crawljobs on ↵ | schneefux | 2017-02-20 | 1 | -15/+21 |
| | | | | | | | | | start, fix async error | ||||
| * | | partition data into tables per day and region | schneefux | 2017-02-20 | 1 | -10/+38 |
| |/ | |||||
| * | reduce job length, increase worker count to keep up with blitz data volume (#22) | schneefux | 2017-02-16 | 1 | -2/+2 |
| | | |||||
| * | Merge pull request #15 from vainglorygame/new_db_tables | Kapil Viren Ahuja | 2017-02-16 | 1 | -48/+34 |
| |\ | | | | | insert objects into dbs by type, upsert players when needed | ||||
| | * | insert objects into dbs by type, upsert players when needed | schneefux | 2017-02-15 | 1 | -48/+34 |
| | | | |||||
| * | | fix idling jobs crashing | schneefux | 2017-02-14 | 1 | -1/+1 |
| | | | |||||
| * | | fetch from 2017-02-14 onwards | schneefux | 2017-02-14 | 1 | -2/+2 |
| | | | |||||
| * | | workers sleep and don't die when they have no jobs | schneefux | 2017-02-14 | 1 | -1/+8 |
| |/ | |||||
| * | refactor and optimize storage requirements | schneefux | 2017-02-12 | 1 | -18/+31 |
| | | |||||
| * | rewrite for better concurrency support | schneefux | 2017-02-12 | 1 | -56/+206 |
| | | |||||
| * | tolerate connection errors | schneefux | 2017-02-08 | 1 | -3/+8 |
| | | |||||
| * | add all regions | schneefux | 2017-02-08 | 1 | -2/+2 |
| | | |||||
| * | refactor api.py | schneefux | 2017-02-08 | 1 | -22/+18 |
| | | |||||
| * | use logging module | schneefux | 2017-02-08 | 1 | -5/+6 |
| | | |||||
| * | fix api grabber: run forever | schneefux | 2017-02-07 | 1 | -12/+14 |
| | | |||||
| * | remove code not related to API data fetching | schneefux | 2017-02-07 | 1 | -32/+8 |
| | | |||||
| * | db connection params from env, fix early start | schneefux | 2017-02-07 | 1 | -1/+7 |
| | | |||||
| * | move into Docker | schneefux | 2017-02-06 | 1 | -2/+3 |
| | | |||||
| * | crawl regions peux a peux | schneefux | 2017-02-06 | 1 | -17/+29 |
| | | |||||
| * | make api.py independent | schneefux | 2017-02-06 | 1 | -3/+2 |
| | | |||||
| * | api: allow to be run from the root directory | schneefux | 2017-02-05 | 1 | -3/+3 |
| | | |||||
| * | manually push the earliest match to get | schneefux | 2017-02-05 | 1 | -1/+1 |
| | | |||||
