summaryrefslogtreecommitdiff
Commit message (Expand)AuthorAgeFilesLines
* don't fail with 404 if a player was foundschneefux2017-02-271-0/+5
* set api pagelimit to maximumschneefux2017-02-271-1/+1
* Merge branch 'multiple-workers'schneefux2017-02-271-13/+16
|\
| * support multiple threads per workerschneefux2017-02-261-13/+16
* | Merge branch 'errors'schneefux2017-02-273-4/+14
|\|
| * catch more API bugsschneefux2017-02-261-1/+4
| * report job fails in queueschneefux2017-02-263-3/+10
* | Merge branch 'player-upsert'schneefux2017-02-272-102/+84
|\|
| * pass requested player name to job queueschneefux2017-02-261-0/+7
| * fix players not being linked to participantschneefux2017-02-261-1/+1
| * store api data as one json per matchschneefux2017-02-262-102/+77
| * Merge branch 'pass-type' into developschneefux2017-02-262-10/+15
| |\
| * \ Merge branch 'pass-priority' into developschneefux2017-02-262-3/+4
| |\ \
* | | | Merge pull request #43 from vainglorygame/fix-participant-linksKapil Viren Ahuja2017-02-271-1/+1
|\| | |
| * | | fix participants not being linked into rosterschneefux2017-02-261-1/+1
* | | | Merge pull request #42 from vainglorygame/pass-typeKapil Viren Ahuja2017-02-272-10/+15
|\ \ \ \ | | |_|/ | |/| |
| * | | pass object type to process job payloadschneefux2017-02-262-10/+15
| | |/ | |/|
* | | Merge pull request #41 from vainglorygame/pass-priorityKapil Viren Ahuja2017-02-272-3/+4
|\| |
| * | pass job priority to processorschneefux2017-02-262-3/+4
| |/
* | Merge pull request #39 from vainglorygame/redesignKapil Viren Ahuja2017-02-265-322/+184
|\|
| * rewrite to use shared queue, fixes #36schneefux2017-02-255-322/+184
* | Merge pull request #37 from vainglorygame/ratelimitKapil Viren Ahuja2017-02-251-2/+2
|\ \ | |/ |/|
| * update limits: cannot get more than 5 random matchesschneefux2017-02-251-2/+2
* | Merge pull request #35 from vainglorygame/ratelimitKapil Viren Ahuja2017-02-252-13/+26
|\|
| * use gzip for API requestsschneefux2017-02-251-1/+1
| * respect rate limitsschneefux2017-02-252-7/+18
| * add VAINSOCIAL_APIKEY env variableschneefux2017-02-252-5/+7
|/
* Merge branch 'envvars'schneefux2017-02-251-15/+32
|\
| * specify region and crawl times per env varsschneefux2017-02-201-15/+32
* | Merge pull request #34 from vainglorygame/partitioningKapil Viren Ahuja2017-02-211-18/+53
|\ \ | |/ |/|
| * ghost commit to re-initiate a PRKapil Viren Ahuja2017-02-211-0/+1
| * work around table creation race condition, delete unfinished crawljobs on sta...schneefux2017-02-201-15/+21
| * partition data into tables per day and regionschneefux2017-02-201-10/+38
|/
* catch ssl RuntimeError and retry (#24)schneefux2017-02-161-1/+1
* reduce job length, increase worker count to keep up with blitz data volume (#22)schneefux2017-02-161-2/+2
* Merge pull request #15 from vainglorygame/new_db_tablesKapil Viren Ahuja2017-02-161-48/+34
|\
| * insert objects into dbs by type, upsert players when neededschneefux2017-02-151-48/+34
* | Merge pull request #13 from vainglorygame/hotfix_servererrorKapil Viren Ahuja2017-02-161-4/+9
|\ \
| * | ignore server errorsschneefux2017-02-151-4/+9
| |/
* | Merge pull request #12 from vainglorygame/worker_boredKapil Viren Ahuja2017-02-151-3/+10
|\ \ | |/ |/|
| * fix idling jobs crashingschneefux2017-02-141-1/+1
| * fetch from 2017-02-14 onwardsschneefux2017-02-141-2/+2
| * workers sleep and don't die when they have no jobsschneefux2017-02-141-1/+8
|/
* refactor and optimize storage requirementsschneefux2017-02-121-18/+31
* rewrite for better concurrency supportschneefux2017-02-123-171/+206
* Merge branch 'master' of https://github.com/vainglorygame/apigrabberschneefux2017-02-113-32/+36
|\
| * tolerate connection errorsschneefux2017-02-081-3/+8
| * add all regionsschneefux2017-02-081-2/+2
| * refactor api.pyschneefux2017-02-081-22/+18
| * use logging moduleschneefux2017-02-083-8/+11