summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* update joblibschneefux2017-03-081-0/+0
|
* start with only 1 db connectionschneefux2017-03-081-1/+2
|
* revert crawler import pathschneefux2017-03-081-1/+1
|
* allow to import apigrabber as a moduleschneefux2017-03-081-15/+16
|
* log API errorsschneefux2017-03-071-3/+2
|
* fix 'unknown encoding' bugschneefux2017-03-071-0/+1
|
* rm logschneefux2017-03-061-0/+0
|
* update joblibschneefux2017-03-061-0/+0
|
* update joblibschneefux2017-03-051-0/+0
|
* hotfix: filter casual/ranked matchesschneefux2017-03-051-1/+1
|
* tolerate API json errorschneefux2017-03-051-1/+3
|
* update joblibschneefux2017-03-051-0/+0
|
* run jobs in batches (#57)schneefux2017-03-053-22/+26
|
* refactor to use joblib worker classschneefux2017-03-042-43/+19
|
* use proper log paths for Dockerschneefux2017-03-012-1/+4
|
* Merge branch 'master' of https://github.com/vainglorygame/apigrabberschneefux2017-03-010-0/+0
|\
| * set api pagelimit to maximum (#49)schneefux2017-02-281-1/+6
| | | | | | | | | | | | * set api pagelimit to maximum * don't fail with 404 if a player was found
* | log to fileschneefux2017-03-012-2/+14
| |
* | reduce default worker idle cooldownschneefux2017-02-281-2/+2
| |
* | logs: be more quietschneefux2017-02-281-7/+2
| |
* | don't fail with 404 if a player was foundschneefux2017-02-271-0/+5
| |
* | set api pagelimit to maximumschneefux2017-02-271-1/+1
|/
* Merge branch 'multiple-workers'schneefux2017-02-271-13/+16
|\
| * support multiple threads per workerschneefux2017-02-261-13/+16
| |
* | Merge branch 'errors'schneefux2017-02-273-4/+14
|\|
| * catch more API bugsschneefux2017-02-261-1/+4
| |
| * report job fails in queueschneefux2017-02-263-3/+10
| |
* | Merge branch 'player-upsert'schneefux2017-02-272-102/+84
|\|
| * pass requested player name to job queueschneefux2017-02-261-0/+7
| |
| * fix players not being linked to participantschneefux2017-02-261-1/+1
| |
| * store api data as one json per matchschneefux2017-02-262-102/+77
| |
| * Merge branch 'pass-type' into developschneefux2017-02-262-10/+15
| |\
| * \ Merge branch 'pass-priority' into developschneefux2017-02-262-3/+4
| |\ \
* | | | Merge pull request #43 from vainglorygame/fix-participant-linksKapil Viren Ahuja2017-02-271-1/+1
|\| | | | | | | | | | | fix participants not being linked into roster
| * | | fix participants not being linked into rosterschneefux2017-02-261-1/+1
| | | |
* | | | Merge pull request #42 from vainglorygame/pass-typeKapil Viren Ahuja2017-02-272-10/+15
|\ \ \ \ | | |_|/ | |/| | pass object type to process job payload
| * | | pass object type to process job payloadschneefux2017-02-262-10/+15
| | |/ | |/|
* | | Merge pull request #41 from vainglorygame/pass-priorityKapil Viren Ahuja2017-02-272-3/+4
|\| | | | | | | | pass job priority to processor
| * | pass job priority to processorschneefux2017-02-262-3/+4
| |/
* | Merge pull request #39 from vainglorygame/redesignKapil Viren Ahuja2017-02-265-322/+184
|\| | | | | rewrite to use shared queue
| * rewrite to use shared queue, fixes #36schneefux2017-02-255-322/+184
| |
* | Merge pull request #37 from vainglorygame/ratelimitKapil Viren Ahuja2017-02-251-2/+2
|\ \ | |/ |/| update limits: cannot get more than 5 random matches
| * update limits: cannot get more than 5 random matchesschneefux2017-02-251-2/+2
| |
* | Merge pull request #35 from vainglorygame/ratelimitKapil Viren Ahuja2017-02-252-13/+26
|\| | | | | token env variable, rate limits
| * use gzip for API requestsschneefux2017-02-251-1/+1
| |
| * respect rate limitsschneefux2017-02-252-7/+18
| |
| * add VAINSOCIAL_APIKEY env variableschneefux2017-02-252-5/+7
|/
* Merge branch 'envvars'schneefux2017-02-251-15/+32
|\
| * specify region and crawl times per env varsschneefux2017-02-201-15/+32
| |
* | Merge pull request #34 from vainglorygame/partitioningKapil Viren Ahuja2017-02-211-18/+53
|\ \ | |/ |/| Partitioning