| Commit message (Collapse) | Author | Age | Files | Lines |
|---|
| |
|
|
|
|
|
|
| |
* Add configuration for dailymotion, interview magazine, it's foss, le vent se lève, le monde informatique, stackexchange, the linux documentation project, turnoff.us
* Set same file mode on each file
* Rename stackexchange.com.txt to .stackexchange.com.txt
|
| |
|
|
|
|
|
|
|
|
|
|
|
| |
This commit fixes the next_page_link detection for heise.de/ct/
articles, where the next-link (<a> with class=next) refers to the next
article and not to the next page. Therefore i added a check, that the
link text does not contain the word "Artikel".
Without that check all consecutive articles are fetched, altough they
are new articles and not a follow-up page of the same article.
e.g.:
https://www.heise.de/ct/ausgabe/2017-6-DVB-T2-HD-startet-in-Deutschland-3636637.html
|
| |
|
|
|
|
| |
* Fix LF / CRLF
* Fix some typos
|
| |
|
|
|
|
|
|
|
|
|
| |
adds a new test url pointing to a heise autos article, which is http://heise.de/-3527918 and gets resolved to https://www.heise.de/autos/artikel/China-Sondersteuer-auf-besonders-teure-Autos-3527918.html?view=print
The latter contains an h1 tag, which does not include the real title of
the article, but instead the date of the article:
<h1><span class="untertitel">01.12.2016</span></h1>
Removing the title param from this config fixes this issue, also not
destroying fetching title of other heise.de test_urls and keeping those
intact.
|
| |
|
|
|
|
|
|
|
|
|
|
| |
(#209)
* Update heise.de.txt for telepolis-articles
Added single_page_link for printing versions in articles at heise.de/tp/
* Update heise.de.txt for ct-articles
in articles at heise.de/ct there is no print/single-page-link, so a next_page_link is needed
|
| |
|
|
|
|
| |
* futurezone.at: Update site config.
* heise.de: Fix extraction of author and single page link.
|
| | |
|
| | |
|
| | |
|
| |
|
