diff options
| author | Jordi De Groof <jordi.degroof@gmail.com> | 2015-08-31 17:19:45 +0200 |
|---|---|---|
| committer | Jordi De Groof <jordi.degroof@gmail.com> | 2015-08-31 17:19:45 +0200 |
| commit | 87eeefe9a1fa4d55c93a209314dcc5834a2e2391 (patch) | |
| tree | e34953a836a870a4f165599eb2ec1fdfa29c6fd8 /itworld.com.txt | |
| parent | 3522e412afc29a2f04bd7c915a4cec4c9b049d7a (diff) | |
| download | ftr-site-config-87eeefe9a1fa4d55c93a209314dcc5834a2e2391.tar.gz ftr-site-config-87eeefe9a1fa4d55c93a209314dcc5834a2e2391.zip | |
All sites in the IDG network have the same structure
Diffstat (limited to 'itworld.com.txt')
| -rw-r--r-- | itworld.com.txt | 22 |
1 files changed, 17 insertions, 5 deletions
diff --git a/itworld.com.txt b/itworld.com.txt index 1ee0ee5..9898309 100644 --- a/itworld.com.txt +++ b/itworld.com.txt @@ -1,5 +1,17 @@ -title: //*[@id="article-title"] -author: //*[@id="article-info"]/strong -date: //*[@class="article-dateline"]/strong -body: //*[@id="article-content"] -test_url: http://www.itworld.com/open-source/140916/android-sued-microsoft-not-linux
\ No newline at end of file +# All sites of the IDG network can be extracted using the same rules, +# make sure to update all of them + +author: //meta[@name="author"]/@content +date: //meta[@name="DC.date.issued"]/@content + +body: //div[@itemprop="articleBody"] +body: //div[@itemprop="reviewBody"] +body: //figcaption|//div[@class="img-wrapper"]/noscript/img + +next_page_link: //a[@rel="next"] + +strip: //aside +strip: //h3[contains(., "See also:")] +strip: //div[@id="article-top-page-number"] +strip: //p[starts-with(normalize-space(.), '[')] +strip: //p[starts-with(normalize-space(.), '+')] |