Tracking Changes of Catalog via RSS

RSS feeds for recently updated datasets on

Interesting Observations

The datasets published at change on a weekly basis. In order to find out (1) what datasets are available on, and (2) which datasets were recently updated, we generate RSS feeds daily which use semantic web technologies. The following are some examples:
  • today-raw-ping.rss: list all raw datasets published at as of today, and update their date by pinging their data access points.
  • diff-today.rss: list recently added, deleted or updated datasets (raw dataset and tool catalog) since last catalog update (see figure).
  • twitter updates

Technology Highlights

Warning: Table './drupal/watchdog' is marked as crashed and last (automatic?) repair failed query: INSERT INTO watchdog (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (0, 'php', '%message in %file on line %line.', 'a:4:{s:6:\"%error\";s:12:\"user warning\";s:8:\"%message\";s:365:\"Table './drupal/accesslog' is marked as crashed and last (automatic?) repair failed\nquery: INSERT INTO accesslog (title, path, url, hostname, uid, sid, timer, timestamp) values('Tracking Changes of Catalog via RSS', 'node/64', '', '', 0, '7git4206n2mglkf8v6dkbg58v3', 30, 1618683632)\";s:5:\"%file\";s:58:\"/data/www/html/drupal/modules/statistics/statistics.module\";s:5:\"%line\";i:63;}', 3, '', ' in /data/www/html/drupal/includes/ on line 134