Tracking Changes of data.gov Catalog via RSS

Description: 
RSS feeds for recently updated datasets on data.gov
Contributor:

Interesting Observations

The datasets published at data.gov change on a weekly basis. In order to find out (1) what datasets are available on data.gov, and (2) which datasets were recently updated, we generate RSS feeds daily which use semantic web technologies. The following are some examples:
  • today-raw-ping.rss: list all raw datasets published at data.gov as of today, and update their date by pinging their data access points.
  • diff-today.rss: list recently added, deleted or updated datasets (raw dataset and tool catalog) since last catalog update (see figure).
  • http://twitter.com/datagovwiki twitter updates

Technology Highlights


Warning: Table './drupal/watchdog' is marked as crashed and last (automatic?) repair failed query: INSERT INTO watchdog (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (0, 'php', '%message in %file on line %line.', 'a:4:{s:6:\"%error\";s:12:\"user warning\";s:8:\"%message\";s:362:\"Table './drupal/accesslog' is marked as crashed and last (automatic?) repair failed\nquery: INSERT INTO accesslog (title, path, url, hostname, uid, sid, timer, timestamp) values('Tracking Changes of data.gov Catalog via RSS', 'node/64', '', '10.0.1.254', 0, '32cfb33o22kigd8uncbvu62et5', 57, 1575630018)\";s:5:\"%file\";s:58:\"/data/www/html/drupal/modules/statistics/statistics.module\";s:5:\"%line\";i:63;}', 3, '', 'https://logd.tw.rpi.edu/demo/tracking_c in /data/www/html/drupal/includes/database.mysqli.inc on line 134