- Home
- HealthData.gov Challenge (2013)
- IOGDS: International Open Government Dataset Search (DEMO)
- IOGDS Analytics (V1)
- IOGDS Analytics (V2)
- Submit a Catalog to IOGDS
- Schema.org Dataset Extension (DEMO)
- Instance Hub demo (V.1)
- Instance Hub demo (V.2)
- URI Design Principles
- SW Challenge 2010
- Tutorials
- Videos
- Demos
- Datasets
- Tools & Technologies
- Community
- About Us
- Publications
- RSS Feed
User login
Navigation
Share
Procedure for Getting and Publishing Metadata for LOGD International OGD Catalog (IOGDS)
Summary
Given a catalog, metadata for each dataset is extracted and saved in a CSV file. csv2rdf4lod automation is then used to convert the CSV file into RDF. Four outputs are publicly accessible through https://scm.escience.rpi.edu/svn/public/logd-csv2rdf4lod/data/source/ for each catalog:
Workflow for getting metadata
Workflow for publishing a dataset catalog
Given a catalog, metadata for each dataset is extracted and saved in a CSV file. csv2rdf4lod automation is then used to convert the CSV file into RDF. Four outputs are publicly accessible through https://scm.escience.rpi.edu/svn/public/logd-csv2rdf4lod/data/source/ for each catalog:
| Example 2: data.gov.gh | |
|---|---|
| Metadata in csv format | https://scm.escience.rpi.edu/svn/public/logd-csv2rdf4lod/data/source/data-gov-gh/catalog/version/2013-May-06/manual/ghana.csv |
| Source code if any to get the metadata | T.B.D. |
| Conversion trigger | https://scm.escience.rpi.edu/svn/public/logd-csv2rdf4lod/data/source/data-gov-gh/catalog/version/2013-May-06/convert-catalog.sh |
| Enhancement file | https://scm.escience.rpi.edu/svn/public/logd-csv2rdf4lod/data/source/data-gov-gh/catalog/version/2013-May-06/manual/ghana.csv.e1.params.ttl |
Workflow for getting metadata
- Select a catalog
- List all datasets in the catalog and collect metadata for each dataset in a big table; save the table in CSV format
- Some catalogs provide a data dump, such as data.gov.uk; use the provided dump files
- For catalogs that do not provide a data dump, custom programs must be used (e.g. in Java, Python or otherwise) to extract the metadata
- Commit the CSV files and any corresponding source code to https://scm.escience.rpi.edu/svn/public/logd-csv2rdf4lod/data/source/
Workflow for publishing a dataset catalog
- Follow csv2rdf4lod conversion/enhancement process to convert the csv files into rdf, see details in https://github.com/timrdf/csv2rdf4lod-automation/wiki/Conversion-process-phases
- Run the converter to generate the default enhancement configuration
- Edit the enhancement configuration files to map the original metadata into designed metadata for LOGDC
- Re-run the converter to generate the rdf graph
- Commit the enhancement configuration files and conversion triggers to https://scm.escience.rpi.edu/svn/public/logd-csv2rdf4lod/data/source/
- 2832 reads
To the extent possible under law,
Tetherless World Constellation
has waived all copyright and related or neighboring rights to
TWC LOGD. TWC LOGD is an educational project on open government data using Semantic Web technologies.
Datasets hosted on this site are converted from a number of data sources such as data.gov. All data created by us are open for reuse, and usage of data created and managed by other sources should follow their own licenses.
The data contained on this site is automatically repopulated from US government or other open data sites, and any personal data in our linked-data versions is coming from those sources. If your information is removed from the government sources, it will be automatically removed from ours on the next update.
