View source for WebSchemas/Datasets

{{Template:SchemaDotOrgProposal|name=Datasets|status=Published}}
== Overview ==
This page discusses a proposal extending schema.org for describing datasets and data catalogs.  For additional information, see this [https://logd.tw.rpi.edu/schemaorg_dataset_extension demo page]. [mailto:shinaj@rpi.edu Comments] on this proposal are welcome.
== Status ==
We have a detailed proposal here, and something in this direction is a strong candidate for official addition to schema.org.
The natural next steps before finalizing the addition are:
* some indication from potential publishers that there is willingness to adopt, and that the design is a good fit to existing sites/content
* some positive indication from relevant experts (eg. open gov data publishers; from W3C's [https://www.w3.org/2011/gld/wiki/Main_Page Government Linked Data group] or others) that the schema has had some careful review. Comments can be here in the Wiki, to the public-vocabs@w3.org list (see details at [[WebSchemas]] page), or passed along via mail to danbri@google.com.
== Vocabulary ==
The Datasets extension introduces three new types, with associated properties:
* [https://schema.org/Thing Thing] > [https://schema.org/CreativeWork CreativeWork] > '''[https://logd.tw.rpi.edu/node/11401 Dataset]''': a body of structured information describing some topic(s) of interest
** '''catalog'''([https://logd.tw.rpi.edu/datacatalog DataCatalog]): the data catalog which contains a dataset
** '''distribution'''([https://logd.tw.rpi.edu/datadownload DataDownload]): a downloadable form of this dataset, at a specific location, in a specific format
** '''spatial'''([https://schema.org/Place Place]): the range of spatial applicability of a dataset, e.g. for a dataset of New York weather, the state of New York
** '''temporal'''(DateTime): the range of temporal applicability of a dataset, e.g. for a 2011 census dataset, the year 2011 (in [https://en.wikipedia.org/wiki/ISO_8601 ISO 8601] time interval format)
* [https://schema.org/Thing Thing] > [https://schema.org/CreativeWork CreativeWork] > '''[https://logd.tw.rpi.edu/datacatalog DataCatalog]''': a collection of datasets
** '''dataset'''([https://logd.tw.rpi.edu/node/11401 Dataset]): a dataset contained in a catalog
* [https://schema.org/Thing Thing] > [https://schema.org/CreativeWork CreativeWork] > [https://schema.org/MediaObject MediaObject] > '''[https://logd.tw.rpi.edu/datadownload DataDownload]''': a dataset in downloadable form
== Example ==
=== Microdata markup ===
<pre>
<div itemscope="itemscope" itemtype="https://schema.org/Dataset" itemid="https://example.org/datasets/seismic-hazard-zones">
    <meta itemprop="url" content="https://www.example.org/story.php?title=seismic-hazard-zones"/>
    <span itemprop="name">
        <a href="https://www.example.org/story.php?title=seismic-hazard-zones">
            <b>Seismic Hazard Zones</b>
        </a>
    </span>
    (<span itemprop="temporal">2011</span>, version &quot;<span itemprop="version">2011-Sep-13</span>&quot;)
    <div itemprop="description">This is a dataset of liquefaction and landslide zones in the state of California.</div>
    <div itemprop="spatial" itemscope="itemscope" itemtype="https://schema.org/Country" itemid="https://dbpedia.org/resource/United_States">
        <i>Country:</i>
        <a href="https://en.wikipedia.org/wiki/United_States">
            <span itemprop="name">United States</span>
        </a>
    </div>
    <div itemprop="publisher" itemscope="itemscope" itemtype="https://schema.org/Organization"><i>Publisher:</i>
        <span itemprop="name">Department of Technology</span>
        <span itemprop="email">dot at example dot org</span>
    </div>
    <div><i>Topics:</i>
        <span itemprop="about" itemscope="itemscope" itemtype="https://schema.org/Thing" itemid="https://dbpedia.org/resource/Seismic_hazard">
            <a href="https://en.wikipedia.org/wiki/Seismic_hazard"><span itemprop="name">seismic hazard</span></a>
        </span>
    </div>
    <div><i>Keywords:</i>
        <span itemprop="keywords"><span itemscope="itemscope" itemtype="https://schema.org/Text">layers</span></span>,
        <span itemprop="keywords"><span itemscope="itemscope" itemtype="https://schema.org/Text">geography</span></span>,
        <span itemprop="keywords"><span itemscope="itemscope" itemtype="https://schema.org/Text">maps</span></span>,
        <span itemprop="keywords"><span itemscope="itemscope" itemtype="https://schema.org/Text">gis</span></span>
    </div>
    <div itemprop="license" itemscope="itemscope" itemtype="https://schema.org/Webpage"><i>License:</i>
        <a href="https://opendatacommons.org/licenses/pddl/1.0/">
            <span itemprop="name">ODC Public Domain Dedication and Licence (PDDL)</span>
        </a>
        <meta itemprop="url" content="https://opendatacommons.org/licenses/pddl/1.0/" />
    </div>
    <div itemprop="distribution" itemscope="itemscope" itemtype="https://schema.org/DataDownload"><i>Download:</i>
        <a href="https://example.org/downloads/seismic-hazard-zones.nt.gz">
            <meta itemprop="encodingFormat" content="text/plain" />
            <meta itemprop="contentUrl" content="https://example.org/downloads/seismic-hazard-zones.nt.gz" />
            <meta itemprop="inLanguage" content="en" />
            <span itemprop="description">compressed N-Triples dump</span>,
            <span itemprop="datePublished" content="2011-08-12">August 12, 2011</meta>
            <span itemprop="contentSize" content="13.9">(13.97MB)</span>
	</a>
    </div>
</div>
</pre>
=== embedded data ===
<pre>
Item 
type: https://schema.org/dataset	
name: Seismic Hazard Zones
temporal: 2011
version: 2011-Sep-13
url: https://www.example.org/story.php?title=seismic-hazard-zones
description: This is a dataset of liquefaction and landslide zones in the state of California.
spatial: Item 1
publisher: Item 2
about: Item 3
keywords: layers
keywords: geography
keywords: maps
keywords: gis
license: Item 4
distribution: Item 5
Item 1
type: https://schema.org/country
name: United States
Item 2
type: https://schema.org/organization
name: Department of Technology
email: dot at example dot org
Item 3
type: https://schema.org/thing
name: seismic hazard
Item 4
type: https://schema.org/webpage
name: ODC Public Domain Dedication and Licence (PDDL)
url: https://opendatacommons.org/licenses/pddl/1.0/
Item 5
type: https://schema.org/datadownload
encodingformat: text/plain
contenturl: https://example.org/downloads/seismic-hazard-zones.nt.gz
inlanguage: en
description: compressed N-Triples dump
datepublished: 2011-08-12
contentsize: 13.9
</pre>
=== equivalent RDFa 1.1 markup ===
<pre>
<div vocab="https://schema.org/" prefix="dcat: https://www.w3.org/ns/dcat#" typeof="Dataset dcat:Dataset"
     about="https://example.org/datasets/seismic-hazard-zones">
 
    <meta property="url" content="https://www.example.org/story.php?title=seismic-hazard-zones"/>
    <span property="name"><b><a href="https://www.example.org/story.php?title=seismic-hazard-zones">Seismic Hazard Zones</a></b></span>
    (<span property="temporal">2011</span>, version &quot;2011-Sep-13&quot;)
    <div property="description">This is a dataset of liquefaction and landslide zones in the state of California.</div>
    <div rel="spatial" resource="https://dbpedia.org/resource/United_States"><i>Country:</i>
        <a href="https://dbpedia.org/resource/United_States">
            <span about="https://dbpedia.org/resource/United_States" typeof="Country">
                <span property="name">United States</span>
            </span>
        </a>
    </div>
    <div rel="publisher"><i>Publisher:</i>
        <span typeof="Organization">
            <span property="name">Department of Technology</span>
	    (<span property="email">dot at example dot org</span>)
        </span>
    </div>
    <div><i>Topics:</i>
        <span rel="about" resource="https://dbpedia.org/resource/Seismic_hazard">
            <a href="https://en.wikipedia.org/wiki/Seismic_hazard">
                <span property="name">seismic hazard</span></a>
        </span>
    </div>
    <div><i>Keywords:</i>
        <span property="keywords">layers</span>,
        <span property="keywords">geography</span>,
        <span property="keywords">maps</span>,
        <span property="keywords">gis</span>
    </div>
    <div rel="license"><i>License:</i>
    	<a href="https://opendatacommons.org/licenses/pddl/1.0/">
	<span typeof="Webpage">
	    <span property="name">ODC Public Domain Dedication and Licence (PDDL)</span>
	    <meta property="url" content="https://opendatacommons.org/licenses/pddl/1.0/"/>
	</span>
	</a>
    </div>
    
    <div rel="distribution"><i>Download:</i>
        <a href="https://example.org/downloads/seismic-hazard-zones.nt.gz">
        <span typeof="DataDownload">
            <meta property="encodingFormat" content="text/plain" />
            <meta property="contentUrl" content="https://example.org/downloads/seismic-hazard-zones.nt.gz" />
            <meta property="inLanguage" content="en" />
            <span property="description">compressed N-Triples dump</span>,
            <meta property="datePublished" content="2011-08-12">August 12, 2011</meta>
            <meta property="contentSize" content="13.9">(13.97MB)</span>
	</span>
	</a>
    </div>
</div>
</pre>
=== RDFa 1.1 Lite markup ===
<pre>
<div vocab="https://schema.org/" prefix="dcat: https://www.w3.org/ns/dcat#" typeof="Dataset dcat:Dataset"
     about="https://example.org/datasets/seismic-hazard-zones">
    <meta property="url" content="https://www.example.org/story.php?title=seismic-hazard-zones"/>
    <span property="name"><b><a href="https://www.example.org/story.php?title=seismic-hazard-zones">Seismic Hazard Zones</a></b></span>
    (<span property="temporal">2011</span>, version &quot;2011-Sep-13&quot;)
    <div property="description">This is a dataset of liquefaction and landslide zones in the state of California.</div>
    <div><i>Keywords:</i>
        <span property="keywords">layers</span>,
        <span property="keywords">geography</span>,
        <span property="keywords">maps</span>,
        <span property="keywords">gis</span>
    </div>
</div>
</pre>
== Related vocabularies ==
* [https://www.w3.org/TR/vocab-dcat/ Data Catalog Vocabulary] (DCAT)
* [https://www.w3.org/TR/vocab-adms/ Asset Description Metadata Schema] (ADMS)
* [https://www.w3.org/TR/void/ Vocabulary of Interlinked Datasets] (VoID)
* [https://logd.tw.rpi.edu/lab/project/logd_internaltional_ogd_catalog/metadata_design/ vocabulary] of the International Open Government Search service (derived from the above)
* [https://www.w3.org/TR/vocab-data-cube/ RDF Data Cube Vocabulary]
=== Mappings ===
This table maps Datasets extension types and properties (including supporting schema.org vocabulary) to and from their approximate equivalents in [https://www.w3.org/TR/vocab-dcat/ DCAT] and [https://vocab.deri.ie/void/ VoID]. A further relevant vocabulary, [https://www.w3.org/TR/vocab-adms ADMS], is a profile (specialization) of DCAT. Only the terms that are specialized in ADMS are listed separately, otherwise it uses DCAT.
{| border="1" style="text-align:left; color: #3A4956; background-color:#eeeeee; font-family: "Lucida Grande" , "Lucida Sans Unicode" , Verdana, Tahoma, Arial, sans-serif;" cellpadding="5" cellspacing="0" border="1" 
!Datasets extension
!DCAT
!ADMS
!VoID
|-
|sdo:DataCatalog
|dcat:Catalog
|adms:AssetRepository (sub class of dcat:Catalog)
|
|-
|sdo:DataDownload
|dcat:Distribution
|adms:AssetDistribution (sub class of dcat:Distribution)
|
|-
|sdo:Dataset
|dcat:Dataset
|adms:Asset (sub class of dcat:Dataset)
|void:Dataset
|-
|sdo:catalog
|
|
|
|-
|sdo:dataset
|dcat:dataset
|
|
|-
|sdo:distribution
|dcat:distribution
|
|void:dataDump 
|-
|sdo:spatial
|dcterms:spatial
|
|
|-
|sdo:temporal
|dcterms:temporal
|
|
|-
|sdo:about
|dcat:theme
|
|
|-
|sdo:contentSize
|dcat:byteSize
|
|
|-
|sdo:contentUrl
|dcat:downloadURL
|
|
|-
|sdo:dateModified
|dcterms:modified
|
|
|-
|sdo:datePublished
|dcterms:issued
|
|
|-
|sdo:description
|dcterms:description
|
|
|-
|sdo:encodingFormat
|dcterms:format
|
|
|-
|sdo:inLanguage
|dcterms:language
|
|
|-
|sdo:keywords
|dcat:keyword
|
|
|-
|sdo:name
|dcterms:title
|
|
|-
|sdo:Organization
|foaf:Organization
|
|
|-
|sdo:Person
|foaf:Person
|
|
|-
|sdo:publisher
|dcterms:publisher
|
|
|-
|sdo:Thing
|skos:Concept
|
|
|-
|sdo:url
|foaf:homepage
|
|
|-
|sdo:version
|
|owl:versionInfo (also adms:versionNotes)
|
|-
|
|dcat:CatalogRecord
|
|
|-
|
|dcat:Distribution
|
|
|-
|
|dcat:byteSize
|
|
|-
|
|dcat:downloadURL
|
|
|-
|
|dcat:landingPage
|
|
|-
|
|dcat:mediaType
|
|
|-
|
|dcat:record
|
|
|-
|
|dcat:themeTaxonomy
|
|
|-
|
|dcterms:accrualPeriodicity
|
|
|-
|
|dcterms:identifier
|
|
|-
|
|dcterms:license
|
|
|-
|
|foaf:primaryTopic
|
|
|-
|
|skos:ConceptScheme
|
|
|-
|
|
|adms:Identifier
|
|-
|
|
|adms:identifier
|
|-
|
|
|adms:includedAsset
|
|-
|
|
|adms:interoperabilityLevel
|
|-
|
|
|adms:last
|
|-
|
|
|adms:next
|
|-
|
|
|adms:prev
|
|-
|
|
|adms:representationTechnique
|
|-
|
|
|adms:schemeAgency
|
|-
|
|
|adms:status
|
|-
|
|
|adms:versionNotes
|
|-
|
|
|
|void:class
|-
|
|
|
|void:classes
|-
|
|
|
|void:classPartition
|-
|
|
|
|void:DatasetDescription
|-
|
|
|
|void:distinctObjects
|-
|
|
|
|void:distinctSubjects
|-
|
|
|
|void:documents
|-
|
|
|
|void:entities
|-
|
|
|adms:sample
|void:exampleResource
|-
|
|
|
|void:feature
|-
|
|
|
|void:inDataset
|-
|
|
|
|void:linkPredicate
|-
|
|
|
|void:Linkset
|-
|
|
|
|void:objectsTarget
|-
|
|
|
|void:openSearchDescription
|-
|
|
|
|void:properties
|-
|
|
|
|void:property
|-
|
|
|
|void:propertyPartition
|-
|
|
|
|void:rootResource
|-
|
|
|
|void:sparqlEndpoint
|-
|
|
|
|void:subjectsTarget
|-
|
|
|
|void:subset
|-
|
|
|
|void:target
|-
|
|
|
|void:TechnicalFeature
|-
|
|
|
|void:triples
|-
|
|
|
|void:uriLookupEndpoint
|-
|
|
|
|void:uriRegexPattern
|-
|
|
|
|void:uriSpace
|-
|
|
|adms:supportedSchema
|void:vocabulary
|}
== See also ==
* [https://semanticweb.com/closing-in-on-a-million-open-government-data-sets_b29994 Closing In On A Million Open Government Data Sets]