DataOps Ontology
EKGF Editor's Draft
1. DataOps Ontology§
1.1 Overview§
DataOps Ontology
| Identifier | Value |
|---|---|
| Ontology IRI / Namespace | https://ekgf.org/ontology/dataops# |
| Prefix | ekg-dataops |
A vocabulary for DataOps pipelines, RDF load requests, their processing states, and the single-graph and multi-graph datasets produced during loading and assembly.
1.2 Classes§
1.2.1 Failed RDF Load Request§
A load request classified as failed because its loading operation did not complete successfully.
ekg-dataops:FailedLoadRequest | |
https://ekgf.org/ontology/dataops#FailedLoadRequest | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:Class |
rdfs:label | Failed RDF Load Request |
rdfs:subClassOf | ekg-dataops:LoadRequest |
1.2.2 Finished RDF Load Request§
A load request classified as finished after its loading operation has completed.
ekg-dataops:FinishedLoadRequest | |
https://ekgf.org/ontology/dataops#FinishedLoadRequest | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:Class |
rdfs:label | Finished RDF Load Request |
rdfs:subClassOf | ekg-dataops:LoadRequest |
1.2.3 RDF Load Request§
A LoadRequest represents an RDF file being loaded into the current RDF Graph Database.
ekg-dataops:LoadRequest | |
https://ekgf.org/ontology/dataops#LoadRequest | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:Class |
rdfs:label | RDF Load Request |
1.2.4 Loading RDF Load Request§
A load request whose loading operation is in progress.
ekg-dataops:LoadingLoadRequest | |
https://ekgf.org/ontology/dataops#LoadingLoadRequest | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:Class |
rdfs:label | Loading RDF Load Request |
rdfs:subClassOf | ekg-dataops:LoadRequest |
1.2.5 Logical RDF Dataset§
A Multi-graph RDF Dataset can be constructed from one or more Single-graph RDF Datasets as they get loaded into a staging environment in the context of a pipeline. Usually the single-graph datasets get merged into the multi-graph dataset later on in the pipeline in order to construct a production-ready final RDF Dataset,
ekg-dataops:MultiGraphDataset | |
https://ekgf.org/ontology/dataops#MultiGraphDataset | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:Class |
rdfs:label | Logical RDF Dataset |
rdfs:subClassOf | dcat:Dataset |
1.2.6 Pipeline§
A DataOps process in which load requests bring source data into datasets and subsequent steps can assemble or transform that data.
ekg-dataops:Pipeline | |
https://ekgf.org/ontology/dataops#Pipeline | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:Class |
rdfs:label | Pipeline |
1.2.7 Queued RDF Load Request§
A load request waiting to be processed by a pipeline.
ekg-dataops:QueuedLoadRequest | |
https://ekgf.org/ontology/dataops#QueuedLoadRequest | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:Class |
rdfs:label | Queued RDF Load Request |
rdfs:subClassOf | ekg-dataops:LoadRequest |
1.2.8 Single-graph RDF Dataset§
A single-graph RDF dataset emerges to exist in an RDF graph dataset in the first stage of a pipeline, the load stage, where a given RDF file (usually an N-Triples or Turtle file in an S3 bucket) gets loaded into its own named graph where the IRI of the graph is equal to the S3 file URL. That would be a "single-graph RDF dataset" that usually ends up being merged into a "multi-graph RDF dataset" further down the road.
ekg-dataops:SingleGraphDataset | |
https://ekgf.org/ontology/dataops#SingleGraphDataset | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:Class |
rdfs:label | Single-graph RDF Dataset |
rdfs:subClassOf | dcat:Dataset |
1.3 Properties§
1.3.1 Created By Pipeline§
Identifies the DataOps pipeline that produced a dataset.
ekg-dataops:createdByPipeline | |
https://ekgf.org/ontology/dataops#createdByPipeline | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:ObjectProperty |
rdfs:domain | dcat:Dataset |
rdfs:label | Created By Pipeline |
rdfs:range | ekg-dataops:Pipeline |
1.3.2 Load Request Target Graph§
Records the IRI of the target graph for a load request as an xsd:anyURI literal.
ekg-dataops:graph | |
https://ekgf.org/ontology/dataops#graph | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:DatatypeProperty |
rdf:type | owl:FunctionalProperty |
rdfs:domain | ekg-dataops:LoadRequest |
rdfs:label | Load Request Target Graph |
rdfs:range | xsd:anyURI |
1.3.3 In Pipeline§
Identifies the pipeline to which a load request belongs. Each load request has at most one pipeline under the declared functional-property axiom.
ekg-dataops:inPipeline | |
https://ekgf.org/ontology/dataops#inPipeline | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:FunctionalProperty |
rdf:type | owl:ObjectProperty |
rdfs:domain | ekg-dataops:LoadRequest |
rdfs:label | In Pipeline |
rdfs:range | ekg-dataops:Pipeline |
1.3.4 Loaded By Load Request§
Relates a single-graph dataset to a load request that loaded its data.
ekg-dataops:loadedByLoadRequest | |
https://ekgf.org/ontology/dataops#loadedByLoadRequest | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:ObjectProperty |
rdfs:domain | ekg-dataops:SingleGraphDataset |
rdfs:label | Loaded By Load Request |
rdfs:range | ekg-dataops:LoadRequest |
1.3.5 Load Request Source IRI§
Records the IRI of the source to be loaded by a load request as an xsd:anyURI literal.
ekg-dataops:source | |
https://ekgf.org/ontology/dataops#source | |
| RDF predicate | Value |
|---|---|
rdf:type | owl:DatatypeProperty |
rdf:type | owl:FunctionalProperty |
rdfs:domain | ekg-dataops:LoadRequest |
rdfs:label | Load Request Source IRI |
rdfs:range | xsd:anyURI |