EKGF Ontologies / DataOps Ontology

EKGF Editor's Draft

DataOps Ontology

EKGF Editor's Draft

1. DataOps Ontology§

1.1 Overview§

DataOps Ontology

IdentifierValue
Ontology IRI / Namespacehttps://ekgf.org/ontology/dataops#
Prefixekg-dataops

A vocabulary for DataOps pipelines, RDF load requests, their processing states, and the single-graph and multi-graph datasets produced during loading and assembly.

1.2 Classes§

1.2.1 Failed RDF Load Request§

A load request classified as failed because its loading operation did not complete successfully.

ekg-dataops:FailedLoadRequest
https://ekgf.org/ontology/dataops#FailedLoadRequest
RDF predicateValue
rdf:typeowl:Class
rdfs:labelFailed RDF Load Request
rdfs:subClassOfekg-dataops:LoadRequest
UML class diagram for Failed RDF Load Request. Diagram labels: «owl:Class»; Failed RDF Load Request; «owl:Class»; RDF Load Request; Failed RDF Load Request rdfs:subClassOf RDF Load Request.«owl:Class»Failed RDF Load Request«owl:Class»RDF Load Request
Class neighborhood: Failed RDF Load Request [1]

1.2.2 Finished RDF Load Request§

A load request classified as finished after its loading operation has completed.

ekg-dataops:FinishedLoadRequest
https://ekgf.org/ontology/dataops#FinishedLoadRequest
RDF predicateValue
rdf:typeowl:Class
rdfs:labelFinished RDF Load Request
rdfs:subClassOfekg-dataops:LoadRequest
UML class diagram for Finished RDF Load Request. Diagram labels: «owl:Class»; Finished RDF Load; Request; «owl:Class»; RDF Load Request; Finished RDF Load Request rdfs:subClassOf RDF Load Request.«owl:Class»Finished RDF LoadRequest«owl:Class»RDF Load Request
Class neighborhood: Finished RDF Load Request [1]

1.2.3 RDF Load Request§

A LoadRequest represents an RDF file being loaded into the current RDF Graph Database.

ekg-dataops:LoadRequest
https://ekgf.org/ontology/dataops#LoadRequest
RDF predicateValue
rdf:typeowl:Class
rdfs:labelRDF Load Request
UML class diagram for RDF Load Request. Diagram labels: «owl:Class»; Failed RDF Load Request; «owl:Class»; Finished RDF Load; Request; «owl:Class»; RDF Load Request; Load Request Target Graph : xsd:anyURI; «owl:Class»; Loading RDF Load Request; «owl:Class»; Queued RDF Load Request; Failed RDF Load Request rdfs:subClassOf RDF Load Request. Finished RDF Load Request rdfs:subClassOf RDF Load Request. Loading RDF Load Request rdfs:subClassOf RDF Load Request. Queued RDF Load Request rdfs:subClassOf RDF Load Request. Load Request Target Graph rdfs:domain RDF Load Request. Load Request Target Graph rdfs:range xsd:anyURI.«owl:Class»Failed RDF Load Request«owl:Class»Finished RDF LoadRequest«owl:Class»RDF Load RequestLoad Request Target Graph : xsd:anyURI«owl:Class»Loading RDF Load Request«owl:Class»Queued RDF Load Request
Class neighborhood: RDF Load Request [1]

1.2.4 Loading RDF Load Request§

A load request whose loading operation is in progress.

ekg-dataops:LoadingLoadRequest
https://ekgf.org/ontology/dataops#LoadingLoadRequest
RDF predicateValue
rdf:typeowl:Class
rdfs:labelLoading RDF Load Request
rdfs:subClassOfekg-dataops:LoadRequest
UML class diagram for Loading RDF Load Request. Diagram labels: «owl:Class»; RDF Load Request; «owl:Class»; Loading RDF Load Request; Loading RDF Load Request rdfs:subClassOf RDF Load Request.«owl:Class»RDF Load Request«owl:Class»Loading RDF Load Request
Class neighborhood: Loading RDF Load Request [1]

1.2.5 Logical RDF Dataset§

A Multi-graph RDF Dataset can be constructed from one or more Single-graph RDF Datasets as they get loaded into a staging environment in the context of a pipeline. Usually the single-graph datasets get merged into the multi-graph dataset later on in the pipeline in order to construct a production-ready final RDF Dataset,

ekg-dataops:MultiGraphDataset
https://ekgf.org/ontology/dataops#MultiGraphDataset
RDF predicateValue
rdf:typeowl:Class
rdfs:labelLogical RDF Dataset
rdfs:subClassOfdcat:Dataset
UML class diagram for Logical RDF Dataset. Diagram labels: «owl:Class»; dcat:; Dataset; «owl:Class»; Logical RDF Dataset; Logical RDF Dataset rdfs:subClassOf dcat:Dataset.«owl:Class»dcat:Dataset«owl:Class»Logical RDF Dataset
Class neighborhood: Logical RDF Dataset [1]

1.2.6 Pipeline§

A DataOps process in which load requests bring source data into datasets and subsequent steps can assemble or transform that data.

ekg-dataops:Pipeline
https://ekgf.org/ontology/dataops#Pipeline
RDF predicateValue
rdf:typeowl:Class
rdfs:labelPipeline
UML class diagram for Pipeline. Diagram labels: «owl:Class»; dcat:; Dataset; «owl:Class»; RDF Load Request; «owl:Class»; Pipeline; Created By Pipeline; In Pipeline; Created By Pipeline rdfs:domain dcat:Dataset. Created By Pipeline rdfs:range Pipeline. In Pipeline rdfs:domain RDF Load Request. In Pipeline rdfs:range Pipeline.«owl:Class»dcat:Dataset«owl:Class»RDF Load Request«owl:Class»PipelineCreated By PipelineIn Pipeline
Class neighborhood: Pipeline [1]

1.2.7 Queued RDF Load Request§

A load request waiting to be processed by a pipeline.

ekg-dataops:QueuedLoadRequest
https://ekgf.org/ontology/dataops#QueuedLoadRequest
RDF predicateValue
rdf:typeowl:Class
rdfs:labelQueued RDF Load Request
rdfs:subClassOfekg-dataops:LoadRequest
UML class diagram for Queued RDF Load Request. Diagram labels: «owl:Class»; RDF Load Request; «owl:Class»; Queued RDF Load Request; Queued RDF Load Request rdfs:subClassOf RDF Load Request.«owl:Class»RDF Load Request«owl:Class»Queued RDF Load Request
Class neighborhood: Queued RDF Load Request [1]

1.2.8 Single-graph RDF Dataset§

A single-graph RDF dataset emerges to exist in an RDF graph dataset in the first stage of a pipeline, the load stage, where a given RDF file (usually an N-Triples or Turtle file in an S3 bucket) gets loaded into its own named graph where the IRI of the graph is equal to the S3 file URL. That would be a "single-graph RDF dataset" that usually ends up being merged into a "multi-graph RDF dataset" further down the road.

ekg-dataops:SingleGraphDataset
https://ekgf.org/ontology/dataops#SingleGraphDataset
RDF predicateValue
rdf:typeowl:Class
rdfs:labelSingle-graph RDF Dataset
rdfs:subClassOfdcat:Dataset
UML class diagram for Single-graph RDF Dataset. Diagram labels: «owl:Class»; dcat:; Dataset; «owl:Class»; RDF Load Request; «owl:Class»; Single-graph RDF Dataset; Loaded By Load Request; Single-graph RDF Dataset rdfs:subClassOf dcat:Dataset. Loaded By Load Request rdfs:domain Single-graph RDF Dataset. Loaded By Load Request rdfs:range RDF Load Request.«owl:Class»dcat:Dataset«owl:Class»RDF Load Request«owl:Class»Single-graph RDF DatasetLoaded By Load Request
Class neighborhood: Single-graph RDF Dataset [1]

1.3 Properties§

1.3.1 Created By Pipeline§

Identifies the DataOps pipeline that produced a dataset.

ekg-dataops:createdByPipeline
https://ekgf.org/ontology/dataops#createdByPipeline
RDF predicateValue
rdf:typeowl:ObjectProperty
rdfs:domaindcat:Dataset
rdfs:labelCreated By Pipeline
rdfs:rangeekg-dataops:Pipeline

1.3.2 Load Request Target Graph§

Records the IRI of the target graph for a load request as an xsd:anyURI literal.

ekg-dataops:graph
https://ekgf.org/ontology/dataops#graph
RDF predicateValue
rdf:typeowl:DatatypeProperty
rdf:typeowl:FunctionalProperty
rdfs:domainekg-dataops:LoadRequest
rdfs:labelLoad Request Target Graph
rdfs:rangexsd:anyURI

1.3.3 In Pipeline§

Identifies the pipeline to which a load request belongs. Each load request has at most one pipeline under the declared functional-property axiom.

ekg-dataops:inPipeline
https://ekgf.org/ontology/dataops#inPipeline
RDF predicateValue
rdf:typeowl:FunctionalProperty
rdf:typeowl:ObjectProperty
rdfs:domainekg-dataops:LoadRequest
rdfs:labelIn Pipeline
rdfs:rangeekg-dataops:Pipeline

1.3.4 Loaded By Load Request§

Relates a single-graph dataset to a load request that loaded its data.

ekg-dataops:loadedByLoadRequest
https://ekgf.org/ontology/dataops#loadedByLoadRequest
RDF predicateValue
rdf:typeowl:ObjectProperty
rdfs:domainekg-dataops:SingleGraphDataset
rdfs:labelLoaded By Load Request
rdfs:rangeekg-dataops:LoadRequest

1.3.5 Load Request Source IRI§

Records the IRI of the source to be loaded by a load request as an xsd:anyURI literal.

ekg-dataops:source
https://ekgf.org/ontology/dataops#source
RDF predicateValue
rdf:typeowl:DatatypeProperty
rdf:typeowl:FunctionalProperty
rdfs:domainekg-dataops:LoadRequest
rdfs:labelLoad Request Source IRI
rdfs:rangexsd:anyURI

Document provenance

Search this specification