Usage

One command, a list of paths and an optional output file.

Command-line reference

This is the output of triplify --help:

Triplify turns any tabular data dump (CSV, XLSX, Parquet, ...) into raw RDF using the EKGF Raw Data Ontology, with DCAT, PROV and git provenance, without any mapping

Usage: triplify [OPTIONS] [PATHS]...

Arguments:
  [PATHS]...  Files or directories to triplify (directories are walked, honouring .gitignore) [default: .]

Options:
  -o, --output <OUTPUT>  Output file: .nq, .nt (graphs merged) or .trig, optionally .gz. Defaults to N-Quads on stdout
      --canonical        Emit RDFC-1.0 canonical N-Quads/N-Triples (buffers the dataset in memory)
      --profile          Profile every column: exact value/null/distinct counts, most frequent value, an inferred datatype with its conforming count, and min/max/mean/std/percentiles. Costs memory per column and time
  -v, --verbose...       Increase logging verbosity
  -q, --quiet...         Decrease logging verbosity
  -h, --help             Print help
  -V, --version          Print version

Inputs

Give any mix of files and directories; with none, triplify reads the current directory. Directories are walked in parallel. The walk honours .gitignore, .git/info/exclude and your global Git excludes, and skips hidden files and directories.

Files are selected by extension, ignoring case:

ExtensionRead as
.csvcomma-separated text
.tsv, .tabtab-separated text
.xlsx, .xlsm, .xlsbExcel workbook
.xlsExcel 97-2003 workbook
.odsOpenDocument spreadsheet
.parquetApache Parquet

Other files are ignored, and so are Excel lock files such as ~$Book.xlsx. XLSX worksheets are read cell by cell, as a stream. Parquet files are read in batches of record rows, and every compression codec is supported (Snappy, Zstd, LZ4, Gzip, Brotli).

Output

The output file name selects the syntax. Add .gz to compress it with gzip.

OutputMeaning
(none)N-Quads on stdout
*.nq, *.nq.gzN-Quads, one named graph per source plus one for the run
*.nt, *.nt.gzN-Triples, the union of all graphs
*.trig, *.trig.gzTriG

Any other extension is an error. Output always streams, except with --canonical.

Canonical output

--canonical writes RDFC-1.0 canonical N-Quads or N-Triples, so that two runs over the same input can be compared byte for byte. This mode buffers the whole dataset in memory. It does not support TriG.

triplify ./dumps --canonical -o raw.nq

Column profiles

--profile adds data-quality measures to every column: counts, the most frequent value, an inferred datatype with its evidence, and numeric statistics. They are computed in the same streaming pass, which is far cheaper than computing them in SPARQL afterwards. They do cost memory for each column, so they are opt-in. See Output model for the measures and the inference policy.

triplify ./dumps --profile -o raw.nq.gz

Logging and exit status

Logs go to stderr. By default only warnings are shown; -v adds progress per file, -vv and -vvv add debugging detail, -q shows only errors and -qq nothing. The RUST_LOG environment variable overrides these flags.

A file that cannot be read is reported as a warning, and the other files are still triplified. The command then exits with a nonzero status that says how many sources failed.

Examples

# Every table under ./dumps, as compressed N-Quads
triplify ./dumps -o raw.nq.gz

# Two specific files, all graphs merged into N-Triples
triplify orders.csv rates.xlsx -o raw.nt

# The current directory, to stdout
triplify > raw.nq

Search documentation

Enter words to search this site.