Design Notes#

Notes on the decisions behind pyml-datasets: why the provenance of a dataset is written in one place, how the legal rules are enforced, and how missing values are stored.

Single source of truth

Why DatasetInfo is the only place where a fact about a dataset is written.

The legal gate

Which licenses are accepted, and what fails when evidence is missing.

Missing values

Why NaN and integer codes, and what the package does not do.