Files

2.2 KiB

Provenance in mlsysim

Every Tier A number (registry entries and public Sourced scalars) must carry a Provenance record. Citation managers and prose live outside the package; MLSysIM stores structured lineage only.

Audit gates

Gate What it catches Tool
1. Registry metadata Hardware/model nodes without metadata.provenance audit_registries
2. Sourced scalars Literature.*, Ops.*, ReferenceStats.*, Infrastructure.Capacity.*, engine.calibration.* without notes/URL rules audit_literature_sourced, audit_infra_capacity, sourced registry checks
3. Appendix lineage Stale defaults.* or registry paths in assumption appendices without provenance audit_appendix_*

Run the package gate:

python -m mlsysim.tools.audit_provenance --scope all --strict

Where constants live

There is no mlsysim.core.defaults module. Organize by domain:

Namespace Examples
Systems.Reliability Component MTTF, recovery timeouts, checkpoint bandwidth
Systems.Nodes / Racks / Fabrics / Clusters / Pods Server/rack profiles, network tiers, fleet sizes
Systems.Orchestration Target utilization, queue discipline
Literature.* MFU bands, Chinchilla, communication and batch-size literature anchors
Infrastructure.Grids / FacilityCooling / Pricing / Capacity Carbon, PUE, cloud $ anchors, build-out lead times
Ops.Monitoring / TrainingRunOverheads PSI thresholds, KS coefficient, goodput-loss profiles
Scenarios.* Executable workload + system + constraint bundles
ReferenceStats.* Non-executable sourced world statistics and case-study anchors
core.calibration Default kwargs and internal heuristics for solver/engine internals

Do not duplicate registry fields across namespaces (chip unit_cost lives on Hardware.Cloud.* only).

Downstream checks

Rendered-content checks live outside the package. Those checks should consume MLSysIM through public registries such as Systems.Reliability.Gpu.mttf_hours and Literature.Training.MfuHigh; the package does not scan downstream content files.