mirror of
https://github.com/harvard-edge/cs249r_book.git
synced 2026-07-21 00:23:30 -05:00
Vijay Janapa Reddi
cb0ae4082f
Run quartodoc build against the refactored package (engine/ extracted from core/, infra->infrastructure): regenerate the API reference so every stub points at the new paths. Adds engine.*/infrastructure.* stubs, removes the 41 stale core.solver.* / core.engine.* / core.scenarios.* / core.config.* / core.evaluation.* / infra*.qmd orphans, and refreshes the package pages (core now primitives-only) + index. Verified: all 47 documented symbols resolve in the new package; every index link resolves; zero stale mlsysim.core.<engine-mod> / mlsysim.infra references anywhere in docs/. (objects.json inventory is gitignored -- regenerated at build.)
47 lines
2.2 KiB
Plaintext
47 lines
2.2 KiB
Plaintext
# engine.solver.ReliabilityModel { #mlsysim.engine.solver.ReliabilityModel }
|
|
|
|
```python
|
|
engine.solver.ReliabilityModel()
|
|
```
|
|
|
|
Calculates Mean Time Between Failures (MTBF) and optimal checkpointing intervals.
|
|
|
|
This model handles the reliability modeling of massive clusters, helping
|
|
determine the 'Goodput' of long-running training jobs. It identifies
|
|
the probability of a job failure before completion and calculates the
|
|
Young-Daly optimal interval to minimize wasted compute time.
|
|
|
|
Literature Source:
|
|
1. Young (1974), "A First-Order Approximation to the Optimum Checkpoint
|
|
Interval."
|
|
2. Daly (2006), "A Higher Order Estimate of the Optimum Checkpoint
|
|
Interval for Restart-Dump Strategy."
|
|
|
|
## Methods
|
|
|
|
| Name | Description |
|
|
| --- | --- |
|
|
| [solve](#mlsysim.engine.solver.ReliabilityModel.solve) | Calculates reliability and checkpointing metrics for a fleet. |
|
|
|
|
### solve { #mlsysim.engine.solver.ReliabilityModel.solve }
|
|
|
|
```python
|
|
engine.solver.ReliabilityModel.solve(
|
|
fleet,
|
|
job_duration_hours,
|
|
checkpoint_time_s=60.0,
|
|
avg_recovery_time_s=300.0,
|
|
)
|
|
```
|
|
|
|
Calculates reliability and checkpointing metrics for a fleet.
|
|
|
|
#### Parameters {.doc-section .doc-section-parameters}
|
|
|
|
| Name | Type | Description | Default |
|
|
|---------------------|--------|-------------------------------------------------------------------------------------------------------------------------------|------------|
|
|
| fleet | Fleet | The hardware cluster configuration. | _required_ |
|
|
| job_duration_hours | float | Total job duration in hours. | _required_ |
|
|
| checkpoint_time_s | float | Time to write one checkpoint in seconds (default 60s). | `60.0` |
|
|
| avg_recovery_time_s | float | Average time to recover from a failure in seconds (default 300s). Includes checkpoint reload, process restart, and re-warmup. | `300.0` |
|