Reproducibility
A result should come with a path back to the evidence.
Depending on the project, releases may include:
- Raw retrievals or retrieval instructions
- Processed data
- Source provenance
- Content hashes where appropriate
- Analytical code
- Configuration files
- Dependency information
- Random seeds
- Saved outputs
- Figures
- Tables
- Claim verification
- Replication instructions
- Known limitations
- Version history
- Corrections
Not every project includes every item. The list above describes what a serious Cumulant release aims to include.