|
2 | 2 |
|
3 | 3 | ## [Unreleased]
|
4 | 4 |
|
5 |
| - - |
| 5 | + - |
| 6 | + |
| 7 | +## [1.0.0] Foundations - 2020-05-02 |
| 8 | + |
| 9 | +This is the first official release of ReBench as a "feature-complete" product. |
| 10 | +Feature-complete here means, it is a tried and tested tool for benchmark |
| 11 | +execution. It is highly |
| 12 | +[configurable](https://rebench.readthedocs.io/en/latest/config/), |
| 13 | +[documented](https://rebench.readthedocs.io/en/latest/), |
| 14 | +and [successfully used](https://github.com/smarr/ReBench#use-in-academia). |
| 15 | + |
| 16 | +This 1.0 release does not signify any new major features, but instead marks a |
| 17 | +point where ReBench has been stable and relieable for a long time. |
| 18 | + |
| 19 | +ReBench is designed to |
| 20 | + |
| 21 | + - enable reproduction of experiments; |
| 22 | + - document all benchmark parameters; |
| 23 | + - provide a flexible execution model, |
| 24 | + with support for interrupting and continuing benchmarking; |
| 25 | + - enable the definition of complex sets of comparisons |
| 26 | + and their flexible execution; |
| 27 | + - report results to continuous performance monitoring systems, |
| 28 | + e.g., Codespeed or ReBenchDB; |
| 29 | + - provide basic support for building/compiling benchmarks/experiments |
| 30 | + on demand; |
| 31 | + - be extensible to parse output of custom benchmark harnesses. |
| 32 | + |
| 33 | +ReBench isn't |
| 34 | + |
| 35 | + - a framework for microbenchmarks. |
| 36 | + Instead, it relies on existing harnesses and can be extended to parse their |
| 37 | + output. |
| 38 | + - a performance analysis tool. It is meant to execute experiments and |
| 39 | + record the corresponding measurements. |
| 40 | + - a data analysis tool. It provides only a bare minimum of statistics, |
| 41 | + but has an easily parseable data format that can be processed, e.g., with R. |
| 42 | + |
| 43 | +To use ReBench, install it with Python's pip: |
| 44 | + |
| 45 | +```bash |
| 46 | +pip install rebench |
| 47 | +``` |
| 48 | + |
| 49 | +### Acknowledgements |
| 50 | + |
| 51 | +ReBench has been used by a number of people over the years, and their feedback |
| 52 | +and [contributions](https://github.com/smarr/ReBench/graphs/contributors) |
| 53 | +made it what it is today. Not all of these contributions are recorded, |
| 54 | +but I'd still like to thank everyone, from the annoymous reviewer of artifacts, |
| 55 | +to the students who had to wade through bugs and missing documentation. |
| 56 | +Thank you! |
| 57 | + |
| 58 | +### Changes Since 1.0rc2 |
| 59 | + |
| 60 | + - moved CI to use GitHub Actions (#134) |
| 61 | + - added testing of Python 3.7 (#121) and ruamel.yaml (#123) |
| 62 | + - ensure config is YAML 1.2 compliant (#123) |
| 63 | + - added support for ReBenchDB (#129, #130) |
| 64 | + |
| 65 | + - fixed issues with error reporting (#128) |
| 66 | + - fixed handling of input size configuration (#117) |
6 | 67 |
|
7 | 68 | ## [1.0rc2] - 2019-06-09
|
8 | 69 |
|
|
83 | 144 | - [0.6.0] - 2014-05-19
|
84 | 145 | - [0.5.0] - 2014-03-25
|
85 | 146 |
|
86 |
| -[Unreleased]: https://github.com/smarr/ReBench/compare/v1.0rc2...HEAD |
| 147 | +[Unreleased]: https://github.com/smarr/ReBench/compare/v1.0.0...HEAD |
| 148 | +[1.0.0]: https://github.com/smarr/ReBench/compare/v1.0rc2...v1.0.0 |
87 | 149 | [1.0rc2]: https://github.com/smarr/ReBench/compare/v1.0rc1...v1.0rc2
|
88 | 150 | [1.0rc1]: https://github.com/smarr/ReBench/compare/v0.10.1...v1.0rc1
|
89 | 151 | [0.10.1]: https://github.com/smarr/ReBench/compare/v0.10.0...v0.10.1
|
|
0 commit comments