Skip to content

Commit c27a309

Browse files
authored
WEB: Update benchmarks page (#61289)
1 parent 5f354ca commit c27a309

File tree

1 file changed

+7
-45
lines changed

1 file changed

+7
-45
lines changed

Diff for: web/pandas/community/benchmarks.md

+7-45
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ kinds of benchmarks relevant to pandas:
1111

1212
pandas benchmarks are implemented in the [asv_bench](https://github.com/pandas-dev/pandas/tree/main/asv_bench)
1313
directory of our repository. The benchmarks are implemented for the
14-
[airspeed velocity](https://asv.readthedocs.io/en/v0.6.1/) (asv for short) framework.
14+
[airspeed velocity](https://asv.readthedocs.io/en/latest/) (asv for short) framework.
1515

1616
The benchmarks can be run locally by any pandas developer. This can be done
1717
with the `asv run` command, and it can be useful to detect if local changes have
@@ -22,53 +22,15 @@ More information on running the performance test suite is found
2222
Note that benchmarks are not deterministic, and running in different hardware or
2323
running in the same hardware with different levels of stress have a big impact in
2424
the result. Even running the benchmarks with identical hardware and almost identical
25-
conditions produces significant differences when running the same exact code.
25+
conditions can produce significant differences when running the same exact code.
2626

27-
## pandas benchmarks servers
27+
## Automated benchmark runner
2828

29-
We currently have two physical servers running the benchmarks of pandas for every
30-
(or almost every) commit to the `main` branch. The servers run independently from
31-
each other. The original server has been running for a long time, and it is physically
32-
located with one of the pandas maintainers. The newer server is in a datacenter
33-
kindly sponsored by [OVHCloud](https://www.ovhcloud.com/). More information about
34-
pandas sponsors, and how your company can support the development of pandas is
35-
available at the [pandas sponsors]({{ base_url }}about/sponsors.html) page.
29+
The [asv-runner](https://github.com/pandas-dev/asv-runner/) repository automatically runs the pandas asv benchmark suite
30+
for every (or almost every) commit to the `main` branch. It is run on GitHub actions.
31+
See the linked repository for more details. The results are available at:
3632

37-
Results of the benchmarks are available at:
38-
39-
- GitHub Actions results: [asv](https://pandas-dev.github.io/asv-runner/)
40-
- OVH server: [asv](https://pandas.pydata.org/benchmarks/asv/)
41-
42-
### Original server configuration
43-
44-
The machine can be configured with the Ansible playbook in
45-
[tomaugspurger/asv-runner](https://github.com/tomaugspurger/asv-runner).
46-
The results are published to another GitHub repository,
47-
[tomaugspurger/asv-collection](https://github.com/tomaugspurger/asv-collection).
48-
49-
The benchmarks are scheduled by [Airflow](https://airflow.apache.org/).
50-
It has a dashboard for viewing and debugging the results.
51-
You’ll need to setup an SSH tunnel to view them:
52-
53-
```
54-
ssh -L 8080:localhost:8080 [email protected]
55-
```
56-
57-
### OVH server configuration
58-
59-
The server used to run the benchmarks has been configured to reduce system
60-
noise and maximize the stability of the benchmarks times.
61-
62-
The details on how the server is configured can be found in the
63-
[pandas-benchmarks repository](https://github.com/pandas-dev/pandas-benchmarks).
64-
There is a quick summary here:
65-
66-
- CPU isolation: Avoid user space tasks to execute in the same CPU as benchmarks, possibly interrupting them during the execution (include all virtual CPUs using a physical core)
67-
- NoHZ: Stop the kernel tick that enables context switching in the isolated CPU
68-
- IRQ affinity: Ban benchmarks CPU to avoid many (but not all) kernel interruption in the isolated CPU
69-
- TurboBoost: Disable CPU scaling based on high CPU demand
70-
- P-States: Use "performance" governor to disable P-States and CPU frequency changes based on them
71-
- C-States: Set C-State to 0 and disable changes to avoid slower CPU after system inactivity
33+
https://pandas-dev.github.io/asv-runner/
7234

7335
## Community benchmarks
7436

0 commit comments

Comments
 (0)