Use https://github.com/benchmark-action/github-action-benchmark to keep track of benchmark CI results over time (right now they are only tracked in the PR CI).

Edit 1:
I found this as well: https://github.com/marketplace/actions/continuous-benchmark