Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(ci): use manual x-dist value for self-hosted runners #1296

Merged

Conversation

spencer-tb
Copy link
Collaborator

@spencer-tb spencer-tb commented Mar 11, 2025

🗒️ Description

To speed up the release process I've added a new user to the hive server called usainbolt. This user will be used entirely as a self-hosted runner set for the Build and Package Fixtures workflow step. Note this is only runs when creating new releases.

Currently our releases take a long time finish as fixture builds run sequentially, due to our single self-hosted runner instance. Everything in total currently takes around 5hrs. I've now added 6 self hosted runners.
Screenshot 2025-03-11 at 11 49 51

This will take our entire release process time down to <3hrs. Note we could improve this by finding a way to fill the slow marked fixtures faster, ideally giving us a release build time of <30mins.

Other Changes

  • Removed pectra-devnet-6 as a separate build, Prague tests are within develop now.
  • Set x-dist to 10 instead of auto. With the self-hosted runners when using auto it will select n=32 for each build. This will ultimately throttle the EELS resolver and give us timeout errors when filing.

🔗 Related Issues

#1051

✅ Checklist

  • All: Set appropriate labels for the changes.
  • All: Considered squashing commits to improve commit history.
  • All: Added an entry to CHANGELOG.md.
  • All: Considered updating the online docs in the ./docs/ directory.

@spencer-tb spencer-tb added scope:ci Scope: Continuous Integration type:chore Type: Chore labels Mar 11, 2025
@spencer-tb spencer-tb force-pushed the ci-manual-xdist-self-hosted-runner branch from 0631cd3 to 7c2ea7d Compare March 11, 2025 12:28
@spencer-tb spencer-tb requested a review from danceratopz March 11, 2025 12:30
Copy link
Member

@danceratopz danceratopz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes LGTM, but I'm missing the multiple runners config. I guess this needs to be added to the repo settings?

@spencer-tb
Copy link
Collaborator Author

The changes LGTM, but I'm missing the multiple runners config. I guess this needs to be added to the repo settings?

It's all done on the server side! :D

@spencer-tb spencer-tb merged commit 39016c6 into ethereum:main Mar 11, 2025
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
scope:ci Scope: Continuous Integration type:chore Type: Chore
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants