This page details and compares available CI-as-a-Service (CISaaS) platforms for open source communities.
Work in progress as I (Trevor Bramwell ) compile research and slides from multiple presentations.
SCM Support by Platform
This table details the support for CI systems to report back the status of builds to SCM providers.
Gerrit | Github | GitLab | Bitbucket | Azure Code | |
---|---|---|---|---|---|
Jenkins | |||||
CircleCI | |||||
Azure Pipelines | |||||
Drone.io | |||||
Github Actions | |||||
GitLab-CI | † |
† https://docs.gitlab.com/ee/ci/ci_cd_for_external_repos/bitbucket_integration.html
Note: a similar approach could be used for other SCMs provided there is an API for updating CI status
Build Resources and Minutes
Builds, agents, runners: these are all different names providers use to refer to the compute machine CI/CD builds run on.
Builder Size | ARM Builders | External Builders | |
---|---|---|---|
Jenkins | N/A | N/A | Yes |
CircleCI | 2 vCPUs, 4-8 Gb RAM, larger sizes | Yes/No | |
Azure Pipelines | 2 vCPUs, 7 Gb RAM | Yes | |
Drone.io | Yes | Yes/No | |
Github Actions | 2 vCPUs, 7 Gb RAM | Yes | |
GitLab-CI | 1 vCPU, 3.75 Gb RAM | Yes |
SaaS | VMs | Docker | Attach External | Platform + Arch | vCPUs | Ram (Gb) | Disk (Gb) | |
CircleCI | ✓ | ✓ | ✕* | Linux, OSX | 2 | 100 | ||
Gitlab-CI | ✓ | ✓ | ✓ | Linux | 3.75 | 25 | ||
Azure Pipelines | ✓ | ✓ | ✓ | Linux, OSX, Win | 7 | 10 | ||
Drone.io (Cloud) | ✕ | ✓ | ✕* | Linux: x86, ARM | N/A | N/A | N/A | |
Github Actions | yes | yes | yes | Linux, OSX, Win | 2 | 7 | 10 |
Notes on Other Systems
There are several other CI SaaS platforms out there not included in this comparison for various reasons.
- Travis-CI
After the majority of senior staff was laid off when the company was acquired, Travis-CI has essentially been put into standby mode. No new major feature or changes are expected. - Bitbucket Pipelines
Bitbucket Pipelines requires code be hosted in Bitbucket and only provides 50 free minutes per-month for open source projects. - Appveyor
Originally the only place to get free Windows builds. There's little need to use them when Azure Pipelines provides all-if-not-more of the same services.