Discussion

Last updated on 2024-11-19 | Edit this page

Bioconductor and CRAN

Bioconductor and CRAN are two well-established repositories of R packages that are often compared in terms of practices with regard to package submission, review, and release cycles.

R packages can be obtained and installed from a number of repositories online, CRAN and Bioconductor being the two most prominent and well-established repositories. Repositories often have different guidelines and procedures to manage and check the quality of packages that are distributed on their platforms. This can be a source of considerable confusion for users, when searching for new packages and assessing their popularity and reliability before investing time in using them.

CRAN tends to host more general-purpose R packages, hosting more than 17,854 packages (July 2021; source). It is also the oldest and main repository of R packages, established in 1997, and initially hosting 12 packages (reference).

Rather, Bioconductor focuses on R packages related to bioinformatics tasks and workflows. Biocondutor distinguishes packages from different types, including 2,042 software packages, 406 experiment data packages, 965 annotation packages, and 29 workflows (July 2021; source).

Both repositories implement an initial review process for new package submissions. However, the two review processes operate in noticeably different manners, including in the way packages are evaluated and deprecated after acceptance, as they consistently fail regular automated checks without action from package maintainers. In particular, the release cycle of the Bioconductor project creates natural opportunities to regularly identify packages that consistently fail automated checks, triggering their deprecation during the following release cycle, and removal in the subsequent one.

Packages from Bioconductor and CRAN can be installed and used side-by-side. They are all R packages and can often interoperate on standard R structures (e.g., vector, matrix, data.frame). However, one common issue and challenge stems from the different implementations of S3 and S4 class and generic systems. For instance, the r BiocStyle::Biocpkg("AnnotationDbi") and r BiocStyle::CRANpkg("dplyr") packages implement two versions of the select() method, using the S4 and S3 system, respectively. When both packages are attached to the same R session, the select() method defined by the first package attached can only be accessed using the full syntax package::function() (e.g., AnnotationDbi::select()), as the method implemented by the latest package attached masks any other definition of the method in the active R session. To date, there has been no solution to this issue, relying on users learning from experience to circumvent the issue using the full syntax to access individual methods explicitly.

The Bioconductor project labels and classifies packages using biocViews. This controlled vocabulary provides a convenient solution to effectively browse and filter thematically-related packages. The CRAN repository does not provide any comparable functionality, instead relying on search engines and word-of-mouth to identify packages suitable for specific tasks.

Bioconductor package versions

Format

Bioconductor packages use the standard format MAJOR.MINOR.PATCH to version packages (e.g., 1.13.2). The version number is stored in the DESCRIPTION file that is part of every R package. Each of MAJOR, MINOR, and PATCH is an integer that is incremented to mark a new release of the corresponding package, following different rules for each field.

Major version

Candidate packages in development should set the MAJOR field to 0 while the package is submitted for review. When the package is accepted, MAJOR is automatically incremented by 1, to mark its entry into the Bioconductor repository.

Following acceptance, MAJOR often remains the same for the lifetime of the package. It should only be incremented by package developers to mark breaking changes that require the full attention of users who may need to update their workflow accordingly.

However, developers should never update the MAJOR field itself. Instead, they should set MINOR to 99. During the preparation of the next Bioconductor release, this will automatically trigger an increment of MAJOR by 1 and reset MINOR to 0. For instance, a package at version 0.99.15 during the Bioconductor review process will appear at version 1.0.0 when accepted and added to the next release of the Bioconductor package repository.

Minor version

The MINOR field is automatically updated every 6 months as part of the Bioconductor release process to mark the version of each package that will feature in the upcoming release. Simultaneously, when the MINOR field is incremented for a new release cycle, the PATCH field is reset to 0. For instance, if a package was at version 1.3.5 for Bioconductor release 3.13, it would be incremented to version 1.4.0 at the start of Bioconductor release 3.14.

As described above, developers can set MINOR directly to 99 - skipping all values in-between - if they wish to trigger an increment of MAJOR for their package in the next release of Bioconductor.

Patch version

The PATCH field is the field that package developers use most frequently to release updates within a release cycle. Importantly, updates to packages are not deployed to users until the package version is incremented. This is crucial to ensure that users cannot install different versions of a package that contain different source code. For instance, a package at version 1.3.5 would be incremented to version 1.3.6 to deploy a new version of the package available to users on the Bioconductor repository.

The Bioconductor release cycle

Release branches

Bioconductor uses the [Git][git-website] version control system to manage its package repository. For each new Bioconductor release (i.e., version), a new branch is created in the [Bioconductor Git repository][git-bioconductor]; those are referred to as release branches. Release branches allow users to install stable versions of packages that were tested together for a given version of Bioconductor, itself earmarked for a specific version of R.

Work on the release branches is restricted. Older release branches are entirely frozen, meaning that no further update is allowed on those branches. When users request a package for a given version of Bioconductor, they receive the latest version of the package on the correspoding release branch.

Only the latest release branch allows updates from package maintainers, but those are restricted to critical bug fixes. This means that for each 6-month release cycle, users can expect packages on the latest branch to be reasonably stable.

Devel branches

Meanwhile, the main branch of the Git repository (historically called master) is referred to as the devel branch.

The devel branch allow developers to continue updating the packages as frequently as they wish, without affecting users or disrupting workflows. Typically, packages on the devel branch are mainly used by other developers and the Bioconductor build system, to run tests using the latest code of every package in the Bioconductor repository, and to prepare the next stable release of the project. However, users can also access packages on the devel branch using BiocManager::install(version = ...) with version set to one minor version greater than the latest Bioconductor release version (e.g. if the latest release is 3.13, then devel is 3.14).

Transition between devel and release - the release process

After a new release branch is created, the version of every single package on the devel branch is incremented, to prepare the version of the package that will feature in the next Bioconductor stable release. This includes the r BiocStyle::Biocpkg("BiocVersion") package, which marks the value of the next version of Bioconductor.