Skip to content

Contributing

This project is a community effort and lives off your contributions, be it bug reports, feature requests, new plugins, discussions, documentation or code. It follows the contributor guide of ELIXIR On-Cloud, which also describes the project's values and what it offers regular contributors; this page sums up how it applies to this repository.

Please follow the code of conduct in all interactions with the community. To report a violation, email cloud-service@elixir-europe.org.

Report vulnerabilities privately, not in issues, as described in the security policy.

Getting started

  1. Find an issue in the issue tracker, or open one (see Issues).
  2. Join the ELIXIR On-Cloud chat and introduce yourself in the open source community channel: your skills and experience, your GitHub username and the issues you are interested in (see the workflow; send a direct message to a project lead instead if you don't want to share these publicly). Once you are a member of the GitHub organization, you can assign issues to yourself.
  3. Set up a development environment (see Development) and start coding; for a new plugin, see Writing a plugin.

One-time contributors can skip the second step and open pull requests from forks; some checks may need a maintainer's approval to run for them.

Issues

Use the issue tracker to propose plugins and features, report bugs and discuss existing issues; use the chat for questions and informal discussions. Write issues concisely, but with enough detail and context (links, logs, configurations without secrets) for others to start working on them; bug reports need steps to reproduce, and proposals of plugins say what the plugin does, in which phases, and which data it sends to third parties. The maintainers add labels and milestones.

Always work on an issue: before you change code, make sure there is an issue for it and that the maintainers agree with the approach, so that no work is in vain.

Development

Development needs uv (which installs a suitable Python, 3.11 or later, if needed) and Git. The repository root is a uv workspace: one environment (.venv/) with every package installed in editable mode, plus the development tools (dependency group dev). FOCA comes from its dev branch until 0.18.0 is released.

git clone https://github.com/elixir-cloud-aai/foca-plugins.git
cd foca-plugins
uv sync  # all packages and the dev tools, as locked in `uv.lock`
uv run pre-commit install  # run the checks on every commit
uv run pre-commit run --all-files  # ruff, mypy, semgrep, ast-grep, conventions
uv run pre-commit run --all-files --hook-stage manual gitleaks-all  # secrets
uv run pytest  # all tests: the plugins', the scripts' and the docs hooks'

Run pre-commit in the environment (uv run): the mypy, ast-grep and conventions hooks use the installed packages. The first run sets up the other hooks, which takes a few minutes.

CI tests each plugin on its own, in an environment with only that plugin and the dev tools (uv sync --package <distribution> --group dev), so that a plugin can't rely on another's dependencies; the commands of one plugin's checks are in Writing a plugin. Its change detection (python -m scripts.packages changed <base> <head>) runs the tests of the plugins that a pull request affects: changes of a plugin's directory affect that plugin; those of the meta distribution and of shared files (the root pyproject.toml, uv.lock, workflows, scripts, rules) affect all plugins; those of the docs affect none. The gate CI passed is the only required check.

When you change dependencies, run uv lock (or uv sync) and commit uv.lock; CI fails if it is not up to date. Project-specific rules are in .semgrep/ (security) and .ast-grep/ (e.g., no framework imports in plugins); suppress a false positive with a comment with the reason on its line: # noqa: <code> (ruff), # type: ignore[<code>] (mypy), # nosemgrep: <rule-id>, # ast-grep-ignore: <rule-id> or # gitleaks:allow.

Documentation

This documentation is built with MkDocs and Material for MkDocs, from docs/ and mkdocs.yml, by Read the Docs (.readthedocs.yaml) and in CI; warnings, e.g., of broken links, fail the build. The home page includes sections of README.md, and the plugin catalogue is generated from the plugins' READMEs (docs/hooks.py).

uv sync --group docs
uv run mkdocs build --strict  # into `site/`, ignored by Git
uv run mkdocs serve

Branches and pull requests

The project follows a variant of the GitHub flow: all changes reach the development branch dev through pull requests, which are reviewed and tested; main only holds releases: it only moves forward to released commits (see Releasing).

  1. Create a feature branch from an up-to-date dev, named after the type and topic of the change, e.g., feat/tes-routing-distance or docs/<topic>.
  2. Commit your changes, push the branch and open a pull request against dev (not main) that closes the issue (Closes #<issue>) and says what changes, why, and how you tested it.
  3. Get your pull request reviewed: once it is ready for review, automated reviewers (Sourcery, GitHub Copilot) review every pull request, and a maintainer also reviews external contributions. Address the comments by pushing further commits or by replying why you disagree.
  4. Once the checks pass and all conversations are resolved, the maintainers squash-merge the pull request into dev.

Keep pull requests focused, on one plugin where possible: if a change can't be summarized in a title of 50 characters, split it into several pull requests.

Commit messages and pull request titles

Pull request titles, which become the commit messages on dev, follow the Conventional Commits specification:

<type>[(<scope>)][!]: <description>
  • The whole title line has at most 50 characters.
  • The description starts with a verb in the imperative mood (e.g., add, fix) and has no trailing period.
  • ! (and a BREAKING CHANGE: footer in the body) marks breaking changes.
  • The scope of a change of one plugin is its path below plugins/, e.g., feat(tes/routing/distance): ...; that of the meta distribution is meta.
  • The type names the predominant reason for the change:
Type Changes
feat new functionality
fix bug fixes
perf performance improvements
refactor code changes that neither add features nor fix bugs
style formatting, docstrings and type hints of the code
build build system, packaging and dependencies
ci CI and release workflows
docs documentation
test tests
chore other maintenance, e.g., scripts or .gitignore
revert reverts of earlier commits

Use feat, fix, perf, refactor and style only for changes of what is published: the plugins (plugins/) and the meta distribution (meta/).

Citation metadata

The repository is cited with the metadata in CITATION.cff (Citation File Format), which GitHub ("Cite this repository") uses. It has no version, as each distribution has its own. Its authors are the people who committed at least 100 lines (lines added) to main, the release branch (to dev before the first release), not counting bots and generated files. They are ordered by lines, then by commits; equal contributors are listed alphabetically by family name and marked with an asterisk (*). Affiliations come from public ORCID records only. To add or correct your entry, open a pull request that changes only your entry; don't add e-mail addresses. CI validates the file (cffconvert --validate).

Python guidelines

Plugins support the Python versions that FOCA supports (3.11 and later; requires-python), which CI tests (3.11, 3.13 and 3.15). Most of the following is checked by pre-commit and CI; the rest is checked in reviews.

  • Packaging: each package's metadata and dependencies are in its pyproject.toml; the tool configuration and the development dependencies (dependency groups dev and docs) are in the root pyproject.toml. Don't add setup.py or requirements files.
  • Formatting and linting: ruff formats the code (ruff format, compatible with Black, 88 characters per line) and lints it (ruff check) with the rule set shared by FOCA and FOCA apps: pycodestyle, Pyflakes, isort, flake8-bugbear, flake8-comprehensions, flake8-simplify, Pylint, Ruff's own rules, pyupgrade, bandit (security), logging format and pydocstyle, also for the tests (root pyproject.toml, where each ignored rule says why). Prefer explicit checks to suppressions.
  • Docstrings: Google-style docstrings at all levels: packages, modules, classes, methods and functions, also private ones and tests, with a one-line summary and, where applicable, the sections Args, Returns (or Yields), Raises and, for classes, Attributes. The first line of a plugin class's docstring is its title for clients, the rest its description.
  • Type hints: complete type hints for all functions and methods (also of the tests), and generic types with their parameters (e.g., dict[str, Any]). mypy checks them (disallow_untyped_defs, disallow_any_generics), through python -m scripts.packages mypy, which puts the plugins' src/ directories on the search path.
  • Tests: pytest, with coverage measured by coverage (branches included): keep it at 100% of each plugin's src/ and of scripts/ and docs/hooks.py, which is enforced (fail_under in the root pyproject.toml, and Codecov's checks, codecov.yml). Add tests that fail without your change.
  • Further checks: ast-grep (rules in .ast-grep/, with tests), semgrep (security rules in .semgrep/), gitleaks (secrets), actionlint (workflows), pip-audit (known vulnerabilities of each plugin's dependencies, in CI), and the package conventions (python -m scripts.checks check).