Generate Advanced Buildkite CI/CD Pipelines

Buildkite Pipeline Generator turns Claude into an expert at building sophisticated Buildkite pipelines that optimize CI/CD through proper step orchestration, conditional execution, and scalable architecture patterns, covering Buildkite's agent model, dynamic pipeline generation, block steps, matrix builds, and artifact management. Core principles: an agent-queue strategy that targets agents selectors to workload requirements such as compute-intensive, platform-specific, or tool-specific work; step dependencies using depends_on links and wait steps for efficient parallel execution while preserving required ordering; proper artifact flow via artifact_paths and plugins for passing build results between steps; and environment isolation through scoped environment variables and secret management via Buildkite environment hooks and plugins.

Use it to design or generate a Buildkite pipeline YAML file: standard build, test, and deploy step sequences with agent-queue targeting and artifact passing; dynamically generated pipelines, a setup step piping a script's output into buildkite-agent pipeline upload, for conditional, per-changed-service steps; matrix builds across multiple Node versions and operating systems; block steps for manual deploy approvals with typed input fields; plugin integrations for Docker, artifacts, and Slack notifications; branch-based and if-conditional execution; and retry or soft-fail error handling for flaky steps. It is specific to Buildkite's YAML pipeline format and agent model, not a generic CI/CD generator for GitHub Actions, GitLab CI, or Jenkins.

Input is a CI/CD requirement - the build, test, and deploy steps needed, which services or platforms to target, and any conditional or approval logic. Output is Buildkite pipeline YAML, and for dynamic pipelines the generator script that produces it, implementing the requested orchestration: step definitions with label, command, agents, artifact_paths, depends_on, and timeout_in_minutes; matrix.setup blocks for cross-platform testing; block steps with prompt and fields for manual gates; plugin blocks such as docker#v5.8.0, artifacts#v1.9.0, slack#v1.4.0, and junit-annotate#v2.4.1; branches/if conditions; and retry, soft_fail, and continue_on_failure configuration.

steps:
  - label: ":hammer: Build"
    command: |
      echo "Building application..."
      make build
    artifact_paths:
      - "dist/**/*"
      - "build-info.json"
    agents:
      queue: "build"
      os: "linux"
    env:
      NODE_ENV: production
    timeout_in_minutes: 15

Documented Buildkite plugins include docker#v5.8.0 for containerized build steps, artifacts#v1.9.0 for upload and download of build artifacts, slack#v1.4.0 for deployment notifications, and junit-annotate#v2.4.1 for surfacing test results. Dynamic pipeline generation is shown with a Python script that queries changed services and prints generated YAML for buildkite-agent pipeline upload to consume.

DevOps and platform engineers building or optimizing Buildkite CI/CD pipelines who want scalable patterns for agent targeting, dynamic step generation, matrix testing, manual approval gates, plugin integrations, and retry or failure handling rather than writing pipeline YAML from scratch.