Link Search Menu Expand Document

Deploying the Multicluster DevSecOps Pattern

Table of contents

  1. Deploying the Multicluster DevSecOps Pattern
  2. Prerequisites
  3. How to deploy
  4. Validating the Environment
    1. Next Steps
  5. Uninstalling


  1. An OpenShift cluster ( Go to the OpenShift console). See also sizing your cluster.
  2. A second OpenShift cluster for production (optional but desirable)
  3. A third OpenShift cluster for secure CI pipelines (optional but desirable)
  4. A GitHub account (and a token for it with repositories permissions, to read from and write to your forks)
  5. The helm binary, see here

If you do not have running Red Hat OpenShift clusters you can start one on a public or private cloud by using Red Hat’s cloud service.

How to deploy

  1. Install the installation tooling dependencies. You will need:

  2. Clone the forked copy of the multicluster-devsecops repo. Use branch v1.0.

    • make - the well-known software build tool
    • sh - a POSIX-compatible shell
    • sed - the “stream editor”, commonly used in shell scripting
    • oc - the OpenShift client
    • jq - The swiss army knife for JSON
    • git - The well known version control utility
    • ansible - The well-known automation tool
    • The kubernetes.core collection for ansible
  3. Fork the Multi-Cluster DevSecOps repository on GitHub. It is necessary to fork because your fork will be updated as part of the GitOps and DevSecOps processes.

  4. Fork the TBD demo repository on GitHub. It is necessary to fork this repository because the GitOps framework will push tags to this repository that match the versions of software that it will deploy.

  5. Clone the forked copy of the multicluster-devsecops repository. Use branch v1.0.

    git clone{your-username}/multicluster-devsecops.git
    cd multicluster-devsecops
    git checkout v1.0
  6. You could create your own branch where your specific values will be pushed to:

    git checkout -b my-branch
  7. A values-secret.yaml file is used to automate setup of secrets needed for:

    • A Git repository (E.g. Github, GitLab etc.)
    • A container image registry (E.g. Quay)
    • S3 storage (E.g. AWS)

    DO NOT COMMIT THIS FILE. You do not want to push personal credentials to GitHub.

    cp values-secret.yaml.template ~/values-secret.yaml
    vi ~/values-secret.yaml
  8. Customize the deployment for your cluster. Change the appropriate values in values-global.yaml

    vi values-global.yaml
    git add values-global.yaml
    git commit values-global.yaml
    git push origin my-branch
  9. You can deploy the pattern using the validated pattern operator. If you do use the operator then skip to Validating the Environment below.

  10. Preview the changes

    make show
  11. Login to your cluster using oc login or exporting the KUBECONFIG

    oc login


    export KUBECONFIG=~/my-ocp-env/hub
  12. Apply the changes to your cluster

    make install

Validating the Environment

  1. Check the operators have been installed

    UI -> Installed Operators
  2. Navigate to the OpenShift GitOps instances using the links on the top right hand side of the screen.

    The most important ArgoCD instance to examine at this point is hub-gitops-server. This is where all the applications for the hub (datacenter), including the test environment, can be tracked.

  3. Apply the secrets from the values-secret.yaml to the secrets management Vault. This can be done through Vault’s UI - manually without the file. The required secrets and scopes are:

    • secret/hub/git git username & password (GitHub token)
    • secret/hub/imageregistry Quay or DockerHub username & password
    • secret/hub/aws - base64 encoded value (see below)

    For AWS S3 secret, create a file, say, s3-secrets, with two lines:

    s3.accessKey: <accessKey>
    s3.secretKey: <secret key>

    Then encode this with base64 using

    cat s3-secrets | base64 -w 0

    Or you can set up the secrets using the command-line by running the following (Ansible) playbook.


    Using the Vault UI check that the secrets have been setup.

    For more information on secrets management see here. For information on Hashicorp’s Vault see here

  4. Check all applications are synchronized in OpenShift GitOps

Multicluster DevSecOps GitOps overview

Next Steps

Help & Feedback Report Bugs

Once the hub has been setup correctly and confirmed to be working, you can:

  1. Add a dedicated development cluster to deploy the CI pipelines using ACM
  2. Add a dedicated production cluster to deploy production using ACM
  3. Once the hub, production and devel clusters have been deployed you will want to check out and test the Multi-Cluster DevSecOps demo code. You can find that here TBD

    a. Making configuration changes with GitOps TBD a. Making application changes using DevOps TBD


Probably wont work

  1. Turn off auto-sync

    helm upgrade manuela . --values ~/values-secret.yaml --set global.options.syncPolicy=Manual

  2. Remove the ArgoCD applications (except for manuela-datacenter)

    a. Browse to ArgoCD a. Go to Applications a. Click delete a. Type the application name to confirm a. Chose “Foreground” as the propagation policy a. Repeat

  3. Wait until the deletions succeed

    tbd should be the only remaining application

  4. Complete the uninstall

    helm delete tbd

  5. Check all namespaces and operators have been removed