Changes needed for Big Bang and Ironbank Images💣
Due to how Big Bang is making use of Anchore (from within Umbrella) there were values and chart changes that needed to be made. Additionally, the Ironbank images function in slightly different ways than upstream Dockerhub images, so additional modifications were made to support their use.
This provides a log of these changes to make updates from upstream faster.
Big Bang Modifications💣
Added at the top of the values file are changes to support Istio, optional network policies, automated license creation, monitoring, and SSO.
# Big Bang Values
# ---------------
hostname: bigbang.dev
istio:
# Toggle istio integration
enabled: false
injection: "disabled"
ui:
# Toggle vs creation
enabled: true
annotations: {}
labels: {}
gateways:
- istio-system/main
hosts:
- "anchore.{{ .Values.hostname }}"
api:
# Toggle vs creation
enabled: true
annotations: {}
labels: {}
gateways:
- istio-system/main
hosts:
- "anchore-api.{{ .Values.hostname }}"
networkPolicies:
enabled: false
ingressLabels:
app: istio-ingressgateway
istio: ingressgateway
# Enable Prometheus Monitoring
monitoring:
enabled: false
namespace: monitoring
serviceMonitor:
scheme: ""
tlsConfig: {}
# Enterprise license: Specify your multiline license
# enterpriseLicenseYaml: |
# License YAML
enterpriseLicenseYaml: "" # Full multiline license yaml
# Enable/disable Keycloak SSO integration
# If enabled, also enable OAuth - anchoreGlobal.oauthEnabled
sso:
enabled: false
name: "keycloak"
acsHttpsPort: -1
spEntityId: "platform1_a8604cc9-f5e9-4656-802d-d05624370245_bb8-anchore"
acsUrl: "https://anchore.bigbang.dev/service/sso/auth/keycloak"
defaultAccount: "user"
defaultRole: "read-write" # If roleAttribute is passed, defaultRole will be ignored
roleAttribute: "" # Optional, defines the Keycloak attribute to use to map roles/permissions
requireSignedAssertions: false
requireSignedResponse: true
idpMetadataUrl: "https://login.dso.mil/auth/realms/baby-yoda/protocol/saml/descriptor"
All chart changes are located under the chart/templates/bigbang
directory. In summary:
- Creation of virtual services for the UI and API
- Automated creation of the license secret
- Creation of an SSO secret with the above SSO values
- Automation of SSO configuration through a k8s job
- Automated creation of an OAuth cert secret if needed (and this secret name is referenced under
anchoreGlobal.saml
) - Creation of secrets with database credentials from postgres and anchore-feeds-db values
- Automated creation and synchronization of the Postgres databases, database users, and passwords through k8s jobs
- Added analyzerService.yaml to support metrics for analyzer
- Added service monitors for all exposed metrics
As additional Big Bang changes are made they should be added in these spots and this doc updated to reflect that.
Ironbank Modifications💣
All images were updated to be from Ironbank. Additionally, an image pull secret was specified to enable Umbrella to pull them correctly. In the values file:
postgresql:
image: registry1.dso.mil/ironbank/opensource/postgres/postgresql96:9.6.18
imagePullSecrets: private-registry
anchoreGlobal:
image: registry1.dso.mil/ironbank/anchore/enterprise/enterprise:2.4.1
imagePullSecretName: private-registry
anchoreEnterpriseGlobal:
image: registry1.dso.mil/ironbank/anchore/enterprise/enterprise:2.4.1
imagePullSecretName: private-registry
anchore-feeds-db:
image: registry1.dso.mil/ironbank/opensource/postgres/postgresql96:9.6.18
imagePullSecrets: private-registry
anchoreEnterpriseUi:
image: registry1.dso.mil/ironbank/anchore/enterpriseui/enterpriseui:2.4.1
imagePullSecretName: private-registry
To support the Ironbank Postgres image, additional configuration has to be set in the values file:
postgresql:
persistence:
resourcePolicy: nil
size: 20Gi
subPath: "pgdata"
mountPath: /var/lib/postgresql
# Set the configs to allow listening and connecting from other pods
postgresConfig: { "listen_addresses": "*" }
pgHbaConf: |-
local all all md5
host all all all md5
anchore-feeds-db:
persistence:
resourcePolicy: nil
size: 20Gi
subPath: "pgdata"
mountPath: /var/lib/postgresql
# Set the configs to allow listening and connecting from other pods
postgresConfig: { "listen_addresses": "*" }
pgHbaConf: |-
local all all md5
host all all all md5
To support SSO + Istio the RBAC container needs an additional env set:
anchoreEnterpriseRbac:
extraEnv:
- name: AUTHLIB_INSECURE_TRANSPORT
value: "true"
Other Modifications💣
The following block needs to be added to the end of the _helpers.tpl file:
{{/*
Expand the name of the chart.
*/}}
{{- define "anchore.name" -}}
{{- default .Chart.Name .Values.nameOverride | trunc 63 | trimSuffix "-" -}}
{{- end -}}
{{/*
Create chart name and version as used by the chart label.
*/}}
{{- define "anchore.chart" -}}
{{- printf "%s-%s" .Chart.Name .Chart.Version | replace "+" "_" | trunc 63 | trimSuffix "-" -}}
{{- end -}}
In chart/templates/engine_configmap.yaml
, modify the metrics lines as such:
metrics:
enabled: { { .Values.monitoring.enabled } }
auth_disabled: { { .Values.monitoring.enabled } }
Do the same in chart/templates/enterprise_configmap.yaml
:
metrics:
enabled: { { .Values.monitoring.enabled } }
auth_disabled: { { .Values.monitoring.enabled } }
Do the same in chart/templates/enterprise_feeds_configmap.yaml
:
metrics:
enabled: { { .Values.monitoring.enabled } }
auth_disabled: { { .Values.monitoring.enabled } }
And set required environment variables in chart/templates/enterprise_feed_deployment.yaml
:
- name: ANCHORE_ENABLE_METRICS
value: { { .Values.monitoring.enabled | quote } }
- name: ANCHORE_DISABLE_METRICS_AUTH
value: { { .Values.monitoring.enabled | quote } }
To resolve a race condition in Big Bang CI pipelines, an additional sleep argument was added in chart/templates/engine_upgrade_job.yaml
, enterprise_upgrade_job.yaml
, and enterprise_feeds_upgrade_jobs.yaml
:
- |
sleep 60
anchore-manager db --db-connect postgresql://${ANCHORE_DB_USER}:${ANCHORE_DB_PASSWORD}@${ANCHORE_DB_HOST}/${ANCHORE_DB_NAME} upgrade --dontask;
To resolve OPA Gatekeeper violations around container resources and ratios, a field was added to chart/templates/engine_upgrade_job.yaml
, enterprise_upgrade_job.yaml
, and enterprise_feeds_upgrade_jobs.yaml
to allow users to specify container resource requests and limits for the jobs:
resources: { { toYaml .Values.anchoreEngineUpgradeJob.resources | nindent 10 } }
To resolve OPA Gatekeeper violations around istio sidecar injection, a curl command was added to chart/templates/engine_upgrade_job.yaml
, enterprise_upgrade_job.yaml
, and enterprise_feeds_upgrade_jobs.yaml
to allow the istio sidecar container to cleanly terminate after jobs complete.
{{- if eq .Values.istio.injection "enabled" }}
until curl -fsI http://localhost:15021/healthz/ready; do
echo "Waiting for Istio sidecar proxy..."
sleep 3
done
sleep 5
echo "Stopping the istio proxy..."
curl -X POST http://localhost:15020/quitquitquit
{{- end }}
To resolve an issue where Anchore would redeploy after every update, ./chart/templates/engine_secret.yaml
and ./chart/templates/enterprise_feeds_secret.yaml
were modified to set ANCHORE_SAML_SECRET
to a randomly generated value if not set and the previous secret does not exist:
{{- $anchorefullname := include "anchore-engine.fullname" . -}}
{{- $old_secret := lookup "v1" "Secret" .Release.Namespace $anchorefullname }}
{{- if .Values.anchoreGlobal.saml.secret }}
ANCHORE_SAML_SECRET: {{ .Values.anchoreGlobal.saml.secret }}
{{- else if or (not $old_secret) (not $old_secret.data) }}
ANCHORE_SAML_SECRET: {{ (randAlphaNum 12) | quote }}
{{ else }}
ANCHORE_SAML_SECRET: {{ b64dec (index $old_secret.data "ANCHORE_SAML_SECRET") }}
{{- end }}
Additionally, ./chart/templates/engine_configmap.yaml
, ./chart/templates/enterprise_configmap.yaml
, and ./chart/templates/enterprise_feeds_confimap.yaml
were modified to set appropriate saml secret credentials when the saml secret has been randomly generated but left Null
by the user at .Values.anchoreGlobal.saml.secret
:
keys:
{{- if or .Values.anchoreGlobal.saml.secret .Values.anchoreGlobal.saml.useExistingSecret .Values.anchoreGlobal.oauthEnabled }}
secret: ${ANCHORE_SAML_SECRET}
{{- end }}
To support metrics mTLS added appPotocol: http
to the Service port spec found in ./chart/templates/*_deployment.yaml
PostgreSQL Modifications💣
To prevent the postgresql container from writing to local disk, volumes, volume mounts, and a security context were added to the postgresql deployment:
volumeMounts:
- name: init
mountPath: /var/run/postgresql
- name: tmp
mountPath: /tmp
securityContext:
readOnlyRootFilesystem: true
volumes:
- name: init
emptyDir: {}
- name: tmp
emptyDir: {}
Container Security Context Additions💣
To set all containers to run without additional capabilities, and instead to add explicit drops, several containerSecurityContext sections have been added. Each of these sections look like the following (other sections with additional securityContext settings may have been modified to include explicit drops, but were already part of the chart) and are referenced in the template files:
containerSecurityContext:
capabilities:
drop:
- ALL