Fluent-bit

Overview

This package contains an extensible and configurable installation of Fluent-bit based on the upstream chart provided by fluent.

Fluent-bit

Fluent Bit is An open source Log Processor and Forwarder which allows you to collect any data like metrics and logs from different sources, enrich them with filters and send them to multiple destinations. It’s the preferred choice for containerized environments like Kubernetes. Designed with performance in mind: high throughput with low CPU and Memory usage. It’s written in C language and has a pluggable architecture supporting more than 70 extensions for inputs, filters and outputs.

Fluent Bit is a CNCF (Cloud Native Computing Foundation) subproject under the umbrella of Fluentd.

How it works

Fluent-bit mounts a hostPath volume at /var/log for each node in a cluster and the service tails each log it finds and sends to the configured output or set of outputs in the values. The default production setup of the package provided by Platform One is configured to use a storage buffer to better keep track of the many logs a production kubernetes cluster will generate. Recent changes to BigBang and this package mean no default output is configured but fluent-bit has many output plugins available. BigBang has the following configurations available: - Loki enabled - loki additionalOutput configured for fluent-bit and additionOutputs.disableDefault set to true so no Elasticsearch specific output is configured - Logging enabled - Elasticsearch (es) output configured for fluent-bit - Please review the additionalOutputs section of the values and README for other package-specific outputs.

Please review the BigBang Architecture Document for more information about it’s role within BigBang.