3.10.0

Changelog

SDK

• Coordination rbac for leader election and prepare for chart release (#749)
• Controller runtime 0.8.3, CRD v1, Go 1.16 #744
• Upgrade controller-gen and use v1 for CRDs

Fluentd

Updated FluentD Plugins

• fluent-plugin-cloudwatch-logs 0.13.4 -> 0.14.0
• fluent-plugin-kinesis 3.3.0 -> 3.4.0
• fluent-plugin-label-router 0.2.4 -> 0.2.5
• fluent-plugin-newrelic 1.1.10 -> 1.2.0

Fluentbit

• New Fluentbit version 1.7.3 -> 1.7.4

SDK release: controller-runtime 0.8.3, CRD v1, Go 1.16

Pull request: #744
Logging operator image is the same as with 0.6.17: ghcr.io/banzaicloud/logging-operator:3.9.5

3.9.5

Changelog

SDK

• Splunk prometheus client 2.1 support #736
• Fluentd buffer volume metrics #729
• ServiceAccount metaoverride Support #727
• Elasticsearch Data Stream Support #724
• Configurable PSP Annotation #723
• Make SAS Token and Access Key optional for Azure Blob Storage Output #721
• Default fluentbit keepalive config #720

Fluentd

Updated FluentD Plugins

• fluent-plugin-aws-elasticsearch-service 2.4.0 -> 2.4.1
• fluent-plugin-cloudwatch-logs 0.13.4 -> 0.13.4
• fluent-plugin-elasticsearch 5.0.2 -> 5.0.3
• fluent-plugin-kafka 0.16.0 -> 0.16.1
• fluent-plugin-kinesis 3.3.0 -> 3.4.0
• fluent-plugin-label-router 0.2.4 -> 0.2.5
• fluent-plugin-newrelic 1.1.10 -> 1.2.0
• fluent-plugin-prometheus 2.0.0 -> 2.0.1
• fluent-plugin-s3 1.5.1 -> 1.6.0

Fluentbit

• New Fluentbit version 1.6.10 - 1.7.3

3.9.0

Changelog

SDK

• Resource status print columns #633
• Add forwardInput config to fluentd spec #637
• Fluentbit aws filter extend #638
• Fluentbit Service parameter expansion #639
• Fluentbit upstream support #640
• Fluentd, Fluentbit imagePullSecrets support #641
• fluentbit-upstream code cleanup: unnecessary checksum/config annotation removed #643
• Fluentd ignore_repeated_log_interval ignore_same_log_interval paramter support #644
• Add configurable forward options for fluentbit #645
• Fluentd multi process workers config #646
• Add globalFilters to Logging resource #650
• New sumologic filters #651
• Fix PSP on k8s 1.19 #652
• Add ServiceMonitor configuration options #653
• Logging resource status tests #654
• Arm support #657
• New azure storage support #660
• Extended RBAC for Sumnologic fluentd plugin #663
• Assume Helm 3 as the default #666
• Logzio output fix #667
• Fix detectExceptions example #669
• Chart api version fix #676
• Fluentd alpine image update 3.12.1 -> 3.13.0 #678

Fluentd

Updated FluentD Plugins

• fluent-plugin-azurestorage' 0.1.0 -> 0.2.1
• fluent-plugin-cloudwatch-logs 0.11.1 -> 0.13.2
• fluent-plugin-elasticsearch 4.2.2 -> 4.3.3
• fluent-plugin-kafka 0.15.2 -> 0.15.3
• fluent-plugin-kubernetes_metadata_filter 2.5.2 -> 2.5.3
• fluent-plugin-kubernetes_sumologic 2.4.2' -> 2.0.0
• fluent-plugin-logzio 0.0.20 -> 0.0.21
• fluent-plugin-prometheus 1.8.4 -> 1.8.5
• fluent-plugin-redis 0.3.4 -> 0.3.5
• fluent-plugin-rewrite-tag-filter 2.3.0 -> 2.4.0
• fluent-plugin-s3 1.4.0 -> 1.5.0
• fluent-plugin-sumologic_output 1.7.1 -> 1.7.2
• fluent-plugin-syslog_rfc5424 0.9.0.rc.5 -> 0.9.0.rc.7
• fluent-plugin-webhdfs 1.3.1 -> 1.4.0

New FluentD Plugins

• fluent-plugin-enhance-k8s-metadata 2.0.0'

Fluentbit

• New Fluentbit version 1.6.4 -> 1.6.10

Milestone 3.9.0
Detailed changes: 3.8.0...3.9.0
Thanks for all the contributors: @ahma @alexsn @bshifter @ekhaydarov @EppO @pepov @tarokkk @nickgerace @siliconbrain @sdurrheimer @velothump

3.8.0

Changelog

SDK

• Fix whitespace typo in helm chart #629
• fluentd:v1.11.5-alpine-1 #627
• basic validation for output spec #625
• Add support for net config options in fluentbit #621
• Feature/sumologic filter #620
• Kafka output example fix #619
• s3output one-eye format keytemplate fix #616
• Loki tls support #614
• Splunk Plugin CA secret ref #612
• s3output default objectkeyformat + s3output one-eye default values #609
• ServiceMonitor relabelling support #607
• Use a more resilient s3 object name by default #606
• Remove useless -d date in fluentd healthcheck #605
• Resource statuses #604

Fluentd

• New FluentD version 1.11.4 -> 1.11.5

Updated FluentD Plugins

• fluent-plugin-cloudwatch-logs 0.11.0 -> 0.11.1
• fluent-plugin-grafana-loki 1.2.15 -> 1.2.16
• fluent-plugin-kinesis 3.2.3 -> 3.3.0
• fluent-plugin-webhdfs 1.2.5 -> 1.3.1

New FluentD Plugins

• fluent-plugin-syslog_rfc5424 0.9.0.rc.5
• fluent-plugin-kubernetes_sumologic 2.4.2

Fluentbit

• New Fluentbit version 1.6.1 -> 1.6.4

Milestone 3.8.0
Detailed changes: 3.7.0...3.8.0
Thanks for all the contributors: @ahma @bshifter @pepov @tarokkk @siliconbrain @smlx @worr @velothump

3.7.0

Changelog

SDK

• Fluend Statefulset podManagementPolicy support #601
• Local Flow fix #599
• Small enhancements #597
• Configcheck security config #594
• Remove extra, useless -d flag in liveness check #593
• Update dependencies #591
• resourcebuilder image name update to use ghcr #589
• Fix logging-operator Helm chart option for monitoring.serviceMonitor.enable #580
• Update operator-tools version #577
• Allow emit_invalid_record_to_error to be set to false #574
• Bug/chart missing permissions #573
• Updating ClusterRole for logging-operator #572

Fluentd

• New FluentD version 1.11.2 -> 1.11.4

Updated Plugins

• fluent-plugin-elasticsearch 4.1.2 -> 4.2.2
• fluent-plugin-grafana-loki 1.2.14' -> 1.2.15
• fluent-plugin-kafka 0.14.2 -> 0.15.2
• fluent-plugin-logdna 0.3.1 -> 0.4.0
• fluent-plugin-newrelic 1.1.8 -> 1.1.10
• fluent-plugin-prometheus 1.8.3 -> 1.8.4

Fluentbit

• New Fluentbit version 1.5.4 -> 1.6.1

Milestone 3.7.0
Detailed changes: 3.6.0...3.7.0
Thanks for all the contributors: @ahma @bshifter @florianstoeber @pepov @tarokkk @siliconbrain @worr @sagikazarmark @rdpa @velothump

3.6.0

Changelog

⚠️ Breaking changes ⚠️ outputRefs is now deprecated!

For clarity we introduce:

• use globalOutputRefs for ClusterOutputs
• use localOutputRefs for Outputs

Why?

There were a lot of confusion about the difference and precedence between Outputs and ClusterOutputs so we reflect the type in the Flow and ClusterFlow parameters.
Moreover, ClusterFlow and ClusterOutput will become cluster scoped resources in later releases.

What does it mean?

You need to change your custom resources according to the new parameters.

What happens if I already upgraded but I don't want to change the parameters.

You can downgrade to Logging Operator 3.5.1 and everything should work the same as before.

Example: There is a Flow with 1 Output (elasticsearch) and 1 ClusterOutput (s3)

Old syntax

kind: Flow
metadata:
  name: s3-flow
spec:
  filters:
    - tag_normaliser: {}
  match:
    - select:
        labels:
          app.kubernetes.io/name: log-generator
  outputRefs:
    - elasticsearch
    - s3

New syntax

kind: Flow
metadata:
  name: s3-flow
spec:
  filters:
    - tag_normaliser: {}
  match:
    - select:
        labels:
          app.kubernetes.io/name: log-generator
  globalOutputRefs:
    - s3-output
  localOutputRefs:
    - elasticsearch

• Http Output json_array parameter support #566
• Splunk Documentatio #563
• Sumologic documentation #561
• AWS Process Credentials Support #558
• Suppress_type_name support in elasticsearch output #556
• Separate cluster output refs from output refs #550
• Redis Output Plugin Support #549

Fluentd

• New FluentD version 1.11.1 -> 1.11.2

Updated Plugins

• fluent-plugin-elasticsearch 4.1.1 -> 4.1.2
• fluent-plugin-kafka 0.13.1 -> 0.14.2

New Plugins

• fluent-plugin-redis 2.4.0

Fluentbit

• New Fluentbit version 1.5.2 -> 1.5.4
  Milestone 3.6.0
  Detailed changes: 3.5.0...3.6.0
  Thanks for all the contributors: @ahma @asdwsda @bshifter @pepov @eddycharly @tarokkk @siliconbrain

3.5.0

Changelog

SDK

• Chart TLS Setting refactor #542
• fix: logging-operator-logging logging.yaml template #539
• Logging-demo chart dependency update minio 3.0.7 -> 5.0.33 #538
• Stricter RBAC Rules #537
• AWS ELasticSearch Output support #536
• SeLinux support #534
• Kinesis Firehose Output support #531
• LogDNA Output support #530
• Datadog output support #529
• fields column in Splunk Hec output plugin is not working . #505 #527

Fluentd

• New FluentD version 1.10.4 -> 1.11.1

Updated Plugins

• fluent-plugin-prometheus 1.8.1 -> 1.8.2
• fluent-plugin-elasticsearch 4.1.0 -> 4.1.1
• fluent-plugin-kafka 0.13.0 -> 0.13.1
• aws-fluent-plugin-kinesis 3.2.2 -> 3.2.3
• fluent-plugin-grafana-loki 1.2.13 -> 1.2.14
• fluent-plugin-s3 1.3.4 -> 1.4.0
• fluent-plugin-splunk-hec 1.2.2 -> 1.2.3

New Plugins

• fluent-plugin-aws-elasticsearch-service 2.4.0
• fluent-plugin-datadog 0.12.1
• fluent-plugin-logdna 0.3.1

Fluentbit

• New Fluentbit version 1.5.0 -> 1.5.2

Milestone 3.5.0
Detailed changes: 3.4.0...3.5.0
Thanks for all the contributors: @ahma @bshifter @pepov @sermilrod @tarokkk @velothump

3.4.0

Changelog

SDK

• Remove unused rbac generation flag from make manifests #511
• Throttle plugin support #512
• Removed not exists resources from crd kustomize template #515
• docs: fix hugo frontmatter #516
• Add ServiceMonitor configuration #517

Fluentd

Updated Plugins

• fluent-plugin-prometheus 1.8.0 -> 1.8.1
• fluent-plugin-elasticsearch 4.0.9 -> 4.1.0
• fluent-plugin-grafana-loki 1.2.12 -> 1.2.13
• fluent-plugin-s3 1.3.1 -> 1.3.4

Fluentbit

• New Fluentbit version 1.4.6 -> 1.5.0

Milestone 3.4.0
Detailed changes: 3.3.0...3.4.0
Thanks for all the contributors: @ahma @bshifter @pepov @tarokkk @velothump

3.3.0

Changelog

SDK

• Add Worker support to fluentd spec #504
• ltsv parser parameter support #503
• Kafka | Add CA certs from system option #501
• Allow ClusterOutput and ClusterFlow resources defined in arbitrary namespaces #499
• Fix helm chart to properly set clusterIP #494
• Omit empty clusterIP in the logging service spec to avoid helm3 upgrade failures #492
• Expose Username/Password for SASL authentication #490
• Only add HostPath to PSP if PositionDB enabled #489

Fluentd

• New FluentD version 1.10.3 -> 1.10.4

Updated Plugins

• fluent-plugin-geoip 1.3.1 -> 1.3.2
• fluent-plugin-prometheus 1.7.3 -> 1.8.0
• fluent-plugin-cloudwatch-logs 0.9.4 -> 0.10.0
• fluent-plugin-elasticsearch 4.0.8 -> 4.0.9
• aws-fluent-plugin-kinesis 3.2.1 -> 3.2.2
• fluent-plugin-grafana-loki 1.2.11 -> 1.2.12

Fluentbit

• New Fluentbit version 1.4.4 -> 1.4.6

Milestone 3.3.0
Detailed changes: 3.2.0...3.3.0
Thanks for all the contributors: @ahma @bshifter @EppO @pepov @tarokkk @velothump