NEWS: generate for 9.9.9

Signed-off-by: github-actions <41898282+github-actions@users.noreply.github.com>
bazsi · Jan 6, 2024 · 98eebfd · 98eebfd
1 parent 3c2358b
commit 98eebfd
Show file tree

Hide file tree

Showing 7 changed files with 49 additions and 247 deletions.
diff --git a/NEWS.md b/NEWS.md
@@ -1,226 +1,77 @@
-4.5.0
+9.9.9
 =====
 
-Read Axoflow's [blog post](https://axoflow.com/axosyslog-release-4-5/) for more details.
-You can read more about the new features in the AxoSyslog [documentation](https://axoflow.com/docs/axosyslog-core/).
-
-
 ## Highlights
 
-#### Sending log messages to OpenObserve
-
-The `openobserve-log()` destination feeds OpenObserve via the [JSON API](https://openobserve.ai/docs/api/ingestion/logs/json/).
-
-Example config:
-```
-openobserve-log(
-    url("http://openobserve-endpoint")
-    port(5080)
-    stream("default")
-    user("root@example.com")
-    password("V2tsn88GhdNTKxaS")
-);
-```
-([#4698](https://github.com/syslog-ng/syslog-ng/pull/4698))
-
-#### Sending messages to Google Pub/Sub
-
-The `google-pubsub()` destination feeds Google Pub/Sub via the [HTTP REST API](https://cloud.google.com/pubsub/docs/reference/rest/v1/projects.topics/publish).
-
-Example config:
-```
-google-pubsub(
-  project("syslog-ng-project")
-  topic("syslog-ng-topic")
-  auth(
-    service-account(
-      key("/path/to/service-account-key.json")
-    )
-  )
-);
-```
+<Fill this block manually from the blocks below>
 
-See the [Google Pub/Sub documentation](https://cloud.google.com/pubsub/docs/building-pubsub-messaging-system) to learn more about configuring a service account.
-([#4651](https://github.com/syslog-ng/syslog-ng/pull/4651))
+## Features
 
-#### Parsing PostgreSQL logs
+  * `cloud-auth()`: Added support for `user-managed-service-account()` `gcp()` auth method.
 
-The `postgresql-csvlog-parser()`: add a new parser to process CSV log formatted by
-PostgreSQL (https://www.postgresql.org/docs/current/runtime-config-logging.html).
-The CSV format is extracted into a set of name-value pairs.
-([#4586](https://github.com/syslog-ng/syslog-ng/pull/4586))
+    This authentication method can be used on VMs in GCP to use the linked service.
 
-## Features
+    Example minimal config, which tries to use the "default" service account:
+    ```
+    cloud-auth(
+      gcp(
+        user-managed-service-account()
+      )
+    )
+    ```
 
-  * `http()`: Added support for using templates in the `url()` option.
-
-    In syslog-ng a template can only be resolved on a single message, as the same
-    template might have different resolutions on different messages. A http batch
-    consists of multiple messages, so it is not trivial to decide which message should
-    be used for the resolution.
-
-    When batching is enabled and multiple workers are configured it is important to
-    only batch messages which generate identical URLs. In this scenario one must set
-    the `worker-partition-key()` option with a template that contains all the templates
-    used in the `url()` option, otherwise messages will be mixed.
-
-    For security reasons, all the templated contents in the `url()` option are getting
-    URL encoded automatically. Also the following parts of the url cannot be templated:
-      * scheme
-      * host
-      * port
-      * user
-      * password
-    ([#4663](https://github.com/syslog-ng/syslog-ng/pull/4663))
-
-  * `$TRANSPORT`: this is a new name-value pair that syslog-ng populates
-    automatically.  It indicates the "transport" mechanism used to
-    retrieve/receive the message.  It is up to the source driver to determine
-    the value. Currently the following values were implemented:
-
-      BSD syslog drivers: `tcp()`, `udp()` & `network()`
-      * `rfc3164+tls`
-      * `rfc3164+tcp`
-      * `rfc3164+udp`
-      * `rfc3164+proxied-tls`
-      * `rfc3164+<custom logproto like altp>`
-
-      UNIX domain drivers: `unix-dgram()`, `unix-stream()`
-      * `unix-stream`
-      * `unix-dgram`
-
-      RFC5424 style syslog: `syslog()`:
-      * `rfc5426`: syslog over udp
-      * `rfc5425`: syslog over tls
-      * `rfc6587`: syslog over tcp
-      * `rfc5424+<custom logproto like altp>`: syslog over a logproto plugin
-
-      Other drivers:
-      * otlp: `otel()` driver
-      * mqtt: `mqtt()` driver
-      * hypr-api: `hypr-audit-source()` driver
-
-    `$IP_PROTO`: indicate the IP protocol version used to retrieve/receive the
-    message. Contains either "4" to indicate IPv4 and "6" to indicate IPv6.
-    ([#4673](https://github.com/syslog-ng/syslog-ng/pull/4673))
-
-  * `network()` and `syslog()` drivers: Added `ignore-validity-period` as a new flag to `ssl-options()`.
-
-    By specifying `ignore-validity-period`, you can ignore the validity periods
-    of certificates during the certificate validation process.
-    ([#4642](https://github.com/syslog-ng/syslog-ng/pull/4642))
-
-  * `tls()` in `udp()`/`tcp()`/`network()` and `syslog()` drivers: add support
-    for a new `http()` compatible ssl-version() option. This makes the TLS
-    related options for http() and other syslog-like drivers more similar. This
-    requires OpenSSL 1.1.0.
-    ([#4682](https://github.com/syslog-ng/syslog-ng/pull/4682))
-
-  * `cloud-auth()`: Added a new plugin for drivers, which implements different cloud related authentications.
-
-    Currently the only supported authentication is [GCP's Service Account](https://cloud.google.com/iam/docs/service-account-overview) for the `http()` destination.
-
-    Example config:
+    Full config:
     ```
-    http(
-      cloud-auth(
-        gcp(
-          service-account(
-            key("/path/to/service-account-key.json")
-            audience("https://pubsub.googleapis.com/google.pubsub.v1.Publisher")
-          )
+    cloud-auth(
+      gcp(
+        user-managed-service-account(
+          name("alltilla@syslog-ng-test-project.iam.gserviceaccount.com")
+          metadata-url("my-custom-metadata-server:8080")
         )
       )
-    );
+    )
     ```
-    ([#4651](https://github.com/syslog-ng/syslog-ng/pull/4651))
-
-  * `csv-parser()`: allow parsing the extracted values into matches ($1, $2, $3 ...)
-    by omitting the columns() parameter, which normally specifies the column
-    names.
-    ([#4678](https://github.com/syslog-ng/syslog-ng/pull/4678))
-
-  * `--check-startup`: a new command line option for syslog-ng along with the
-    existing `--syntax-only`. This new option will do a complete configuration
-    initialization and then exit with exit code indicating the result. Since
-    this also initializes things like network listeners, it will probably _not_
-    work when there is another syslog-ng instance running in the background. The
-    recommended use of this option is a dedicated config check container, as
-    explained in #4592.
-    ([#4646](https://github.com/syslog-ng/syslog-ng/pull/4646))
-
-## Bugfixes
-
-  * `s3`: Fixed an ImportError.
 
-    `ImportError: cannot import name 'SharedBool' from 'syslogng.modules.s3.s3_object'`
-    ([#4700](https://github.com/syslog-ng/syslog-ng/pull/4700))
-
-  * `loki()`: fixed mixing non-related label values
-    ([#4713](https://github.com/syslog-ng/syslog-ng/pull/4713))
-
-  * type hinting: Parsing and casting fractions are now done locale independently.
-    ([#4702](https://github.com/syslog-ng/syslog-ng/pull/4702))
+    This authentication method is extremely useful with syslog-ng's `google-pubsub()` destination,
+    when it is running on VMs in GCP, for example:
+    ```
+    destination {
+      google-pubsub(
+        project("syslog-ng-test-project")
+        topic("syslog-ng-test-topic")
+        auth(user-managed-service-account())
+      );
+    };
+    ```
 
-  * `metrics-probe()`: Fixed a crash.
+    For more info about this GCP authentication method, see:
+     * https://cloud.google.com/compute/docs/access/authenticate-workloads#curl
+     * https://cloud.google.com/compute/docs/access/create-enable-service-accounts-for-instances
+    ([#4755](https://github.com/syslog-ng/syslog-ng/pull/4755))
 
-    This crash occurred when a `metrics-probe()` instance was used in multiple source threads,
-    like a `network()` source with multiple connections.
-    ([#4685](https://github.com/syslog-ng/syslog-ng/pull/4685))
+  * `loggen`: improve loggen performance for synthetic workloads, so we can test
+    up to 650k msg/sec on my AMD Ryzen 7 Pro 6850U CPU.
+    ([#4476](https://github.com/syslog-ng/syslog-ng/pull/4476))
 
-  * `flags()` argument to various drivers: fix a potential crash in case a flag with at least 32 characters is used.
-    No such flag is defined by syslog-ng, so the only way to trigger the crash is to use an invalid configuration file.
-    ([#4689](https://github.com/syslog-ng/syslog-ng/pull/4689))
 
-  * Fix `$PROTO` value for `transport(tls)` connections, previously it was set
-    to "0" while in reality these are tcp connections (e.g. "6").
+## Bugfixes
 
-    Fix how syslog-ng sets $HOST for V4-mapped addresses in case of IPv6 source
-    drivers (e.g. `udp6()`/`tcp6()` or when using `ip-protocol(6)` for `tcp()`/`udp()`).
-    Previously V4-mapped addresses would be represented as
-    `"::ffff:<ipv4 address>"`. This is not wrong per-se, but would potentially
-    cause the same host to be represented in multiple ways. With the fix,
-    syslog-ng would just use `"<ipv4 address>"` in these cases.
-    ([#4673](https://github.com/syslog-ng/syslog-ng/pull/4673))
+  * `metrics-probe()`: Fixed not cleaning up dynamic labels for each message if no static labels are set.
+    ([#4750](https://github.com/syslog-ng/syslog-ng/pull/4750))
 
-  * `db-parser()`: support nested match characters in `@QSTRING@` pattern parser
-    ([#4717](https://github.com/syslog-ng/syslog-ng/pull/4717))
+  * `network()` source: fix marking originally valid utf-8 messages when `sanitize-utf8` is enabled
+    ([#4744](https://github.com/syslog-ng/syslog-ng/pull/4744))
 
 
 ## Other changes
 
-  * `LogSource` and `LogFetcher`: additional documentation was added to these
-    Python classes to cover explicit source-side batching functionalities (e.g.
-    the `auto_close_batch` attribute and the `close_batch()` method).
-    ([#4673](https://github.com/syslog-ng/syslog-ng/pull/4673))
-
-  * `rate-limit()`: Renamed the `template()` option to `key()`, which better communicates the intention.
-    ([#4679](https://github.com/syslog-ng/syslog-ng/pull/4679))
-
-  * templates: The `template-escape()` option now only escapes the top-level template function.
+  * `network()`/`syslog()` sources: support UTF-8 sanitization/validation of RFC 5424 and `no-parse` messages
 
-    Before syslog-ng 4.5.0 if you had embedded template functions, the `template-escape(yes)` setting
-    escaped the output of each template function, so the parent template function received an
-    already escaped string. This was never the intention of the `template-escape()` option.
+    The `sanitize-utf8`, `validate-utf8` flags are now supported when parsing RFC 5424 messages or when parsing is disabled.
+    ([#4744](https://github.com/syslog-ng/syslog-ng/pull/4744))
 
-    Although this is a breaking change, we do not except anyone having a config that is affected.
-    If you have such a config, make sure to follow-up this change. If you need help with it, feel
-    free to open an issue or discussion on GitHub, or contact us on the Axoflow Discord server.
-    ([#4666](https://github.com/syslog-ng/syslog-ng/pull/4666))
-
-  * `loki()`: The `timestamp()` option now supports quoted strings.
-
-    The valid values are the following, with or without quotes, case insensitive:
-      * "current"
-      * "received"
-      * "msg"
-    ([#4688](https://github.com/syslog-ng/syslog-ng/pull/4688))
-
-## syslog-ng Discord
-
-For a bit more interactive discussion, join our Discord server:
-
-[![Axoflow Discord Server](https://discordapp.com/api/guilds/1082023686028148877/widget.png?style=banner2)](https://discord.gg/E65kP9aZGm)
+  * APT packages: Added Ubuntu Mantic Minotaur.
+    ([#4737](https://github.com/syslog-ng/syslog-ng/pull/4737))
 
 
 ## Credits
@@ -234,5 +85,4 @@ of syslog-ng, contribute.
 
 We would like to thank the following people for their contribution:
 
-Attila Szakacs, Balazs Scheidler, Cedric Arickx, Fabrice Fontaine,
-Hofi, László Várady, Romain Tartière, Szilard Parrag, yashmathne
+
diff --git a/news/bugfix-4744.md b/news/bugfix-4744.md
diff --git a/news/bugfix-4750.md b/news/bugfix-4750.md
diff --git a/news/feature-4476.md b/news/feature-4476.md
diff --git a/news/feature-4755.md b/news/feature-4755.md
diff --git a/news/other-4737.md b/news/other-4737.md
diff --git a/news/other-4744.md b/news/other-4744.md