tencent cloud

피드백

LogListener Updates

마지막 업데이트 시간:2024-01-20 17:14:28
This document describes CLS LogListener updates.
Note:
The __HOSTNAME__ collection feature is available starting from LogListener v2.7.4.
The combined parsing feature is available starting from LogListener v2.6.4.
Full/Incremental collection policies are available starting from LogListener v2.6.2.
CVM batch deployment is available starting from LogListener v2.6.0.
Multi-line - full regular expression collection mode is available starting from LogListener v2.4.5.
LogListener auto upgrade is available starting from LogListener v2.5.0.
Uploading parsing-failed logs is available starting from LogListener v2.5.2.
You are advised to install or upgrade to the latest version for a better user experience.
Version
Change Type
Description
v2.7.9
Experience optimization
Added LogListener file lock verification, so only one agent instance can be started by default.
Fixed the empty row processing exception in `containerd stdout`.
Fixed full disk and business exceptions caused by file handle leaks.
Fixed the failure in parsing the second half of the log content when there were too many lines of logs.
v2.7.8
Experience optimization
Fixed the issue where logs didn't have tag metadata due to metadata file generation delay in container scenarios.
v2.7.7
Experience optimization
Fixed the issue where the collection program's network connection couldn't be reconnected after a DNS exception was fixed.
v2.7.6
Experience optimization
Optimized the line break processing during `hostname` extraction.
v2.7.5
Experience optimization
Fixed the processing exception in file rotation when the actual file and soft link in the same directory were collected at the same time with different collection configurations.
v2.7.4
New feature
Supported collecting `hostname` as the metadata.
Added `meta_processor` for combined parsing and supported parsing custom metadata (path).
Experience optimization
Fixed the missing collection problem in file deletion scenarios.
Fixed the issue where a file was collected repeatedly as the file size calculated by the system was incorrect due to the lace of a line break at the end of the file.
v2.7.3
New feature
Supported log upload from multiple endpoints by a single agent instance.
v2.7.2
Experience optimization
Fixed the issue where the memory leaked as the corresponding configuration cache couldn't be cleared when a rotation file was removed.
v2.7.1
Experience optimization
Fixed the issue where a large number of empty service logs were printed.
v2.7.0
Experience optimization
Fixed the issue where collection was blocked due to possible exceptions when an empty string was uploaded.
v2.6.9
Experience optimization
Fixed the issue where excessive invalid logs were printed when multi-line log parsing failed.
v2.6.8
Experience optimization
Added a limit on the LogListener collection specification, so the protection mechanism will be enabled after the limit is exceeded.
Fixed the Ubuntu startup failure.
Optimized the blocklist feature to reduce the memory usage.
Optimized the combined parsing mode and fixed processing exceptions when the root processor was a regular expression parsing plugin.
Optimized the printing of certain logs.
v2.6.7
New feature
Supported the multi-tenancy collection capabilities under a single agent.
v2.6.6
Experience optimization
Fixed the issue where files with a small amount of written data might be missing or delayed during collection in soft link scenarios.
v2.6.5
New feature
Supported parsing the time zone information in the log time.
Experience optimization
Fixed the empty pointer processing exception in advanced data processing.
Fixed the exception when multiple files were rotated at the same time.
v2.6.4
New feature
Supported customizing log parsing rules through a plugin.
Experience optimization
Optimized the log parsing format pipeline.
Fixed the exception of parsing the millisecond timestamp (`%F`).
v2.6.3
Experience optimization
Fixed the issue where LogListener couldn't be started if the checkpoint file is corrupted.
Fixed the issue where the blocklist didn't take effect for new files in special scenarios.
v2.6.2
New feature
Added support for incremental collection.
Experience optimization
Optimized the issue where collection is ignored in the period from file scanning to processing.
Optimized abnormal overriding during automatic upgrade.
v2.6.1
Experience optimization
Optimized the issue where backtracking collection may occur during log rotation in some scenarios.
Adjusted the timeout duration for log upload on the collection end to avoid data duplication caused by timeout.
v2.6.0
New feature
Added support for CVM batch deployment.
Added support for ciphertext storage of secret IDs/KEYs.
Experience optimization
Optimized the LogListener installation and stop logic.
Optimized the retry policy upon upload failures.
Added a tool for detecting and rectifying dead locks caused by Glibc libraries of earlier versions.
Optimized collection performance.
v2.5.9
Experience optimization
Optimized the resource limit policy.
v2.5.8
Experience optimization
Fixed the issue that removing a directory soft link affects the collection of other directory soft links that point to the same target.
Fixed the issue that files in a directory cannot be collected if a soft link of the directory is removed and the same soft link is created again.
v2.5.7
Experience optimization
Fixed the (new) issue that logs will be collected again when the log file size is greater than 2 GB.
Fixed the issue where renaming too many files will cause the program to malfunction.
Fixed the issue where specified fields cannot be updated under log collection monitoring.
v2.5.6
Experience optimization
Optimized the issue that under specific use cases, the collection program cannot be triggered.
v2.5.5
Experience optimization
Optimized metadata checkpoints for collection to guarantee no data will lose due to restart.
Supports resource limit configuration and overrun handling for memory, CPU, and bandwidth.
v2.5.4
New feature
Added support for log collection monitoring.
Experience optimization
Enhanced memory overrun handling: LogListener will be automatically loaded when memory overrun lasts for a period of time.
v2.5.3
Experience optimization
Optimized LogListener exceptions caused by memory issues.
v2.5.2
New feature
Added support for uploading parsing-failed logs.
Experience optimization
Optimized the blocklist feature. Now, the blocklist FILE mode supports wildcard filtering.
v2.5.1
Experience optimization
Enhanced the handling when breakpoint metadata could not be found in the collection file.
v2.5.0
New feature
Added support for automatic LogListener upgrade.
Added support for automatic LogListener start in Ubuntu operating system.
v2.4.6
Experience optimization
Cleared residual configuration data in the cache after the collection configuration was changed.
Optimized the issue where file collection with a soft link pointing to the `realpath` file was affected when an `IN_DELETE` event that deleted the soft link was being processed.
Optimized the feature of collecting the same source file via the file's soft link and the directory's soft link at the same time.
v2.4.5
New feature
Added support for `multiline_fullregex_log` log collection.
v2.4.4
Experience optimization
Optimized the issue of inaccurate log time caused by the msec feature.
v2.4.3
New feature
Added support for automatically checking the log format (logFormat).
v2.4.2
Experience optimization
Optimized the issue of cache eviction during configuration pulling in Tencent Cloud container scenarios.
v2.4.1
New feature
Added support for collecting logs in milliseconds.
Experience optimization
Optimized exceptions due to no line break data in user logs.
v2.4.0
New feature
Added support for instance-level process monitoring by LogListener.
v2.3.9
New feature
Added support for blocklisting collection paths.
Experience optimization
Optimized the memory leak issue due to outdated Boost library.
v2.3.8
New feature
Added support for multi-path log collection.
v2.3.6
Experience optimization
Fixed the issue where collection stopped due to invalid key value.
Fixed the memory leak issue due to request failures with the error code 502 returned.
v2.3.5
New feature
Added support for log context search.
Experience optimization
Fixed the issue where log collection stopped when logs were uploaded but authentication failed in the static configuration mode.
Fixed the issue where dynamic configurations were no longer read after the memory exceeded the threshold in the dynamic configuration mode.
Fixed the issue where sometimes log collection repeated when the log production speed was too high during log rotation.
Fixed the memory leak issue caused by multiple failures to upload logs.
v2.3.1
Experience optimization
Optimized memory limit.
When the memory limit was reached, requests lasting over 3s were considered as timed out.
v2.2.6
New feature
Added support for configuring private domain names and public domain names separately.
Experience optimization
Fixed LogListener exceptions caused by `getip`.
v2.2.5
New feature
Added support for Tencent Cloud COC environment deployment.
Experience optimization
Fixed the core issue caused by `getip`.
v2.2.4
Experience optimization
Changed the commands for installation and initialization to the subcommands `install` and `init` of `tools/loglistener.sh` respectively.
Changed the command for restart to `/etc/init.d/loglistenerd start|stop|restart`.
v2.2.3
Experience optimization
Renaming or creating logs during log rotation will not cause log loss.
v2.2.2
Experience optimization
A log greater than 512 KB will be automatically truncated.
Earlier versions
-
v2.2.2 added support for collection by full regular expression.
v2.1.4 added support for full text in multi lines.
v2.1.1 added support for log structuring.

문의하기

고객의 업무에 전용 서비스를 제공해드립니다.

기술 지원

더 많은 도움이 필요하시면, 티켓을 통해 연락 바랍니다. 티켓 서비스는 연중무휴 24시간 제공됩니다.

연중무휴 24시간 전화 지원