tencent cloud

PrevNext

Feedback

search by keyword

Recent Pages

Documentation
Cloud Log Service
    Documentation
    Download PDF

    LogListener Updates

    Last updated: 2024-01-20 17:14:28
    Download PDF
    This document describes CLS LogListener updates.
    Note:
    The __HOSTNAME__ collection feature is available starting from LogListener v2.7.4.
    The combined parsing feature is available starting from LogListener v2.6.4.
    Full/Incremental collection policies are available starting from LogListener v2.6.2.
    CVM batch deployment is available starting from LogListener v2.6.0.
    Multi-line - full regular expression collection mode is available starting from LogListener v2.4.5.
    LogListener auto upgrade is available starting from LogListener v2.5.0.
    Uploading parsing-failed logs is available starting from LogListener v2.5.2.
    You are advised to install or upgrade to the latest version for a better user experience.
    Version
    Change Type
    Description
    v2.7.9
    Experience optimization
    Added LogListener file lock verification, so only one agent instance can be started by default.
    Fixed the empty row processing exception in `containerd stdout`.
    Fixed full disk and business exceptions caused by file handle leaks.
    Fixed the failure in parsing the second half of the log content when there were too many lines of logs.
    v2.7.8
    Experience optimization
    Fixed the issue where logs didn't have tag metadata due to metadata file generation delay in container scenarios.
    v2.7.7
    Experience optimization
    Fixed the issue where the collection program's network connection couldn't be reconnected after a DNS exception was fixed.
    v2.7.6
    Experience optimization
    Optimized the line break processing during `hostname` extraction.
    v2.7.5
    Experience optimization
    Fixed the processing exception in file rotation when the actual file and soft link in the same directory were collected at the same time with different collection configurations.
    v2.7.4
    New feature
    Supported collecting `hostname` as the metadata.
    Added `meta_processor` for combined parsing and supported parsing custom metadata (path).
    Experience optimization
    Fixed the missing collection problem in file deletion scenarios.
    Fixed the issue where a file was collected repeatedly as the file size calculated by the system was incorrect due to the lace of a line break at the end of the file.
    v2.7.3
    New feature
    Supported log upload from multiple endpoints by a single agent instance.
    v2.7.2
    Experience optimization
    Fixed the issue where the memory leaked as the corresponding configuration cache couldn't be cleared when a rotation file was removed.
    v2.7.1
    Experience optimization
    Fixed the issue where a large number of empty service logs were printed.
    v2.7.0
    Experience optimization
    Fixed the issue where collection was blocked due to possible exceptions when an empty string was uploaded.
    v2.6.9
    Experience optimization
    Fixed the issue where excessive invalid logs were printed when multi-line log parsing failed.
    v2.6.8
    Experience optimization
    Added a limit on the LogListener collection specification, so the protection mechanism will be enabled after the limit is exceeded.
    Fixed the Ubuntu startup failure.
    Optimized the blocklist feature to reduce the memory usage.
    Optimized the combined parsing mode and fixed processing exceptions when the root processor was a regular expression parsing plugin.
    Optimized the printing of certain logs.
    v2.6.7
    New feature
    Supported the multi-tenancy collection capabilities under a single agent.
    v2.6.6
    Experience optimization
    Fixed the issue where files with a small amount of written data might be missing or delayed during collection in soft link scenarios.
    v2.6.5
    New feature
    Supported parsing the time zone information in the log time.
    Experience optimization
    Fixed the empty pointer processing exception in advanced data processing.
    Fixed the exception when multiple files were rotated at the same time.
    v2.6.4
    New feature
    Supported customizing log parsing rules through a plugin.
    Experience optimization
    Optimized the log parsing format pipeline.
    Fixed the exception of parsing the millisecond timestamp (`%F`).
    v2.6.3
    Experience optimization
    Fixed the issue where LogListener couldn't be started if the checkpoint file is corrupted.
    Fixed the issue where the blocklist didn't take effect for new files in special scenarios.
    v2.6.2
    New feature
    Added support for incremental collection.
    Experience optimization
    Optimized the issue where collection is ignored in the period from file scanning to processing.
    Optimized abnormal overriding during automatic upgrade.
    v2.6.1
    Experience optimization
    Optimized the issue where backtracking collection may occur during log rotation in some scenarios.
    Adjusted the timeout duration for log upload on the collection end to avoid data duplication caused by timeout.
    v2.6.0
    New feature
    Added support for CVM batch deployment.
    Added support for ciphertext storage of secret IDs/KEYs.
    Experience optimization
    Optimized the LogListener installation and stop logic.
    Optimized the retry policy upon upload failures.
    Added a tool for detecting and rectifying dead locks caused by Glibc libraries of earlier versions.
    Optimized collection performance.
    v2.5.9
    Experience optimization
    Optimized the resource limit policy.
    v2.5.8
    Experience optimization
    Fixed the issue that removing a directory soft link affects the collection of other directory soft links that point to the same target.
    Fixed the issue that files in a directory cannot be collected if a soft link of the directory is removed and the same soft link is created again.
    v2.5.7
    Experience optimization
    Fixed the (new) issue that logs will be collected again when the log file size is greater than 2 GB.
    Fixed the issue where renaming too many files will cause the program to malfunction.
    Fixed the issue where specified fields cannot be updated under log collection monitoring.
    v2.5.6
    Experience optimization
    Optimized the issue that under specific use cases, the collection program cannot be triggered.
    v2.5.5
    Experience optimization
    Optimized metadata checkpoints for collection to guarantee no data will lose due to restart.
    Supports resource limit configuration and overrun handling for memory, CPU, and bandwidth.
    v2.5.4
    New feature
    Added support for log collection monitoring.
    Experience optimization
    Enhanced memory overrun handling: LogListener will be automatically loaded when memory overrun lasts for a period of time.
    v2.5.3
    Experience optimization
    Optimized LogListener exceptions caused by memory issues.
    v2.5.2
    New feature
    Added support for uploading parsing-failed logs.
    Experience optimization
    Optimized the blocklist feature. Now, the blocklist FILE mode supports wildcard filtering.
    v2.5.1
    Experience optimization
    Enhanced the handling when breakpoint metadata could not be found in the collection file.
    v2.5.0
    New feature
    Added support for automatic LogListener upgrade.
    Added support for automatic LogListener start in Ubuntu operating system.
    v2.4.6
    Experience optimization
    Cleared residual configuration data in the cache after the collection configuration was changed.
    Optimized the issue where file collection with a soft link pointing to the `realpath` file was affected when an `IN_DELETE` event that deleted the soft link was being processed.
    Optimized the feature of collecting the same source file via the file's soft link and the directory's soft link at the same time.
    v2.4.5
    New feature
    Added support for `multiline_fullregex_log` log collection.
    v2.4.4
    Experience optimization
    Optimized the issue of inaccurate log time caused by the msec feature.
    v2.4.3
    New feature
    Added support for automatically checking the log format (logFormat).
    v2.4.2
    Experience optimization
    Optimized the issue of cache eviction during configuration pulling in Tencent Cloud container scenarios.
    v2.4.1
    New feature
    Added support for collecting logs in milliseconds.
    Experience optimization
    Optimized exceptions due to no line break data in user logs.
    v2.4.0
    New feature
    Added support for instance-level process monitoring by LogListener.
    v2.3.9
    New feature
    Added support for blocklisting collection paths.
    Experience optimization
    Optimized the memory leak issue due to outdated Boost library.
    v2.3.8
    New feature
    Added support for multi-path log collection.
    v2.3.6
    Experience optimization
    Fixed the issue where collection stopped due to invalid key value.
    Fixed the memory leak issue due to request failures with the error code 502 returned.
    v2.3.5
    New feature
    Added support for log context search.
    Experience optimization
    Fixed the issue where log collection stopped when logs were uploaded but authentication failed in the static configuration mode.
    Fixed the issue where dynamic configurations were no longer read after the memory exceeded the threshold in the dynamic configuration mode.
    Fixed the issue where sometimes log collection repeated when the log production speed was too high during log rotation.
    Fixed the memory leak issue caused by multiple failures to upload logs.
    v2.3.1
    Experience optimization
    Optimized memory limit.
    When the memory limit was reached, requests lasting over 3s were considered as timed out.
    v2.2.6
    New feature
    Added support for configuring private domain names and public domain names separately.
    Experience optimization
    Fixed LogListener exceptions caused by `getip`.
    v2.2.5
    New feature
    Added support for Tencent Cloud COC environment deployment.
    Experience optimization
    Fixed the core issue caused by `getip`.
    v2.2.4
    Experience optimization
    Changed the commands for installation and initialization to the subcommands `install` and `init` of `tools/loglistener.sh` respectively.
    Changed the command for restart to `/etc/init.d/loglistenerd start|stop|restart`.
    v2.2.3
    Experience optimization
    Renaming or creating logs during log rotation will not cause log loss.
    v2.2.2
    Experience optimization
    A log greater than 512 KB will be automatically truncated.
    Earlier versions
    -
    v2.2.2 added support for collection by full regular expression.
    v2.1.4 added support for full text in multi lines.
    v2.1.1 added support for log structuring.
    
    Contact Us

    Contact our sales team or business advisors to help your business.

    Contact Us
    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    Submit a Ticket
    7x24 Phone Support
    Copyright © 2013-2024 Tencent Cloud. All Rights Reserved.
    Privacy PolicyLegalCookie Policy