Using object storage#
CLP can:
compress logs from object storage (e.g., S3 and S3-compatible storage services);
store archives on object storage; and
cache stream files (used for viewing compressed logs) on object storage.
Note
Currently, only clp-json supports object storage. Support for clp-text will be
added in a future release.
Tip
If you’re using object storage because the host(s) on which you’re running CLP are ephemeral, consider also using external databases for metadata storage (to ensure data persistence in case of host replacements).
Guides#
Choose the guide that matches your object storage service:
AWS S3
Using CLP with Amazon Web Services S3.
S3-compatible storage
Using CLP with S3-compatible storage services (e.g., MinIO, Ceph).