Project structure#
CLP is currently split across a few different components in the components directory:
api-server contains code for the API server of the CLP package.
clp-mcp-server contains code for CLP MCP server.
clp-package-utils contains Python utilities for operating the CLP package.
clp-py-utils contains Python utilities common to several of the other Python components.
clp-rust-utils contains Rust utilities common to several of the other Rust components.
clp-tdl-package contains implementations of CLP tasks running on Spider.
compression-coordinator contains code to coordinate CLP compression jobs running on Spider.
core contains code to compress uncompressed logs, decompress compressed logs, and search compressed logs.
job-orchestration contains code to schedule compression and search jobs on the cluster.
log-ingestor contains code to serve requests for CLP ingestion job orchestration.
package-template contains the base directory structure and files of the CLP package.
webui contains the web interface for the CLP package.