Project structure#

CLP is currently split across a few different components in the components directory:

  • api-server contains code for the API server of the CLP package.

  • clp-mcp-server contains code for CLP MCP server.

  • clp-package-utils contains Python utilities for operating the CLP package.

  • clp-py-utils contains Python utilities common to several of the other Python components.

  • clp-rust-utils contains Rust utilities common to several of the other Rust components.

  • clp-tdl-package contains implementations of CLP tasks running on Spider.

  • compression-coordinator contains code to coordinate CLP compression jobs running on Spider.

  • core contains code to compress uncompressed logs, decompress compressed logs, and search compressed logs.

  • job-orchestration contains code to schedule compression and search jobs on the cluster.

  • log-ingestor contains code to serve requests for CLP ingestion job orchestration.

  • package-template contains the base directory structure and files of the CLP package.

  • webui contains the web interface for the CLP package.