Skip to main content

AI/ML / Multi Agent Refarch / Threats / DEV

Hosted-provider data-handling exposure

CCC.MARefArc.TH02

Sensitive data submitted through the LLM gateway to third-party hosted models is exposed when the provider lacks transparent encryption, retention limits, or secure-deletion guarantees, leaving the institution without control over data it no longer holds.

Related Capabilities

IDTitleDescription
CCC.MARefArc.CP14Approved-model registry and lifecycleCatalog of approved models with metadata, version information, configuration parameters, and usage constraints, ensuring agents access only models meeting organizational, regulatory, and security standards.
CCC.MARefArc.CP16Model-interaction zero-trust guardrailsEnforces authentication and authorization for every inference request and applies input validation against prompt injection, output filtering and redaction, access control, rate limits, and cost management before and after model execution.

Related Controls

IDTitleDescription
CCC.MARefArc.CN01Data Filtering From External Knowledge BasesSanitize, filter, and classify data ingested by the Knowledge Layer from internal and external source bases before it is embedded into the vector store or used for retrieval-augmented generation, preventing inadvertent exposure or manipulation of sensitive organizational knowledge.
CCC.MARefArc.CN04Data Quality and ClassificationAssess the quality of, and assign classification and sensitivity labels to, all data used for grounding, training, and fine-tuning, and enforce handling rules derived from those labels throughout the Knowledge and LLM layers.
CCC.MARefArc.CN05Legal and Contractual Frameworks for AI SystemsEstablish contractual controls with model and MCP service providers covering data handling, retention and deletion, intellectual property, liability, and supply-chain integrity.
CCC.MARefArc.CN08Role-Based Access Control for AI DataEnforce least-privilege, role-based access control over all AI data stores, including source bases, the vector store, and model artifacts.
CCC.MARefArc.CN13MCP Server Security GovernanceGovern the onboarding, verification, and ongoing monitoring of MCP servers so that only approved, integrity-verified servers are reachable, and supply-chain compromise is detected.
CCC.MARefArc.CN16AI Data Leakage Prevention and DetectionDetect leakage of sensitive data in model inputs and outputs and in telemetry, and alert and respond when disclosure is detected.
CCC.MARefArc.CN17AI System ObservabilityInstrument every layer to emit logs, traces, metrics, and events to the Observability Layer so that behaviour, drift, availability, and data handling are continuously visible and auditable.
CCC.MARefArc.CN21Automated Evaluation Using LLM-as-a-JudgeUse automated model-based evaluation in the Evaluation Layer to assess output quality, grounding, bias, and policy compliance at scale.

External Mappings

FrameworkIDRemarks
air-vecAIR-RC-001-03
air-vecAIR-RC-001-04