Skip to main content

AI/ML / Gen AI / Threats / DEV

Model Tampering

CCC.GenAI.TH08

Supply chain risks, including tampering with a model's core components at any stage of its lifecycle—from its source code and training data to the final deployable artifact—may result in embedding backdoors or adversarial triggers altering model behaviour under certain conditions.

Related Capabilities

IDTitleDescription
CCC.GenAI.CP01Text-Based Model SelectionAbility to select a foundation model that excels at natural language understanding and generation tasks such as summarization, translation, text generation, question answering, and sentiment analysis.
CCC.GenAI.CP02Code-Based Model SelectionAbility to select a foundation model that focuses on code understanding, generation, and transformation tasks.
CCC.GenAI.CP03Embedding Model SelectionAbility to select a foundation model used for tasks like semantic search, clustering, and document similarity by converting text into vector embeddings.
CCC.GenAI.CP04Image-Based Model SelectionAbility to select a foundation model that focuses on tasks related to vision, such as image generation, editing, and manipulation.
CCC.GenAI.CP04Image-Based Model SelectionAbility to select a foundation model that focuses on tasks related to vision, such as image generation, editing, and manipulation.
CCC.GenAI.CP04Image-Based Model SelectionAbility to select a foundation model that focuses on tasks related to vision, such as image generation, editing, and manipulation.

Related Controls

IDTitleDescription
CCC.GenAI.CN08Quality Control and Red TeamingEstablish a formal program for quality evaluation and adversarial testing (red teaming) to ensure GenAI system meet all business, quality, security and compliance requirements before getting deployed into production environments.

External Mappings

FrameworkIDRemarks
FINOS-AIGFAIR-SEC-008Tampering With the Foundational Model
SAIFMSTModel Source Tampering
SAIFMDTModel Deployment Tampering
OWASP-LLM-TOP10LLM03:2025Supply Chain
MITRE-ATLASAML.T0010AI Supply Chain Compromise