Risks AI tool supply chain

High

High: tampered releases reached a public package site and were built to steal cloud and system keys, and it applies to organizations running AI gateway software. How we rate severity

AI gateway supply chain attack: backdoored releases targeted cloud secrets

Two backdoored releases of a widely used AI gateway reached PyPI, built to steal cloud and Kubernetes secrets. AI middleware deserves crown-jewel controls.

What happened

An AI gateway supply chain attack in March 2026 hit a component that sits between applications and model providers and usually holds keys for all of them.

LiteLLM, an open-source AI gateway, says two releases published to PyPI, versions 1.82.7 and 1.82.8, contained malicious code. They were live on March 24, 2026, “from 10:39 UTC for about 40 minutes before being quarantined by PyPI.” LiteLLM says its evidence suggested a maintainer’s PyPI account may have been compromised, and it believes the compromise originated from the Trivy dependency used in its CI/CD security-scanning workflow. According to LiteLLM, the malicious versions appear to have included a credential stealer designed to harvest environment variables, SSH keys, cloud provider credentials, Kubernetes tokens, and database passwords, and send them to a domain that was not LiteLLM’s. LiteLLM says customers running its official proxy Docker image were not affected, because that image pins its dependencies. It later released a clean version built through a new release pipeline.

Datadog Security Labs places the incident in a broader campaign. In its timeline, the Trivy security scanner was compromised on March 19, the activity then reached Checkmarx and OpenVSX artifacts, LiteLLM was hit on March 24, and the Telnyx package on PyPI followed on March 27. Datadog advises defenders to treat any host or CI job that installed the affected versions “as a full-credential exposure event.”

Why it matters to leaders (our analysis)

AI gateways and model-routing libraries are often added quickly, by product teams, as plumbing. They end up holding model API keys alongside cloud, database, and Kubernetes credentials, which makes one poisoned release unusually valuable to an attacker. These releases were live for only about 40 minutes, which is enough for unpinned installs and automated builds to pull them in, and LiteLLM says pinned dependencies kept at least one deployment path unaffected.

It also shows how compromises chain: according to LiteLLM and Datadog, credentials taken through one project’s security tooling became the way into the next. Leaders should make sure AI middleware sits inside the same supply chain controls as any other critical dependency, with pinned versions, internal mirrors, minimal secrets, and a rotation plan that assumes everything the host could reach is exposed.

What to tell your board

The software linking our apps to AI services holds keys to many systems, so we install only verified versions, limit the keys it holds, and can replace them quickly.

What your board will ask

  1. Which AI gateways or model-routing libraries do we run, and which model, cloud, and database credentials do they hold?
  2. Would a malicious version of one of those packages be installed automatically, or do we pin and verify versions?
  3. If an AI gateway host were compromised, how quickly could we rotate every key it could reach?

Controls that help

  • Pin AI middleware packages to exact versions with hash verification, and install them from an internal mirror rather than straight from public registries. NIST SP 800-218 SSDF — PW.4
  • Treat an AI gateway host as a secrets store: minimize the credentials it holds, scope them narrowly, and keep them out of plain environment variables where possible. ISO/IEC 27001:2022 A.8.2 Privileged access rights
  • If a compromised version was installed anywhere, treat it as a full credential exposure. Rotate every secret the host or CI job could reach, and look for persistence and unusual outbound traffic. ISO/IEC 27001:2022 A.5.26 Response to information security incidents
  • Include security-scanning tools in your CI/CD threat model, since a compromised scanner can expose the publishing credentials of the projects it scans. NIST CSF 2.0 — GV.SC

Sources

  1. Security Update: Suspected Supply Chain Incident — LiteLLM · Mar 24, 2026
  2. LiteLLM and Telnyx compromised on PyPI: Tracing the TeamPCP supply chain campaign — Datadog Security Labs · Mar 24, 2026

Published Oct 17, 2026 · Last updated Oct 17, 2026

Change log

  • Oct 17, 2026. First published.

All AI tool supply chain risks

ModelsOther systems

Coming soon

The weekly AI security briefing

The five AI risks security leaders should know, with the questions your board will ask. Signups open soon.

Signups open soon. We'll never share your email. See our Privacy Policy. Privacy Policy

Sponsored

Your logo here: sponsor us →