Supply Chain Attack on Litellm Poses Significant Security Risks

Andrej Karpathy recently reported on the X platform that litellm has been subjected to a PyPI supply chain attack. According to Odaily, executing a simple 'pip install litellm' can lead to the theft of SSH keys, AWS/GCP/Azure credentials, Kubernetes configurations, git credentials, environment variables, encrypted wallets, SSL private keys, CI/CD keys, and database passwords. Litellm has a monthly download rate of 97 million, and the risk extends to all projects dependent on litellm, such as dspy. The malicious code was online for less than an hour before being discovered due to a flaw that caused Callum McMahon's machine to crash from memory exhaustion. Karpathy highlighted that supply chain attacks are among the most threatening issues in modern software, as installing dependencies can introduce compromised packages deep within the dependency tree. He is increasingly inclined to reduce dependencies and use LLMs to directly implement simple functions.