AI Infrastructure

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Data infrastructure for AI

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloudhttps://cloud.qdrant

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference an

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference an

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).