News

AI Provider Index news.

Updates, product notes and practical coverage for AI platforms and operators.

#DataEngineering
Open OpenAI scales Habitat past 500 petabytes for more than one billion users · Ronald

OpenAI scales Habitat past 500 petabytes for more than one billion users

OpenAI has detailed how Habitat, its online storage platform, serves more than one billion users across 40 regions and stores over 500 petabytes. The architecture evolved around Azure Cosmos DB with co-managed multitenant containers, global caching, placement controls and workload isolation. OpenAI says the work delivered 12-times faster reads while reducing operational burden.

#OpenAI #CloudInfrastructure #DataEngineering Read more
Open Databricks Makes Variant and Variant Shredding Generally Available · Ronald

Databricks Makes Variant and Variant Shredding Generally Available

Databricks has moved its Variant data type and Variant Shredding optimisation into general availability. The release is designed to preserve flexible ingestion for semi-structured data while automatically improving query performance across Delta and Iceberg workloads, including data used by analytics and AI applications.

#Databricks#DataEngineering#Lakehouse Read more