Oxide_CDS_Usage_Breakdown
Based on the Oxide rack specifications
Given CDS requirements, here is a detailed analysis and design recommendation for allocating virtual machines (VMs) across four environments (dev, test, UAT, prod) for three products (CNC, NA, Max), along with a performance-optimized solution to support global growth.
Oxide Rack Key Specifications (Per Rack)
Maximum compute sleds: 32
Each sled has:
64 physical cores (AMD EPYC 7713P)
512 GB to 1 TB DRAM (using 1 TB for max capacity)
NVMe storage: up to 10 x 3.2 TB drives per sled
Total resources per full rack (32 sleds):
CPU cores: 32 x 64 = 2048 cores
Memory: 32 x 1 TB = 32 TB RAM (32,768 GB)
NVMe storage: ~250 TB total
Network bandwidth: 12.8 Tbit/s
Power draw: up to 15 kW per rack
Custom hypervisor based on Bhyve/Illumos for VM management
VM Resource Requirements per Product (Hypothetical)
CNC
4
16
NA
8
32
Max
16
64
Total VMs Per Product Per Environment
Total vCPUs available: 2048 (2 vCPUs per physical core)
Total RAM available: 32,768 GB
Calculations:
For CNC:
Max VMs by CPU: 2048 / 4 = 512
Max VMs by RAM: 32,768 / 16 = 2048
Limiting factor: CPU → 512 VMs total
Per environment (4 environments): 512 / 4 = 128 VMs
For NA:
Max VMs by CPU: 2048 / 8 = 256
Max VMs by RAM: 32,768 / 32 = 1024
Limiting factor: CPU → 256 VMs total
Per environment: 256 / 4 = 64 VMs
For Max:
Max VMs by CPU: 2048 / 16 = 128
Max VMs by RAM: 32,768 / 64 = 512
Limiting factor: CPU → 128 VMs total
Per environment: 128 / 4 = 32 VMs
Summary:
CNC
512
128
NA
256
64
Max
128
32
Designing for Growth and Performance
Assuming a growth factor of 2x for each product (doubling VM needs as customers grow globally):
CNC
128
256
384
NA
64
128
192
Max
32
64
96
To accommodate this growth within the same rack, resource allocation must be optimized:
Recommendations for Performance and Scalability
Resource Partitioning: Use Oxide's silo feature to isolate resources per product and environment, ensuring strict tenancy and resource guarantees.
Dynamic Resource Allocation: Leverage Oxide's custom hypervisor and software stack to dynamically allocate CPU and memory resources based on workload demand, allowing burst capacity.
Storage Allocation: Allocate NVMe storage proportionally to VM count and workload I/O needs, ensuring high throughput and low latency.
Network Configuration: Utilize the 12.8 Tbit/s switching capacity to segregate traffic per product and environment, minimizing contention and maximizing throughput.
Power Management: Use Oxide's power management capabilities to optimize power draw per sled, allowing the rack to operate efficiently under varying loads.
Future-Proofing: Plan for DDR5 upgrades and AMD Turin processors to increase performance and capacity as Oxide releases new hardware.
Final Notes
The maximum VMs per environment per product are constrained primarily by CPU cores.
Memory and storage are sufficient to support these VM counts with room for growth.
Oxide's rackscale design integrates hardware and software tightly, enabling rapid deployment and management.
For global growth, consider deploying multiple racks or hybrid cloud extensions as demand exceeds single rack capacity.
This design ensures each product (CNC, NA, Max) has dedicated, scalable environments (dev, test, UAT, prod) with sufficient resources to grow their customer base globally while maintaining high performance and operational efficiency.
References: Oxide rack specs and VM resource calculations based on provided PDF and code analysis[1][2][3].
Sources [1] Oxide-Rack-Specifications-20250217.pdf https://ppl-ai-file-upload.s3.amazonaws.com/web/direct-files/attachments/49592179/4b42cce1-9c77-4bfb-8353-f732afc9748b/Oxide-Rack-Specifications-20250217.pdf [2] Oxide reimagines the DC rack as... a 2500-lb blade server? https://www.theregister.com/2024/02/16/oxide_3000lb_blade_server/ [3] Investing in Oxide: Unlocking Cloud Benefits for On-prem Data ... https://www.intelcapital.com/investing-in-oxide-unlocking-cloud-benefits-for-on-prem-data-centers/ [4] Key Concepts / Guides / Oxide https://docs.oxide.computer/guides/key-entities-and-concepts [5] Row-Scale On-Premises Cloud Infrastructure from Oxide Computer https://futurumgroup.com/insights/row-scale-on-premises-cloud-infrastructure-from-oxide-computer/ [6] Introduction / Guides / Oxide https://docs.oxide.computer/guides/introduction [7] Oxide on-prem cloud computer reinvents the server rack https://blocksandfiles.com/2023/10/31/oxide-on-prem-cloud-computer/ [8] Startup Oxide launches on-prem cloud computing rack system - DCD https://www.datacenterdynamics.com/en/news/startup-oxide-launches-on-prem-cloud-computing-rack-system/ [9] Oxide Computer Company https://oxide.computer [10] Specifications - Oxide Computer https://oxide.computer/product/specifications [11] Oxide reimagines the DC rack as... a 3000 lb blade server? - Reddit https://www.reddit.com/r/hardware/comments/1au7ckp/oxide_reimagines_the_dc_rack_as_a_3000_lb_blade/
Other resources & links
Connect: Join Univrs.io
Last updated