inf1.24xlarge in the Machine Learning ASIC Instances family on AWS.
| Metric | Value |
|---|---|
| Cloud Provider | AWS |
| Instance Family | Machine Learning ASIC Instances |
| Instance Type | inf1.24xlarge |
| vCPUs | 96 |
| Processor | Intel Xeon Platinum 8275CL (Cascade Lake) |
| Processor Architecture | 64-bit |
| Memory | 192 GB |
| Current Generation | Yes |
| Starting Price | $4.721 / hour |
| Metric | Value |
|---|---|
| GPU Count | 16 |
| Metric | Value |
|---|---|
| Max Dedicated EBS Throughput | 14000 Mbps |
| Dedicated EBS Throughput | 14000 Mbps |
| EC2 Classic Networking Support | No |
| EC2 Enhanced Networking Supported | No |
| Networking Throughput | 100000 Mbps |
| Storage Type | EBS Only |
| VPC Networking Supported | Yes |
| Metric | Value |
|---|---|
| Intel AVX2 Available | No |
| Intel AVX Available | No |
| Intel Turbo Available | No |
| Location Count | 24 |
| On-Demand Supported | Yes |
| Bare Metal | No |
| Region | Purchase Option | Operating System | Tenancy | EC2 Capacity Status | Hourly Price | Monthly Price |
|---|---|---|---|---|---|---|
| Africa (Cape Town) (af-south-1) | On-Demand | Linux | Shared | Used | $6.249 | - |
| Africa (Cape Town) (af-south-1) | On-Demand | Linux | Dedicated | Used | $6.624 | - |
| Asia Pacific (Hong Kong) (ap-east-1) | On-Demand | Linux | Shared | Used | $7.274 | - |
| Asia Pacific (Hong Kong) (ap-east-1) | On-Demand | Linux | Dedicated | Used | $7.711 | - |
| Asia Pacific (Mumbai) (ap-south-1) | On-Demand | Linux | Shared | Used | $4.965 | - |
| Asia Pacific (Mumbai) (ap-south-1) | On-Demand | Linux | Dedicated | Used | $5.263 | - |
| Asia Pacific (Seoul) (ap-northeast-2) | On-Demand | Linux | Shared | Used | $5.812 | - |
| Asia Pacific (Seoul) (ap-northeast-2) | On-Demand | Linux | Dedicated | Used | $6.161 | - |
| Asia Pacific (Singapore) (ap-southeast-1) | On-Demand | Linux | Shared | Used | $6.376 | - |
| Asia Pacific (Singapore) (ap-southeast-1) | On-Demand | Linux | Dedicated | Used | $6.759 | - |
| Asia Pacific (Sydney) (ap-southeast-2) | On-Demand | Linux | Shared | Used | $5.902 | - |
| Asia Pacific (Sydney) (ap-southeast-2) | On-Demand | Linux | Dedicated | Used | $6.256 | - |
| Asia Pacific (Tokyo) (ap-northeast-1) | On-Demand | Linux | Shared | Used | $6.376 | - |
| Asia Pacific (Tokyo) (ap-northeast-1) | On-Demand | Linux | Dedicated | Used | $6.759 | - |
| AWS GovCloud (US-East) (us-gov-east-1) | On-Demand | Linux | Shared | Used | $5.953 | - |
| AWS GovCloud (US-East) (us-gov-east-1) | On-Demand | Linux | Dedicated | Used | $6.31 | - |
| AWS GovCloud (US-West) (us-gov-west-1) | On-Demand | Linux | Shared | Used | $5.953 | - |
| AWS GovCloud (US-West) (us-gov-west-1) | On-Demand | Linux | Dedicated | Used | $6.31 | - |
| Canada (Central) (ca-central-1) | On-Demand | Linux | Shared | Used | $5.26 | - |
| Canada (Central) (ca-central-1) | On-Demand | Linux | Dedicated | Used | $5.576 | - |
| China (Beijing) (cn-north-1) | On-Demand | Linux | Shared | Used | - | - |
| China (Beijing) (cn-north-1) | On-Demand | Linux | Dedicated | Used | - | - |
| China (Ningxia) (cn-northwest-1) | On-Demand | Linux | Shared | Used | - | - |
| China (Ningxia) (cn-northwest-1) | On-Demand | Linux | Dedicated | Used | - | - |
| Europe (Frankfurt) (eu-central-1) | On-Demand | Linux | Shared | Used | $5.902 | - |
| Europe (Frankfurt) (eu-central-1) | On-Demand | Linux | Dedicated | Used | $6.256 | - |
| Europe (Ireland) (eu-west-1) | On-Demand | Linux | Shared | Used | $5.26 | - |
| Europe (Ireland) (eu-west-1) | On-Demand | Linux | Dedicated | Used | $5.576 | - |
| Europe (London) (eu-west-2) | On-Demand | Linux | Shared | Used | $5.53 | - |
| Europe (London) (eu-west-2) | On-Demand | Linux | Dedicated | Used | $5.861 | - |
| Europe (Milan) (eu-south-1) | On-Demand | Linux | Shared | Used | $5.53 | - |
| Europe (Milan) (eu-south-1) | On-Demand | Linux | Dedicated | Used | $5.889 | - |
| Europe (Paris) (eu-west-3) | On-Demand | Linux | Shared | Used | $5.517 | - |
| Europe (Paris) (eu-west-3) | On-Demand | Linux | Dedicated | Used | $5.848 | - |
| Europe (Stockholm) (eu-north-1) | On-Demand | Linux | Shared | Used | $5.016 | - |
| Europe (Stockholm) (eu-north-1) | On-Demand | Linux | Dedicated | Used | $5.317 | - |
| Middle East (Bahrain) (me-south-1) | On-Demand | Linux | Shared | Used | $5.786 | - |
| Middle East (Bahrain) (me-south-1) | On-Demand | Linux | Dedicated | Used | $6.162 | - |
| South America (São Paulo) (sa-east-1) | On-Demand | Linux | Shared | Used | $7.8 | - |
| South America (São Paulo) (sa-east-1) | On-Demand | Linux | Dedicated | Used | $8.268 | - |
| US East (N. Virginia) (us-east-1) | On-Demand | Linux | Shared | Used | $4.721 | - |
| US East (N. Virginia) (us-east-1) | On-Demand | Linux | Dedicated | Used | $5.005 | - |
| US East (Ohio) (us-east-2) | On-Demand | Linux | Shared | Used | $4.721 | - |
| US East (Ohio) (us-east-2) | On-Demand | Linux | Dedicated | Used | $5.005 | - |
| US West (N. California) (us-west-1) | On-Demand | Linux | Shared | Used | $5.671 | - |
| US West (N. California) (us-west-1) | On-Demand | Linux | Dedicated | Used | $6.011 | - |
| US West (Oregon) (us-west-2) | On-Demand | Linux | Shared | Used | $4.721 | - |
| US West (Oregon) (us-west-2) | On-Demand | Linux | Dedicated | Used | $5.005 | - |