Machine Learning ASIC Instances Instance Types

Reset

Instance Type	Cloud Provider	Instance Family	Starting Price	vCPU ↓	Memory	Processor	CPU Clock Speed	Locations	Current Generation	Architecture	GPU Name	GPU Count	GPU Memory	Total Storage	Storage Count	Storage Type	Networking Throughput	Free Egress Transfer	On-Demand	Spot	Bare Metal	Processor Architecture	Max EBS Throughput	Dedicated EBS Throughput	EC2 Classic Networking	EC2 Enhanced Networking	Intel AVX2	Intel AVX	Intel Turbo	VPC Networking
inf2.48xlarge	AWS	Machine Learning ASIC Instances	$12.9813 / hour	192	768 GB	AMD EPYC 7R13 Processor	2.95 GHz	13	Yes	-	-	12	384 GB	-	-	EBS Only	100000 Mbps	-	Yes	-	No	64-bit	60000 Mbps	60000 Mbps	No	Yes	No	No	No	Yes
trn1.32xlarge	AWS	Machine Learning ASIC Instances	$21.5 / hour	128	512 GB	Intel Xeon Scalable (Icelake)	3.5 GHz	3	Yes	-	-	16	512 GB	7600 GB	4	SSD	800000 Mbps	-	Yes	-	No	64-bit	80000 Mbps	80000 Mbps	No	Yes	Yes	Yes	Yes	Yes
trn1n.32xlarge	AWS	Machine Learning ASIC Instances	$24.78 / hour	128	512 GB	Intel Xeon Scalable (Icelake)	3.5 GHz	3	Yes	-	-	16	512 GB	7600 GB	4	SSD	1600000 Mbps	-	Yes	-	No	64-bit	80000 Mbps	80000 Mbps	No	Yes	Yes	Yes	Yes	Yes
dl1.24xlarge	AWS	Machine Learning ASIC Instances	$13.109 / hour	96	768 GB	Intel Xeon Platinum 8275L	3 GHz	2	Yes	-	-	-	-	4000 GB	4	NVMe SSD	400000 Mbps	-	Yes	-	No	64-bit	19000 Mbps	19000 Mbps	No	No	Yes	Yes	Yes	Yes
dl2q.24xlarge	AWS	Machine Learning ASIC Instances	$8.9194 / hour	96	768 GB	Intel Xeon Platinum 8259 (Cascade Lake)	2.5 GHz	2	Yes	-	-	8	128 GB	-	-	EBS Only	100000 Mbps	-	Yes	-	No	64-bit	19000 Mbps	19000 Mbps	No	Yes	Yes	Yes	Yes	Yes
inf1.24xlarge	AWS	Machine Learning ASIC Instances	$4.721 / hour	96	192 GB	Intel Xeon Platinum 8275CL (Cascade Lake)	-	24	Yes	-	-	16	-	-	-	EBS Only	100000 Mbps	-	Yes	-	No	64-bit	14000 Mbps	14000 Mbps	No	No	No	No	No	Yes
inf2.24xlarge	AWS	Machine Learning ASIC Instances	$6.4906 / hour	96	384 GB	AMD EPYC 7R13 Processor	2.95 GHz	13	Yes	-	-	6	192 GB	-	-	EBS Only	50000 Mbps	-	Yes	-	No	64-bit	30000 Mbps	30000 Mbps	No	Yes	No	No	No	Yes
inf2.8xlarge	AWS	Machine Learning ASIC Instances	$1.9679 / hour	32	128 GB	AMD EPYC 7R13 Processor	2.95 GHz	13	Yes	-	-	1	32 GB	-	-	EBS Only	25000 Mbps	-	Yes	-	No	64-bit	10000 Mbps	10000 Mbps	No	Yes	No	No	No	Yes
inf1.6xlarge	AWS	Machine Learning ASIC Instances	$1.18 / hour	24	48 GB	Intel Xeon Platinum 8275CL (Cascade Lake)	-	23	Yes	-	-	4	-	-	-	EBS Only	25000 Mbps	-	Yes	-	No	64-bit	3500 Mbps	3500 Mbps	No	No	No	No	No	Yes
inf1.2xlarge	AWS	Machine Learning ASIC Instances	$0.362 / hour	8	16 GB	Intel Xeon Platinum 8275CL (Cascade Lake)	-	23	Yes	-	-	1	-	-	-	EBS Only	25000 Mbps	-	Yes	-	No	64-bit	875 Mbps	875 Mbps	No	No	No	No	No	Yes
trn1.2xlarge	AWS	Machine Learning ASIC Instances	$1.3438 / hour	8	32 GB	Intel Xeon Scalable (Icelake)	3.5 GHz	3	Yes	-	-	1	32 GB	475 GB	1	SSD	12500 Mbps	-	Yes	-	No	64-bit	5000 Mbps	20000 Mbps	No	Yes	Yes	Yes	Yes	Yes
inf1.xlarge	AWS	Machine Learning ASIC Instances	$0.228 / hour	4	8 GB	Intel Xeon Platinum 8275CL (Cascade Lake)	-	24	Yes	-	-	1	-	-	-	EBS Only	25000 Mbps	-	Yes	-	No	64-bit	875 Mbps	875 Mbps	No	No	No	No	No	Yes
inf2.xlarge	AWS	Machine Learning ASIC Instances	$0.7582 / hour	4	16 GB	AMD EPYC 7R13 Processor	2.95 GHz	14	Yes	-	-	1	32 GB	-	-	EBS Only	15000 Mbps	-	Yes	-	No	64-bit	1250 Mbps	10000 Mbps	No	Yes	No	No	No	Yes