GPU instance Instance Types

Reset

Instance Type	Cloud Provider	Instance Family	Starting Price	vCPU ↓	Memory	Processor	CPU Clock Speed	Locations	Current Generation	Architecture	GPU Name	GPU Count	GPU Memory	Total Storage	Storage Count	Storage Type	Networking Throughput	Free Egress Transfer	On-Demand	Spot	Bare Metal	Processor Architecture	Max EBS Throughput	Dedicated EBS Throughput	EC2 Classic Networking	EC2 Enhanced Networking	Intel AVX2	Intel AVX	Intel Turbo	VPC Networking
g5.48xlarge	AWS	GPU instance	$16.288 / hour	192	768 GB	AMD EPYC 7R32	2.8 GHz	20	Yes	-	-	8	192 GB	7600 GB	2	NVMe SSD	100000 Mbps	-	Yes	-	No	64-bit	19000 Mbps	19000 Mbps	No	Yes	No	No	No	Yes
g6.48xlarge	AWS	GPU instance	$13.3504 / hour	192	768 GB	AMD EPYC 7R13 Processor	2.6 GHz	20	Yes	-	-	8	192 GB	7520 GB	8	SSD	100000 Mbps	-	Yes	-	No	64-bit	60000 Mbps	60000 Mbps	No	Yes	No	No	No	Yes
g6e.48xlarge	AWS	GPU instance	$30.1312 / hour	192	1536 GB	AMD EPYC 7R13 Processor	2.6 GHz	10	Yes	-	-	8	384 GB	7600 GB	4	NVMe SSD	400000 Mbps	-	Yes	-	No	64-bit	60000 Mbps	60000 Mbps	No	Yes	No	No	No	Yes
g7e.48xlarge	AWS	GPU instance	$33.1443 / hour	192	2048 GB	Intel Xeon Scalable (Emerald Rapids)	3.2 GHz	6	Yes	-	-	8	768 GB	15200 GB	4	SSD	1600000 Mbps	-	Yes	-	No	64-bit	100000 Mbps	100000 Mbps	No	Yes	No	No	No	Yes
p5.48xlarge	AWS	GPU instance	$55.04 / hour	192	2048 GB	AMD EPYC 7R13 Processor	2.95 GHz	15	Yes	-	-	8	640 GB	30720 GB	8	SSD	3200000 Mbps	-	Yes	-	No	64-bit	80000 Mbps	80000 Mbps	No	Yes	No	No	No	Yes
p5en.48xlarge	AWS	GPU instance	$63.296 / hour	192	2048 GB	Intel Xeon Scalable (Sapphire Rapids)	3.2 GHz	13	Yes	-	-	8	141 GB	30720 GB	8	SSD	3200000 Mbps	-	Yes	-	No	64-bit	100000 Mbps	100000 Mbps	No	Yes	No	No	No	Yes
p6-b200.48xlarge	AWS	GPU instance	$113.9328 / hour	192	2048 GB	Intel Xeon Scalable (Emerald Rapids)	3.2 GHz	4	Yes	-	-	8	1432 GB	30720 GB	8	SSD	3200000 Mbps	-	Yes	-	No	64-bit	100000 Mbps	100000 Mbps	No	Yes	No	No	No	Yes
p6-b300.48xlarge	AWS	GPU instance	$142.416 / hour	192	4096 GB	Intel Xeon Scalable (Emerald Rapids)	3.2 GHz	1	Yes	-	-	8	2144 GB	30720 GB	8	SSD	6400000 Mbps	-	Yes	-	No	64-bit	100000 Mbps	100000 Mbps	No	Yes	No	No	Yes	Yes
g5.24xlarge	AWS	GPU instance	$8.144 / hour	96	384 GB	AMD EPYC 7R32	2.8 GHz	20	Yes	-	-	4	96 GB	3800 GB	1	NVMe SSD	50000 Mbps	-	Yes	-	No	64-bit	19000 Mbps	19000 Mbps	No	Yes	No	No	No	Yes
g6.24xlarge	AWS	GPU instance	$6.6752 / hour	96	384 GB	AMD EPYC 7R13 Processor	2.6 GHz	20	Yes	-	-	4	96 GB	4 GB	1	NVMe SSD	50000 Mbps	-	Yes	-	No	64-bit	30000 Mbps	30000 Mbps	No	Yes	No	No	No	Yes
g6e.24xlarge	AWS	GPU instance	$15.0656 / hour	96	768 GB	AMD EPYC 7R13 Processor	2.6 GHz	10	Yes	-	-	4	192 GB	3800 GB	2	NVMe SSD	200000 Mbps	-	Yes	-	No	64-bit	30000 Mbps	30000 Mbps	No	Yes	No	No	No	Yes
g7e.24xlarge	AWS	GPU instance	$16.5722 / hour	96	1024 GB	Intel Xeon Scalable (Emerald Rapids)	3.2 GHz	6	Yes	-	-	4	384 GB	7600 GB	2	SSD	800000 Mbps	-	Yes	-	No	64-bit	50000 Mbps	50000 Mbps	No	Yes	No	No	No	Yes
p3dn.24xlarge	AWS	GPU instance	$31.212 / hour	96	768 GB	Intel Xeon Platinum 8175 (Skylake)	2.5 GHz	6	Yes	-	-	8	256 GB	1800 GB	2	SSD	100000 Mbps	-	Yes	-	No	64-bit	14000 Mbps	14000 Mbps	No	Yes	Yes	Yes	Yes	Yes
p4d.24xlarge	AWS	GPU instance	$21.9576 / hour	96	1152 GB	Intel Xeon Platinum 8275L	3 GHz	16	Yes	-	-	8	320 GB	8000 GB	8	-	400000 Mbps	-	Yes	-	No	64-bit	19000 Mbps	19000 Mbps	No	No	Yes	Yes	Yes	Yes
p4de.24xlarge	AWS	GPU instance	$27.4471 / hour	96	1152 GB	Intel Xeon Platinum 8275L	3 GHz	6	Yes	-	-	8	640 GB	8000 GB	8	-	400000 Mbps	-	Yes	-	No	64-bit	19000 Mbps	19000 Mbps	No	No	Yes	Yes	Yes	Yes
g3.16xlarge	AWS	GPU instance	$4.56 / hour	64	488 GB	Intel Xeon E5-2686 v4 (Broadwell)	2.3 GHz	14	Yes	-	-	4	32 GB	-	-	EBS Only	20000 Mbps	-	Yes	-	No	64-bit	14000 Mbps	14000 Mbps	No	Yes	Yes	Yes	Yes	Yes
g4ad.16xlarge	AWS	GPU instance	$3.468 / hour	64	256 GB	AMD EPYC 7R32	2.8 GHz	8	Yes	-	-	4	32 GB	2400 GB	1	NVMe SSD	25000 Mbps	-	Yes	-	No	64-bit	6000 Mbps	6000 Mbps	No	Yes	No	No	No	Yes
g4dn.16xlarge	AWS	GPU instance	$4.352 / hour	64	256 GB	Intel Xeon Family	2.5 GHz	26	Yes	-	-	1	16 GB	900 GB	1	NVMe SSD	50000 Mbps	-	Yes	-	No	64-bit	7000 Mbps	7000 Mbps	No	Yes	Yes	Yes	Yes	Yes
g5.16xlarge	AWS	GPU instance	$4.096 / hour	64	256 GB	AMD EPYC 7R32	2.8 GHz	20	Yes	-	-	1	24 GB	1900 GB	1	NVMe SSD	25000 Mbps	-	Yes	-	No	64-bit	16000 Mbps	16000 Mbps	No	Yes	No	No	No	Yes
g5g.16xlarge	AWS	GPU instance	$2.744 / hour	64	128 GB	AWS Graviton2 Processor	2.5 GHz	7	Yes	-	-	2	32 GB	-	-	EBS Only	25000 Mbps	-	Yes	-	No	64-bit	19000 Mbps	19000 Mbps	No	Yes	No	No	No	Yes
g6.16xlarge	AWS	GPU instance	$3.3968 / hour	64	256 GB	AMD EPYC 7R13 Processor	2.6 GHz	20	Yes	-	-	1	24 GB	1880 GB	2	NVMe SSD	25000 Mbps	-	Yes	-	No	64-bit	20000 Mbps	20000 Mbps	No	Yes	No	No	No	Yes
g6e.16xlarge	AWS	GPU instance	$7.5772 / hour	64	512 GB	AMD EPYC 7R13 Processor	2.6 GHz	10	Yes	-	-	1	48 GB	1900 GB	1	NVMe SSD	35000 Mbps	-	Yes	-	No	64-bit	20000 Mbps	20000 Mbps	No	Yes	No	No	No	Yes
p2.16xlarge	AWS	GPU instance	$14.4 / hour	64	732 GB	Intel Xeon E5-2686 v4 (Broadwell)	2.3 GHz	12	Yes	-	-	16	-	-	-	EBS Only	20000 Mbps	-	Yes	-	No	64-bit	10000 Mbps	10000 Mbps	No	Yes	Yes	Yes	Yes	Yes
p3.16xlarge	AWS	GPU instance	$24.48 / hour	64	488 GB	Intel Xeon E5-2686 v4 (Broadwell)	2.3 GHz	14	Yes	-	-	8	128 GB	-	-	EBS Only	25000 Mbps	-	Yes	-	No	64-bit	14000 Mbps	14000 Mbps	No	Yes	Yes	Yes	Yes	Yes
g4dn.12xlarge	AWS	GPU instance	$3.912 / hour	48	192 GB	Intel Xeon Family	2.5 GHz	26	Yes	-	-	4	64 GB	900 GB	1	NVMe SSD	50000 Mbps	-	Yes	-	No	64-bit	7000 Mbps	7000 Mbps	No	Yes	Yes	Yes	Yes	Yes
g5.12xlarge	AWS	GPU instance	$5.672 / hour	48	192 GB	AMD EPYC 7R32	2.8 GHz	20	Yes	-	-	4	96 GB	3800 GB	1	NVMe SSD	40000 Mbps	-	Yes	-	No	64-bit	16000 Mbps	16000 Mbps	No	Yes	No	No	No	Yes
g6.12xlarge	AWS	GPU instance	$4.6016 / hour	48	192 GB	AMD EPYC 7R13 Processor	2.6 GHz	20	Yes	-	-	4	96 GB	4 GB	1	NVMe SSD	40000 Mbps	-	Yes	-	No	64-bit	20000 Mbps	20000 Mbps	No	Yes	No	No	No	Yes
g6e.12xlarge	AWS	GPU instance	$10.4926 / hour	48	384 GB	AMD EPYC 7R13 Processor	2.6 GHz	10	Yes	-	-	4	192 GB	3800 GB	2	NVMe SSD	100000 Mbps	-	Yes	-	No	64-bit	20000 Mbps	20000 Mbps	No	Yes	No	No	No	Yes
g7e.12xlarge	AWS	GPU instance	$8.2861 / hour	48	512 GB	Intel Xeon Scalable (Emerald Rapids)	3.2 GHz	6	Yes	-	-	2	192 GB	3800 GB	1	SSD	400000 Mbps	-	Yes	-	No	64-bit	25000 Mbps	25000 Mbps	No	Yes	No	No	No	Yes
g2.8xlarge	AWS	GPU instance	$2.6 / hour	32	60 GB	Intel Xeon E5-2670 (Sandy Bridge)	2.6 GHz	9	No	-	-	4	-	240 GB	2	-	-	-	Yes	-	No	64-bit	1 Mbps	-	Yes	No	No	Yes	Yes	Yes
g3.8xlarge	AWS	GPU instance	$2.28 / hour	32	244 GB	Intel Xeon E5-2686 v4 (Broadwell)	2.3 GHz	14	Yes	-	-	2	16 GB	-	-	EBS Only	10000 Mbps	-	Yes	-	No	64-bit	7000 Mbps	7000 Mbps	No	Yes	Yes	Yes	Yes	Yes
g4ad.8xlarge	AWS	GPU instance	$1.734 / hour	32	128 GB	AMD EPYC 7R32	2.8 GHz	8	Yes	-	-	2	16 GB	1200 GB	1	NVMe SSD	15000 Mbps	-	Yes	-	No	64-bit	3000 Mbps	3000 Mbps	No	Yes	No	No	No	Yes
g4dn.8xlarge	AWS	GPU instance	$2.176 / hour	32	128 GB	Intel Xeon Family	2.5 GHz	26	Yes	-	-	1	16 GB	900 GB	1	NVMe SSD	50000 Mbps	-	Yes	-	No	64-bit	7000 Mbps	7000 Mbps	No	Yes	Yes	Yes	Yes	Yes
g5.8xlarge	AWS	GPU instance	$2.448 / hour	32	128 GB	AMD EPYC 7R32	2.8 GHz	21	Yes	-	-	1	24 GB	900 GB	1	NVMe SSD	25000 Mbps	-	Yes	-	No	64-bit	16000 Mbps	16000 Mbps	No	Yes	No	No	No	Yes
g5g.8xlarge	AWS	GPU instance	$1.372 / hour	32	64 GB	AWS Graviton2 Processor	2.5 GHz	7	Yes	-	-	1	16 GB	-	-	EBS Only	12000 Mbps	-	Yes	-	No	64-bit	9500 Mbps	9500 Mbps	No	Yes	No	No	No	Yes
g6.8xlarge	AWS	GPU instance	$2.0144 / hour	32	128 GB	AMD EPYC 7R13 Processor	2.6 GHz	20	Yes	-	-	1	24 GB	900 GB	2	NVMe SSD	25000 Mbps	-	Yes	-	No	64-bit	16000 Mbps	16000 Mbps	No	Yes	No	No	No	Yes
g6e.8xlarge	AWS	GPU instance	$4.5286 / hour	32	256 GB	AMD EPYC 7R13 Processor	2.6 GHz	10	Yes	-	-	1	48 GB	900 GB	1	NVMe SSD	25000 Mbps	-	Yes	-	No	64-bit	16000 Mbps	16000 Mbps	No	Yes	No	No	No	Yes
g7e.8xlarge	AWS	GPU instance	$5.2682 / hour	32	256 GB	Intel Xeon Scalable (Emerald Rapids)	3.2 GHz	6	Yes	-	-	1	96 GB	1900 GB	1	SSD	100000 Mbps	-	Yes	-	No	64-bit	16000 Mbps	16000 Mbps	No	Yes	No	No	No	Yes
gr6.8xlarge	AWS	GPU instance	$2.4464 / hour	32	256 GB	AMD EPYC 7R13 Processor	2.6 GHz	18	Yes	-	-	1	24 GB	900 GB	2	NVMe SSD	25000 Mbps	-	Yes	-	No	64-bit	16000 Mbps	16000 Mbps	No	Yes	No	No	No	Yes
p2.8xlarge	AWS	GPU instance	$7.2 / hour	32	488 GB	Intel Xeon E5-2686 v4 (Broadwell)	2.3 GHz	12	Yes	-	-	8	-	-	-	EBS Only	10000 Mbps	-	Yes	-	No	64-bit	5000 Mbps	5000 Mbps	No	Yes	Yes	Yes	Yes	Yes
p3.8xlarge	AWS	GPU instance	$12.24 / hour	32	244 GB	Intel Xeon E5-2686 v4 (Broadwell)	2.3 GHz	14	Yes	-	-	4	64 GB	-	-	EBS Only	10000 Mbps	-	Yes	-	No	64-bit	7000 Mbps	7000 Mbps	No	Yes	Yes	Yes	Yes	Yes
g3.4xlarge	AWS	GPU instance	$1.14 / hour	16	122 GB	Intel Xeon E5-2686 v4 (Broadwell)	2.3 GHz	14	Yes	-	-	1	8 GB	-	-	EBS Only	10000 Mbps	-	Yes	-	No	64-bit	3500 Mbps	3500 Mbps	No	Yes	Yes	Yes	Yes	Yes
g4ad.4xlarge	AWS	GPU instance	$0.867 / hour	16	64 GB	AMD EPYC 7R32	2.8 GHz	8	Yes	-	-	1	8 GB	600 GB	1	NVMe SSD	10000 Mbps	-	Yes	-	No	64-bit	1500 Mbps	3000 Mbps	No	Yes	No	No	No	Yes
g4dn.4xlarge	AWS	GPU instance	$1.204 / hour	16	64 GB	Intel Xeon Family	2.5 GHz	32	Yes	-	-	1	16 GB	225 GB	1	NVMe SSD	25000 Mbps	-	Yes	-	No	64-bit	3500 Mbps	3500 Mbps	No	Yes	Yes	Yes	Yes	Yes
g5.4xlarge	AWS	GPU instance	$1.624 / hour	16	64 GB	AMD EPYC 7R32	2.8 GHz	21	Yes	-	-	1	24 GB	600 GB	1	NVMe SSD	25000 Mbps	-	Yes	-	No	64-bit	8000 Mbps	8000 Mbps	No	Yes	No	No	No	Yes
g5g.4xlarge	AWS	GPU instance	$0.828 / hour	16	32 GB	AWS Graviton2 Processor	2.5 GHz	7	Yes	-	-	1	16 GB	-	-	EBS Only	10000 Mbps	-	Yes	-	No	64-bit	4750 Mbps	4750 Mbps	No	Yes	No	No	No	Yes
g6.4xlarge	AWS	GPU instance	$1.3232 / hour	16	64 GB	AMD EPYC 7R13 Processor	2.6 GHz	20	Yes	-	-	1	24 GB	600 GB	1	NVMe SSD	25000 Mbps	-	Yes	-	No	64-bit	8000 Mbps	8000 Mbps	No	Yes	No	No	No	Yes
g6e.4xlarge	AWS	GPU instance	$3.0042 / hour	16	128 GB	AMD EPYC 7R13 Processor	2.6 GHz	10	Yes	-	-	1	48 GB	600 GB	1	NVMe SSD	20000 Mbps	-	Yes	-	No	64-bit	8000 Mbps	8000 Mbps	No	Yes	No	No	No	Yes
g6f.4xlarge	AWS	GPU instance	$0.95 / hour	16	64 GB	AMD EPYC 7R13 Processor	2.6 GHz	13	Yes	-	-	-	12 GB	450 GB	1	SSD	25000 Mbps	-	Yes	-	No	64-bit	8000 Mbps	8000 Mbps	No	Yes	No	No	No	Yes
g7e.4xlarge	AWS	GPU instance	$3.9982 / hour	16	128 GB	Intel Xeon Scalable (Emerald Rapids)	3.2 GHz	6	Yes	-	-	1	96 GB	1900 GB	1	SSD	50000 Mbps	-	Yes	-	No	64-bit	8000 Mbps	8000 Mbps	No	Yes	No	No	No	Yes