The Intel Second Technology Xeon Scalable: Cascade Lake, Now with Up To 56-Cores and Optane!

The cadence of Intel's enterprise processor portfolio is designed to help prospects who use the and supply socket and platform help for no less than three years. In consequence, we normally get two plenty of processors per socket: Sandy Bridge and Ivy Bridge, Broadwell, and Haswell. Now Cascade Lake joins Skylake. Intel's second-generation Xeon Scalable (the official title) continues to be included within the new "Platinum / Gold / Silver / Bronze" nomenclature, however gives as much as 56 cores if you need the processor equal of Wolverine , Not solely does Intel provide extra cores, it additionally gives Optane help, quicker DRAM, new configurations and higher specialization. Intel additionally stunned us with better-than-expected help for the weakening of Specter and Meltdown whereas nonetheless delivering larger general efficiency.

Processor Improvement: Rising Eyes and Limbs

Upgrading a processor portfolio is a posh downside. There are the plain enhancements an organization can goal for: extra energy, higher effectivity, decrease efficiency. Then there are the much less apparent enhancements that could be : help for brand new directions, optimized ecosystem optimizations, help for brand new applied sciences, or a brand new product alignment. The main focus is on new scalable second-generation Intel Xeon processors (Cascade Lake) that concentrate on the latter.

Cascade Lake builds on a basis of Skylake by enhancing the secondary options that usually take a again seat to a regular product announcement. The cynic within the room may recommend that the earlier era's microarchitecture is identical, no enchancment, however Intel has expanded its providing by focussing on product implementations, creating particular options for rising markets, rising safety, and including two highly effective processors to adventurers in a single bundle. Bettering the periphery of the product and the ecosystem creates a brand new era.

What does that imply in actuality? Which properties have modified? Right here is an enumeration record that we’ll talk about in additional element.

Most mid-range processors have extra cores for a similar worth
The frequency has elevated in nearly all processors
L3 has elevated in most mid-range processors
Quicker DDR4 is supported
Extra DRAM over the stack is supported
Optane DRAM is supported by nearly all Gold / Platinum SKUs
New CPU configurations optimized for particular markets
Pace ​​Choose know-how for cloud deployments
New "Cascade Lake-AP" Platinum 9200 household with as much as 56 cores and 400 W per socket
Improved attenuation of Specter and Meltdown
New AVX-512 VNNI directions for brand new workloads

Every of them has its personal historical past and reveals that constructing a processor household will need to have an vital ecosystem to achieve success. Speaking to Intel and AMD and Arm, enterprise customers are rather a lot totally different than they have been ten years in the past – they need custom-designed and optimized merchandise, not a lot the usual parts. They’re prepared to speculate extra in one thing that’s tailored for his or her market, or if they need an off-roadmap that’s distinctive to them. All firms within the house are searching for their prospects, both to offer the product they need or to construct the ecosystem they want as their very own workload adjustments.

Cascade Lake: Naming and Enhancements!

With the silicon that enterprise customers really wish to purchase, Intel retains its platinum, gold, silver and bronze designations for the second era. New to the stack is the Platinum 9200 household, which is predicated on the higher-core BGA fashions for high-density implementations in addition to numerous new suffixes and letters to determine the differentiated product.

The letters are as follows:

No letter = regular reminiscence help (1.5 TB)
M = Medium Reminiscence Help (2.zero TB)
L = Massive Reminiscence Help (four.5 TB)
Y = velocity choice fashions (see under)
N = Networking / NFV specialised
V = Digital Machine Density Worth Optimized
T = lengthy life / thermal
S = search optimized

Customers accustomed to Xeon Scalable's first-generation letters will miss one factor: F. F was Intel's letter for SKUs with an extra OmniPath material on the pack. Intel mentioned it won’t produce material processors for this new era, which can present how widespread it was.

With the brand new letter configurations, customers will discover that the spelling with out letters now helps 1.5TB of reminiscence, double the primary era. This capability contains as much as 2TB for M and four.5TB for L. These values ​​embody components geared up with Optane. Due to this fact, a "L" CPU can help three.0TB Optane plus 1.5TB DDR4 reminiscence to get four.5 TB whole. From the M / L designation, M appears to be odd at 2.zero TB, particularly for a processor with six reminiscence channels. It’s because there are a variety of motherboards available on the market which are in a "2 + 1 + 1" configuration, which refers back to the variety of DIMMs on either side of the processor. "2 + 1 + 1" means that there’s one reminiscence channel with two DIMMs on either side, one with a DIMM and one other with a DIMM. That's eight per slot, permitting 2.zero TB divided by eight 256 GB per DIMM slot. Nearly complicated.

Within the remaining letters, this info primarily refers to optimizations for every processor by way of core quantity, frequency, energy, manufacturing (for the excessive thermal components), and worth. The unusual factor right here is the "Y" Pace ​​Choose mannequin, which refers to a brand new Intel perform, which we are going to talk about under.

Total, the adjustments within the processors between the primary and second era are as follows:

Intel Xeon scalable

2nd era
Cascade Lake
AnandTech
1st gene.
Skylake-SP

April 2019
Launched
July 2017

[8200] As much as 28
[9200] As much as 56
cores
[8100] As much as 28

1 MB L2 per core
As much as 38.5 MB shared L3
cache
1 MB L2 per core
As much as 38.5 MB shared L3

As much as 48 trains
PCIe three.zero
As much as 48 trains

Six channels
Till DDR4-2933
1.5 TB Commonplace
DRAM help
Six channels
Till DDR4-2666
768 GB normal

As much as four.5 TB per processor
Optane help

AVX-512 VNNI with INT8
vector calculation
AVX-512

Variant 2, three, 3a, four,
and L1TF

Specter / Meltdown
corrections

[8200] As much as 205 W
[9200] As much as 400 W
TDP
As much as 205 W

Cascade Lake helps Optane, DDR4-2933 (with two DIMMs per channel), higher help for Specter / Meltdown, new VNNI directions and the brand new 9200 processor household. Now we're going via the precise SKUs of the processors, beginning with the brand new 9200 household.

Cascade Lake AP: Intel Xeon Platinum 9200 Household

Intel has already introduced plans to construct a brand new high-density, high-density computing platform. We reported the primary announcement in November final 12 months, which reveals that Intel put two of its giant enterprise-core silicon chips in a silicon bundle to do one thing with double cores and twice as a lot reminiscence as a system with two sockets. In keeping with Intel, this product was designed to focus completely on the high-density computing market, the place house is tight. The corporate mentioned HPC, if it had two processors earlier than, might now be 4.

the intel second generation xeon scalable cascade lake now with up to 56 cores and optane - The Intel Second Technology Xeon Scalable: Cascade Lake, Now with Up To 56-Cores and Optane!

Now Intel has a reputation for this product household: the Xeon Platinum 9200 household. Intel will provide three components, and if the corporate had beforehand said that it could provide as much as 48 cores in a single bundle, it’s going to now provide as much as 56, with the height TDP as much as 400 watts. These processors are simply BGA and are bought solely by Intel via the OEMs as fundamental Intel server ideas. OEMs can optimize the design as they see match, for instance: For instance, if in case you have 4 blades in a 2U design or swap between air and liquid cooling, the motherboard / CPU configurations are set by Intel.

Intel Xeon Platinum 9200 Household
(Cascade Lake AP)

AnandTech
cores
Base
Freq
Turbo
Freq
L3
cache
TDP
worth

Platinum 9282
56 C / 112 T
2.6 GHz
three.eight GHz
77.zero MB
400W
poor

Platinum 9242
48C / 96T
2.three GHz
three.eight GHz
71.5 MB
350 W
leg

Platinum 9222
32C / 64T
2.three GHz
three.7 GHz
71.5 MB
250 W
foot

Platinum 9221
32C / 64T
2.1 GHz
three.7 GHz
71.5 MB
250 W
kidney

Every CPU has 40 lanes of PCIe three.zero and helps 12 reminiscence channels as much as DDR4-2933. There isn’t any Optane help, as Intel believes that this sort of high-density computing is for installations which are computationally sure and non-storage-bound. There’s purpose to imagine that some installations shouldn’t have all of the slots for the reminiscence channels, or that there’s just one DIMM per channel.

Contemplating the UPI hyperlinks structure on this diagram, what Intel basically offers its prospects is one option to create a really dense equal of a four-socket system. With only a single socket, the processor behaves very similar to a poor, communications-based dual-socket system, so we see the worth of the 9200 household in dual-socket designs.

Intel doesn’t launch any official pricing for these processors as a result of they’re solely BGA and bought as OEMs to OEMs, not as particular person components. We're making an attempt to ask you for overview.

Intel Platinum 8200, Gold 6200, Gold 5100, Silver 4200 and Bronze 3200

The opposite processors within the Intel stack comply with the nomenclature and differ in core quantity (as much as 28), frequency (as much as four.zero GHz), TDP (as much as 205 W) and L3 cache (as much as 28) to 38.5 MB). The uncooked processor record is as follows:

Intel's Second Technology Scalable Xeon Household
(Cascade Lake)

cores
Base
Freq
Turbo
Freq
L3
cache
TDP
(W)
Optane
worth

Xeon Platinum 8200

8280
L
28
2.7
four.zero
38.50
205
Sure
?

8280
M
28
2.7
four.zero
38.50
205
Sure
?

8280

28
2.7
four.zero
38.50
205
Sure
$ 10009

8276
L
28
2.2
four.zero
38.50
165
Sure
?

8276
M
28
2.2
four.zero
28.50
165
Sure
?

8276

28
2.2
four.zero
38.50
165
Sure
$ 8719

8270

26
2.7
four.zero
25.75
205
Sure
$ 7405

8268

24
2.9
three.9
35.75
205
Sure
6302 $

8260
L
24
2.four
three.9
25.75
165
Sure
?

8260
M
24
2.four
three.9
25.75
165
Sure
?

8260

24
2.four
three.9
25.75
165
Sure
4702 $

8260
Y
24
2.four
three.9
35.75
165
Sure
$ 5320

8256

24
three.eight
three.9
16.50
105
Sure
$ 7007

8253
L
16
2.2
three.zero
35.75
165
Sure
?

8253
M
16
2.2
three.zero
35.75
165
Sure
?

8253

16
2.2
three.zero
35.75
165
Sure
$ 3115

Xeon Gold 6200

6262
V
24
1.9
three.6
33,00
135
Sure
$ 2900

6254

18
three.1
four.zero
24.75
200
Sure
$ 3803

6252

24
2.1
three.7
35.75
150
Sure
$ 3665

6252
N
24
2.three
three.6
35.75
150
Sure
$ 3984

6248

20
2.5
three.9
27,50
150
Sure
$ 3072

6244

eighth
three.6
four.four
24.75
150
Sure
$ 2925

6242

16
2.eight
three.9
22:00
150
Sure
$ 2529

6240
L
18
2.6
three.9
24.75
150
Sure
?

6240
M
18
2.6
three.9
24.75
150
Sure
?

6240

18
2.6
three.9
24.75
150
Sure
$ 2445

6240
Y
18
2.6
three.9
24.75
150
Sure
$ 2726

6238
L
22
2.1
three.7
30,25
140
Sure
?

6238
M
22
2.1
three.7
30,25
140
Sure
?

6238

22
2.1
three.7
30,25
140
Sure
$ 2612

6238
T
22
1.9
three.7
30,25
125
Sure
$ 2742

6234

eighth
three.three
four.zero
24.75
130
Sure
$ 2214

6230

20
2.1
three.9
27,50
125
Sure
$ 1894

6230
N
20
2.three
three.5
27,50
125
Sure
$ 2046

6230
T
20
2.1
three.9
27,50
125
Sure
1988

6226

12
2.eight
three.7
19:25
125
Sure
$ 1,776

6222
V
20
1.eight
three.6
27,50
115
Sure
$ 1,600

Xeon Gold 5200

5222

four
three.eight
three.9
16.50
105
Sure
$ 1221

5220

18
2.2
three.9
24.75
125
Sure
$ 1555

5220
T
18
2.2
three.9
24.75
105
Sure
$ 1727

5220
S
18
2.7
three.9
24.75
125
Sure
$ 2000

5218

16
2.three
three.9
22:00
125
Sure
$ 1273

5218
N
16
2.three
three.9
22:00
105
Sure
1375 US

5217

eighth
three.zero
three.7
16.50
115
Sure
$ 1522

5215
L
10
2.5
three.four
16.50
85
Sure
?

5215
M
10
2.5
three.four
16.50
85
Sure
?

5215

10
2.5
three.four
16.50
85
Sure
$ 1221

Xeon Silver 4200

4216

16
2.1
three.2
16.50
100

$ 1002

4215

eighth
2.5
three.5
16.50
85
Sure
$ 794

4214

12
2.2
three.2
16.50
85

$ 694

4214
Y
12
2.2
three.2
16.50
85

$ 768

4210

10
2.2
three.2
13.75
85

$ 501

4209
T
eighth
2.2
three.2
11.00 clock
70

$ 501

4208

eighth
2.1
three.2
11.00 clock
85

$ 417

Xeon Bronze 3200

3204

6
1.9

eight.25
85

$ 213

It might be troublesome to inform why one processor is best than the opposite. Some of the hanging examples of how Intel redesigned the stack is the Xeon Gold 6200 household, one in every of Intel's hottest worth factors.

Intel gives one of many few merchandise for a similar worth for a similar worth: both the next frequency or extra cores. In consequence, there will probably be many cases the place Intel and its prospects declare to supply "25-40% extra energy!" – this will probably be true by way of efficiency per greenback, the core efficiency of a processor with this core quantity is barely elevated by the frequency adjustment. Intel and its companions won’t cease selling that they provide higher per-dollar efficiency, although it's not all the time apparent that uncooked efficiency per clock has not modified.

Intel Optane Everlasting DC Reminiscence: Precise DRAM or RAMDisk

The one factor that may give me nightmares endlessly is (insert Echo Microphone) "The Pyramid of Optane!". That is the diagram that Intel brings out at each occasion that's about Optane. I'm dreaming of this pyramid now.

1554227543 252 the intel second generation xeon scalable cascade lake now with up to 56 cores and optane - The Intel Second Technology Xeon Scalable: Cascade Lake, Now with Up To 56-Cores and Optane!

Intel's new Optane know-how is break up into two segments, closing the hole between DRAM and reminiscence. The storage product is a competitor to 3D NAND however excessive capability, low capability storage layer utilizing NVMe. Within the reminiscence product, that is within the DDR4 kind issue and supplies a barely slower different to high-capacity DRAM. Intel's new Cascade Lake processors now help the brand new DDR4-compatible model of Optane.

1554227543 416 the intel second generation xeon scalable cascade lake now with up to 56 cores and optane - The Intel Second Technology Xeon Scalable: Cascade Lake, Now with Up To 56-Cores and Optane!

Intel supplies Optane DC Persistent Reminiscence (the official title) in two methods.

First, so as to add rather more reminiscence to the system at a slower velocity. With high-memory-compatible processors, customers can add as much as 1.5TB of DDR4 as much as three.0TB Optane DCPMM for a complete of four.5TB of reminiscence per socket. On this configuration, the DDR4 acts as a buffer / reminiscence earlier than the Optane, which hides a part of the elevated latency, however in the end signifies that bigger in-memory databases can be utilized per socket.

Second, as everlasting storage. The quantity that Intel likes to quote right here is when a system is rebooted and all knowledge from NVMe needs to be loaded into essential reminiscence. With persistent storage, the information already exists, as with a storage machine, lowering the database downtime from forty minutes to 4, considerably lowering downtime on a reboot.

1554227543 414 the intel second generation xeon scalable cascade lake now with up to 56 cores and optane - The Intel Second Technology Xeon Scalable: Cascade Lake, Now with Up To 56-Cores and Optane!

For the enterprise buyer utilizing Optane, the system is seen to the system in two other ways: storage mode or App Direct mode. In reminiscence mode, the Optane matches solely within the DDR4 reminiscence, so there’s rather more DRAM within the system. On this mode, it is extremely straightforward to see the advantages of extra reminiscence. In App Direct mode, the Optane is definitely mounted like a storage machine, however with the facility of a RAM disk. With a view to use this mode, the software program could should be redesigned to make use of this additional reminiscence as a tool.

Speaking to OEMs, they anticipate prospects who want giant database shops to purchase Optane first, because it's simpler to recoup the storage footprint. The RAM Disk App App Mode will take longer.

Intel will provide Optane with 128GB, 256GB and 512GB modules. The performance permits as much as six Optane modules per socket to be put in (even with no less than one DDR4 module). Intel has said that it’ll not publish costs for Optane presently, and in discussions with OEMs, their Optane-based options ought to be out there someday in June.

Cascade Lake: extra than simply Moore (similar)

If I have been uninteresting, I might say that the brand new super-plateau Cascade Lake processor household is actually an replace to the previous-generation Skylake Xeon Scalable processors. It's the identical core microarchitecture amongst them, with some reminiscence will increase or an adjustment of the core quantity. A cynic could level out that CPU efficiency doesn’t change per clock. If Intel solely introduced one processor to the market, I’d agree, however firm launches are extra about processor help than efficiency. With options resembling Optane and added safety, in addition to new components within the product portfolio, Cascade Lake is surpassed by "simply one other launch".

One of many huge questions will probably be whether or not Intel can compete with 28 cores at 14nm when AMD is able to roll out 64 cores at 7nm and the way the efficiency differs. One of many smartest issues Intel has executed on this competitors is to speak about quoting solely the core numbers and serving to construct a platform across the product. AMD is wise, they are going to do the identical and are making ready to launch 64 cores later this 12 months. It is going to present an attention-grabbing head-to-head battle.

For customers searching for a whole launch of Intel's Cascade Lake right this moment, the time between sampling and launch was too brief to convey something collectively. Johan and I are at the moment engaged on a number of concepts and testing Optane to offer you a whole overview as soon as it's executed. It is going to most likely take a number of weeks, however we have now thrilling content material in entrance of us. Keep tuned!

1 Comment
  1. Ryan says

    Thanks for the article. When is the ETA on the Xeon Golds? How long does it take before a consumer can purchase two chips for a build? I’ve been patiently waiting, but it’s impossible to get any info, and after months of this secretive release, it’s getting frustrating not knowing anything about when I’m going to be able to actually build my workstation. Thanks

Leave A Reply

Your email address will not be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.