slide - T2K Open Supercomputer

8HPCI>?AE8398,$&
1FGICKB;DI=L>HK7-46
8HPCI>?AE7/5:,$&
)
2
2014310
'11!#1*+(>?AE."7/5:JL<>H@D
$&."
0%
HPCI FS
y
NGV 1B/F (256Gflop/s)
256.0
128.0
BW
B/s
6G
25
SX-9 2.5B/F
(102.4Gflop/s)
B/s
.7G
64
/s
BW
GB
3.3
/s
am
4
e
r
GB
St
BW 34.8
m
/s
ea
BW
GB
Str
am
.95
s
2
/
7
tre
B
S
G
BW
.61
m
58
ea
r
/s
W
t
S
B
GB s
am
7.6 GB/
e
1
r
.0
St
BW 17
B/s
am BW
0G
.
e
r
0
1
St eam
BW
Str
m
a
e
Str
ea
Str
64.0
32.0
16.0
8.0
4.0
2.0
m
For Memory
intensive
applications
1.0
'201$&+
'201$&+
'201$&+
*4,33$-,5,-278 )2..3/$-,5,-278 (,60/$-,5,-278
y
Power7 0.52B/F(245.1Gflop/s)
FX-10 0.36B/F (236.5Gflop/s)
Sandy Bridge 0.27B/F (187.5Gflop/s)
K computer 0.5B/F(128Gflop/s)
Tesla C1060 1.3B/F (78Gflop/s)
Nehalem EX 0.47B/F (72.48Gflop/s)
Nehalem EP 0.55B/F (46.93Gflop/s)
FX-1 1.0B/F (40.32Gflop/s)
SX-8 4B/F (35.2Gflop/s)
For Computationintensive applications
0.5
8
4
2
1
0.5
0.25 0.125 0.063 0.03
Application B/F (Memory Access Intensity)
Source: 2012 report
of computational
science roadmap
0.01
WX
Za=
CJ@S
U
BGGi
IN
[Y_
U
HPCI
L9TDHbcd^g\U#OR
@JLPQiK!QFH:R
UBi
]h\f`eML"R@JUI>RE?<
A;iKV_dI#:UCR
Attainable Performance (Gflops/s)
p
y
%
HPCI FS$*(
+' !)&HPC"#%(+
 éĄåwzvĆøùýbćÂh)Å>ÇM`%ÆéĄå´.¯
Á¯Å¯½ÍĈM`%´P‡ÆžÁ¯Ò
 (úÁš˜œ‘“™Ċ‹ąÇ,jQÖ|6µÒÇÂĈ
“¡Ãáâè÷nGÇïĄÝ4g´5$Ö9¿´ĉĉĉ
 !f´ÑÇ4g#ÇcO´xÀ¶«>ąÇQÖ<
Æáâè÷nGÂ2m4gÖýÛÒ˱ÆĈæçòÆ
Y¾Á¯ÒM`%ÖBKU»Ò¹ÃÖe±Òʵĉ¼Ç½Í
ÆÈ
 øùýßñáâè÷rqĆ{éîØâÃץÜèÝæú8kÇi"ćÃU8kĆäðê
ÙÚ×ÆÏÒéĄåaSćÇÞéàØĂÆÏÒáâè÷rqÖAÆ{Íҹô&
‚_ÖB»Ò8kÇ+ƒÃ¯°oNÂ~m
 SZÇu?ÆöâêÈâÛüăôÝêþíØñýçëÆ#·½}'ÃBÒ´ĈŸ˜›”ÖāØëº
ÁôÝêþûìçêÖ1»Ò@#4Ș’›Š‘›”Š˜œ •šÅÄÎX:»Ã¹Ôĉ7­Ç–ŸÈ¼ÓÖ
»ÂÆ ÑºÁ²ÑĈ~mÅöØĂêȼÓÖT³»øùýßñáâè÷Ö¯³Æƈ·Á
,R»Ò³Â®Ò
 õâꓝ¡Ö9½Å¯(
·×ÝãüÿĄåøĄÛ®¾½¥©¤¤¢ÎHȑž›Þ×֗¡Éd"¬
 øùý³Ð=yº½Ã¯ÕÓÁ¯ÒØĂèþ´HCòĀãçß#·øùýßñáâè÷rqÇ6E
Ö0Vl
 ˜’›ÈøùýØĂåðÚĄâÖ1º)-ă‰øùýîĂë/ǧ¦ª£¨òĀãçßրV
D)*æĄ÷ÈĈæçòíØñýçëóèĀץÜèÝæú´{ÌÃ3ÕÓÒ
‹Œ‹‹…ÆpJ´IÍÐÓÁ¯Ò\Wă]*Ws†ÃºÁĈ‰,øùýî
Ăë/ăLt„øùýßñáâè÷ÇץÜèÝæúÇ[^ÎXFÆ;¸Á¯Ò
HPCI"#%(
Ž
:o=W[³7Â¥·­Äª´
  ‘‘.‡·iG¦F¾ÂÅÄYUôZ#Unˆ¸7X´®¸iG¸¯
¾¸ÈãîÏõÓìó¸>kô|TñõÝåÙã¸]$
– 
‹ 
‘‹ 
’‹ 
“‹ 
cPO&ø´ÃÆ© †JI·ÁÄO&sLÇV4­¯¾øH+Ûõ×ÇS«¯îÈï×
ÉçJIMô †ÓÞîÌǽJIßÒõÝMô †JI·¢gf&Mô‚
q„\Ǿ¯y,O&´xƒ¸M´¡°¯nˆ·Ã`½ùªÅ¹JI¦t¸
Íõòõݳ ÃøQ·:?·¤¡²¹øJIj^·~ÆÄ×õÐÙÜÈãîÏõÓìóÇS
¡¯ÓÔÚçmÀnˆ>kÇ/·d¢
cPO&·(­ÄOôLOø¤Á»v¿¸±¨Ãz³¸YUôZ#Unˆ¸7X
YUôZ#UnˆÇiG­Ä¯¾¸ †ôJIôEpôEŒ¤Á»ãíÕåô—™˜\·~
­Ä×õÐÙÜÈãîÏõÓìó¸o=W[
×õÐÙÜÈãîÏõÓìó¸%d·w«¯š—›ŠÓÔÚç¸Abô1bh
¸7X
ÓÔÚçmSäóØåõÎ|T
†ôJI·¢f&2$
  l×õÐÙÜÈãîÏõÓìó·w«¯š—›ÓÔÚç¸>kô|TñõÝåÙã
¸]$
– 
†ôJIø‚q„¶µy,O&¸f&M´xƒM·B¶ÈãîÏõÓìó¦
š—›ÓÔÚç·0h´­Ä1bôAbÇ7Â¥·«ø®¸%R¸¯¾¸ÈõÍÚÎØê¤Á»
ÛàÉÔ3e¸>kÇt¬²ø‘•.‡·ÓÔÚçÇ%R­Ä¯¾¸|TñõÝåÙã¸]
$Çd¢ù
‹  ×õÐÙÜÈãîÏõÓìó¸1bh
ö£ºø–Ž™¸èéîàóÝ-ôN^ÔïõãÙ
ÜD÷ÇKr…³%R­Ä¯¾¸ÈõÍÚÎØê¸o=W[
‘‹  "'{ôKr…ô€*!èéîÑâÓÔÚçÈõÍÚÎØê>k
’‹  ÈõÍÚÎØêø¤Á»ÛàÉÔðäﳸKr…3eÀa53e´øœžŒÈãîÏõ
Óìó¦o«²®¸<¸9"Çb´­ÄÓÔÚçÖáÜÊËÈ3e¸>k
“‹  ÌáíÉóÓæëðõÓìó¸‰u·£ø@Ÿ¶8}_¸³îÈï×ÉçÓæëðõ
ÓìóÇ%R­Ä³0h¶);¸š—›ÓÔÚ禣ļ§Abô1b¸7X
”‹  ×õÐÙÜÈãîÏõÓìó·ÁÄÓÔÚç¸m´‘•.‡¸%RÇV4­|TñõÝåÙ
ã¸]$
);¸HPCIÓÔÚç¸ Ã6¸o=W[
EpôE·¢O&2$
C¿¸±¨Ã
%
kcv…kcdƒnƒo…
XXXXXXXXXXXXXXXXXXXXXXXX)„,LD‡&
:7;:
1:P7;
"$:C
7;nƒo…
Q-I7;
Q-I7;,*
0/7;K5,*
,LDXJ4@B
#Q-'9
,LDX+#~f
%
M
A<7;K5,*
O=:CN
%ycg‚rqg'9
3
7;
{|€{…e
‡o…jqtbx€^
yqpY\UWTVlmrz
_(G][_K5‚…
uyqx_>
‡b…frgp}a
2Z`E?svcm
C_(G][_K5
‚…uyqx_>
‡96„:6H
Ra 8^Y†[_F
.bx€_(G]K5
‚…uyqx_>
bx€i…lƒ(G
kwh…x
lmrz(G
kwh…x
HPCI
!
svcmC(G
kwh…x
S
„†‚† qVx\`PJECˆ
tBd…†ƒ
€~} Qnx/‡PJECˆ
KHBd…†ƒ
xu)xvvv‡PJECˆ
_x"xvvv‡PJECˆ
x#;xxv‡?ˆ
,>x.vvvvvv‡?ˆ
>x 0vv‡?ˆ
fxTWx‡?ˆ
>x5/xv‡?ˆ
j>xxv‡?ˆ
&Viovv‡?ˆ
:*xoxv‡RS3Yˆ
rxZxvvvvv‡PJECˆ
bNxIxv‡PJECˆ
FgBd…†ƒ
L
Bd…†ƒ
Dxxvv‡!$ECˆ
'=x2xxvvv‡?ˆ
y<kxv‡qG+ˆ
uDxxxxv‡?l+ˆ
@(xOxxxv‡?ˆ
1]9mec…†ƒ
4x8avvxv‡7=sFˆ
Qpxxvxxv‡7=sFˆ
uDxAxxx‡PJECˆ
X*xJxxx‡PJECˆ
<Vx6oxv‡PJECˆ
V^xxxvv‡Fg-ˆ
%|z{xxx‡Fg-ˆ
U'Axxxvv‡Fg-ˆ
fV^xxxvv‡Fg-ˆ
XV[xxxvv‡Fg-ˆ
qMhxxxvv‡Fg-ˆ
HPCI
w
¸ÀT}Æ©«±¼zl0Æ
T}’Q?Ê^‰7
ÈÊÊ
3P=ÈO(ɒ
…C
©«±¼¬¶³¢£ T}Æ
©«±¼zl0
R9LÊ4K:ÊE5
’’
³°¸®¢Å
­Ç§°³©«±¼
¹³¼ °¸
Ǥ±¥¯½T}
Y6„ÈO(ÉÊ'dw
È4<(ɒ
´°³ÄÇ¥T}
‰)†Ê`Z2’’’’’
ÈO(ÉÊ
t6ʊ‚6Èʌ(É
«³ÂǪÆ
T}
U6]*ÈcgÆi@(ÉʐQ
?Ê!’$ÈÊÊ
/‰m
Ècgɒ
Ǥ±¥¯½T}
eaf)†Êu!-’
´°³ÄÇ¥T}
oÊeaf)†Ê
u!-!’
«³ÂǪÆ
T}
4K:Êk9"Ê
eaf)†Êu!-’
~|ƅC
²µ¡«T}¨·¦ÁǸÈÉ
²µ¡«T}
3SXÈO(ÉÊ(&2[
¨·¦ÁǸÈÉ
ÈHI(ÉÊN9GÈO(ÉÊ
d>ʈs’
#fÈOº¡¥Ã±°¥É
HPCI
˜Ê©«±¼1x—{b“œ©«±¼T
}Æ©»¾ÂÇ­~|•©«±¼Ÿ–A;
©«±¼¬¶³¢£ T}Æ©«±¼
zl0
`Z2ÈO(ÉÊv7n
ÈÊ/‰m
Ècgɒ
(.ÆgjW‹qBƒr
3R8HÈO(É
¸ÀT}Æ©«±¼z
l0ÆT}
DJy_‡Ê
h‡\+’
qBƒr
VM¿¤+
(.ÆgjW‹˜Ê©«±¼—%MT}•”—€p
ƭǧ°³ ¸À–›žŸ–A;
ŽF,˜
•™
•šA;
‘
2020
!
HPCI j£;:£8]‡Š?‚=
A‚f?ZD£<?QƒSk‡ŠV&£={s|sŠ¦
b‚SkI}UMw‹€tzy?ƒ¥p&q‚?~€Š¦
["ŒT'xyLG3({syf?ZD£<?Q‚O4u9…ˆ‹|sŠ¦
5o€’—Ÿ‡Š`*’š¡¤’ž¢‚A~Y$‚u%W}rŠ¦
n-e}‚`*’š¡¤’ž¢
jFC
:)
LGV=
Hj
/FC-‚=
mlll¤“‚Y1
;:c
nae}‚¢‘¢˜ `*’š¡¤’ž¢
–¤”
Bœ– E#8]=
R7‚=
h^i€
œ– LGIX‡Š£V&‚’“•›£,!d
.
P¡™ .+‚LGIX†~{v’“•›dF
JN¡™ g6>£Ÿ ”Ž›
¡™ K„‚_@
SktˆLG’“•›„
0‚HPCI’“•›‚r‰,‚\2JN
%/WbhZl[gj+Xel\
+[cfil[gj
2;;73
2>ABDC693
2=>:9@3
5
2>?<84879;7>3
=>:9@
OQ*Rbil`1P[cfil[gjV&GE
0
V'KU
PeYa^d
>ABDC69
0JOKU)P[cfil[gjV&H
;;7
-NMP
!N
0P[cfil[gjV&H
>?<84879;7>
MMA,
MMA2
(Micro-scale)
MMA1
(Macro-scale)
RSDGX
Seism3D
ISk,P[cfil[gjV&H
RSGDX
Parallel Process
(
Mapping
STOC-CADMAS
(STOC-ML,NS,CADMAS)
mZl]Vn.#L
Time
PHPCI[]_dPFTP("$
%Yfm[r^lpV$$,s"+t
S"+(ar\bdYfmT
;/?
$ ,sR1018t
HI@=L
8.00
INOQP3=
"ijm]Z`
"eXZn)
$
#*
1.7
33,J;
26,J;
24,*
2.14
870
2.8,F;
433,J;
8,*
GI?=CM@BE;>
1.39
86.5
1.7,J;
284,@;
12,*
CC:
5.56
1376
703,J;
16.2,F;
10,
IJE<-<:=C:I
9.31
116
42.3,J;
4.1,F;
24,*
JKD:CA-<:=C:I
9.31
19
0.6,J;
378,J;
15,*
CII@
4.00
720
175,J;
1.6,F;
6,*
<=:
4.24v4.99
2
18,J;
9,J;
4,*
@IC
4.31
0.4
21,J;
4,J;
1.4,*
2.14w9.31
39R1000
85.7,J;
832,J;
R1000
3*R1000
u!4q
Yfm[r^lp
"+V'^gkor^lp
s1000[r_t
VHPCI^_chVUWV&
¯¬§¡²«ž¢³o2Mcb
ɸÂÅÝÉÀ¹à¬>J I9K¨¬¹ÍÓâÁÚଵ0f¥å
_iL«ž¢³. ¬kVµ*
ÁÕÙÞâÁÚà¬S:MJ«°³cb¾Ãʬ (A©cb5j¬P[
1¬cbÏÛ×âŵa7¥år,á!
,µ¤¦³
cbUj¬/
;#t¬[&
r,á!
,áHI,¬
Gg-<áOºÌ¬#F
I9K­¬Ñ¸âËÎÇ»
œœœœšv‡‘‘–Ž“v‰“‘–¬#F
ã"'Ÿ±n"'Fe¬Fä
œœœœ›mX]U<¬cb
ãUpqa7¬#Fä
œœœœšvuEÅâÐà¬#F
ãÅâÐ൮³£©D?a7ä
œœœœ›vÔÝÆѸÂÇ»†‰‡¬#F
ãNå\såR¬#Fä
]U<cb
Ll<cb
œœÔ»ßª?´©«Õ»ßªFe¬a #F
…y‰
+`Y)@&1C
BW1ã™{z{‚ä
1ÅâÐàœã|z¼âÃ4#^ä
|x}}
|ƒ
…†Œ
x~
…†Œw‹ˆˆœã{z¼âÃ4#^ä
‹Š„•˜”’~—
Åâ½ÇÊ·ÒܼâÁÚà
Z×ØÜ¿¹Ä
ZѶ¹Ý$h
`=#^4j
{€}xv…
{€€v…
|zv4j
}}
}ƒzv…
}}‚vŠ…
zxv4j
~x
}zzz
€‚‚v…
|v…
€zv4j
{x€~
}}zz
‚‚zv…
|}vŒ…
|~v4j
%6¬HPCIÁÃÈÖ¬²3¬d8QT
EB>DMA8
EB>DMA
' , L ,
0000,N.N65000000NN-65
:;/$6?FHJM?IK849
1173<16(L*DMA=3<
/)&
(L*DMA
8HPCI?@CG82;8+!#
:;$%6
0000"
"
$
!
#
M M $
6@9a1
!&)"+#(*
#$%'
=BQROMSC
#BRUX[ZGMCAA
:=zPPJC
$#zLJMPJRC
x0G;_a3&
xHDIw_aFEEEgyj&
oykBLMJC
(touBORPC
touzPRROC
x4&pmfoyka%)
x/
a ."8a&
*<!BkypvC
xrulqeimfjLNM
xbd^`5a'
2-!BKLPC
xMXVX\TYANYXVW\a'
x>?-5a'
aHPCIhjnsa]ca7+,
4@&JEGQ?,wzglck
2014|
2016|
RK%
By
#!@&
2018|
2020|
,+\htW80LK;<
C!B80KC1
#!FO=80KC
(80KHMKSuZt_n?,
#!K%
Vz]UxfKTxdt]Ux^KC
>A\mqvz\rx
:&
) $"2
eza\^dn
C75KHMK80SuZt_nK?,
peuK3
Sx[xju80JNQ.(KC
)peu
C75KHMK80SuZt_nK?,
C75peuKHMK'*^Xzn{isoat`z\rxK?,
lub^Yzu
$"\mqvz\rx
peuKC75{6peuIK2
KHPCI\^dnKDPK9-/
XVTOYUNPZB0twjofn
2014
0D
&
2016
0D/9)ewlu<;
&ewluV'( qhsewluV'
7\@ZF-Y9) (7\@ZF-Y9
+[:#V
)+[
:#V.
t`fi^ucu<;WV
/
'(7\@ZF
+[
:#
2018
6vCv2qhs\
?RS&ewluV
'(7\@ZF
-Y9)+[
:#
V.
2020
'dkauU!A
Q[Sewlu<;/
ewlubdgpV
'(7\@ZF
-Y5)+[
:#
0D/v85/_dew
lu<;WV/
85
&
hcesmr]iV.
JKLV1:#*VB0
1:#*VB0
85&V1:#HV:#*V%=
85&V1:#HV=34
E85&V<;
85&IG:#*V
/34
85&5IG:#*V
/34
85&IGV
,<;*
"VHPCIbdgpVMY
V>$34
85&5IGV
,<;*
HPCI
jƒŠps‰Žjnzoxˆ{€kuGFD
R†‡Š€Ž}i#A_\hjƒŠps‰Žb]cbjnzoxˆ-E
†‡Š$?
2B/Fb{w=?
i*\h†‡Šr‚suz…
 egRUB/Fb†‡Š€Ž}
 LbP&5bRJ
4<$?
„o|‹8"2.
 /`„o|‹OiR6a8
}$?
 (i%W`YfRU$?i7
~y|o$?
 H&IiMC[^^dSIdK
u|ŒtI/O$?
R$?qjXf`hSMP}
9!K~y|o
 B1{wa>WVhR€Ž}Nu
|Œt
Qu|Œtsuz…
suz…v|lmj
Linuxi„uasuz…b$?i
Z\suz…v|lmj
 v|lmjuwyo
b03_b'$
 /X^(bt‰‚bR6@
jƒŠ
suz…
+bHPCIsuz…bTg)bG,:;
{€ku
oqv€‰zŠyiŠkvltƒ
  EC!NŒ5)
Si}…@+<^YWoqv€EC
  OdgXC9H/h"O^-4ZVfo
qv€
•  oqv€|Šl<S100PF
•  oqv€‚…<S 100 ~ 200 PB/s
•  oqv€‚…MSR3.2PB ~ 6.4PB
  'D[:%oqv€1
Node0 4TFlop/s
CPU01 TFlop/s
Node xxxx
CPU0
1 2 3
core core core core
24B/F
1 2 3
core core core core
VLSB VLSB
12B/F
Shared memory
Shared memory
Storage
 ‰M#‚…_3
  zŠyXe_‚…M128256GB
 zŠy09<4TFlop/s
  ‚…{ˆy4Ž8TB/s
  UMAiŠkvltƒ
  QKI>h4UX.GP
zŠy
J
 4CPU(16mi)^cfSMPzŠy(
  CPU`=2_QU†tmi‰~lx†}
‡run
  2.5*Œ3*7>]\ Aw{jq
>h4UX4‚…‚p„Š†?^cf
Q‚…{ˆy_3
  ,4‚p„Š†‹4‚p„Š†_4
b'D
  oqv€‰w{jqFEC
  09a_wŠs;<LBEC
$_HPCIoqv€_Te!_F&68
{|nu1c9$.#
  ~‡vyqc76e5%suz
c8!@l/Y^~‡vul=
  ECDGb76l?ZjbdDG‹
DIRQ~‡vul4V[76X<
  ~‡vuc,]XiWh-Db>
'
\XSECRQ_d30?
!X;kg^Uj
  ONP*1l(U[MNL}yp‰tX
ECDJAbdl
  FK‚ƒ…ƒt„‰†dECDGbf
  EBHK*c3dZ_bf
  ECDIbd3:ˆxXnˆw‰€‰
r‰2l
2017bd*1l(U[LSI}yp‰tXsomc-40Šbaj`c&
"cHPCIsuzcTic9$)+
GINTI (Global INTegration Initiative)
¡¢£¡o˜Œƒ dVXQYWbG—CM12˜Œƒe
p48-Nh˜Œƒ
˜Š
—œžQYWQ‰€y–“˜“&
—HDAU”ywzŠDAUƒ}>UœžQ¡G
—J o.†‡Žgt.†‡Ž>QR\^]T_]`a(!S
—M6lr$InG
—5GR[Z\gt7qlS
—
P#F3£Ÿ z{˜‹vDAUG
—O7y–…˜™€DAmG
—;@)—/0)
Bonder / Debonder
—6483Vžb¡†‡ŽoGv˜Š
—.nsu'if-:*B—Ev˜Š
—483nLij–Ž“oG
+h˜Œƒ
—Ž•„ƒFU
P#F3£Ÿ z{˜‹DA—G—Fv˜Š
—VžQ¡%<vkjx˜‚Œ’ˆxƒ…‰xcŽ•Š…yŽGc?,12
—|ƒ…‘’~–y–…˜˜€DAUGU?,12
Wafer edge trimming
Wafer thinning
patterning
Asher
SiO2 etch
Insulator CVD
Ionized sputter
Deep Si etch
21
plating
š›y–†z{‹"o6>K=9
<1/2>
~|^}y{ŠsW78TkD;h19P
 8T0]ŒD;
 Xq‚†kYP@jf
Fat~|&b/SW*B
jmoE#NWp$jd
23iNW:'p8T
 Mp&fg
t‡Z!U
%KŒuw{Œ`U
2014~2018jBKi(L:
Fat
Fat
treel
64x64€‡s‰wSW,
Fattreel
treel
Hybrid
Hybrid
NW
`?Œ+J
HybridNW
NW
node 1
(4 CPU)
 AB%Œ[B%\R
 E#, †‹s
 FTT-Hybrid*
 n-D Torus
 uw{Œ)"%\R
 E#,†‹sŽ>

 E#,†‹sŽb>

 Fat treehTorusk  Dragonfly
 _:'jmo
O
Cb/NW
 E#, †‹s
 E#,†‹s
VI8TN
10GB/s
†‹s }y{Šs8Tk,cŽ10CPUQ<
 S6ƒwjmoNW48T
 Fat tree
node
25600
4‚ˆ‹
}y{Šs
 VI8TaD
 M
~|, H, €‰q‚…‹
 wryxŒt‡Z!
 HW.-=:
 RAS=K
 Y%K
 `Œuw{
*Fat tree-Torus Hybrid
5kHPCIvwz„ken0kW7FG
J9'Gb^f:%
 Df'G
 64x64 |“sxp|{
 PW100ns
 VW100W
 I#.
 3*”SX-9•/ea\
@ XWo…Œ@I
 NW)! XW#.f'H
 ‡wJ9, NW(
 7, ƒo…‹‘
 02., S>
 @1
 p‘z“us
 V,’
;
 t“„T
 HW"
 @I
*(, RAS*@
 HybridgMO[jjml
iffYHW" *(n`
Fat treegAeBd@
 ˆ{rŠx*@ ”xp|{•
 <8O*@
”‚“€I/F•
 RAS*@
 q‘€}“q‘€fNRC
–  FECdcfKkF+Yh_gY
–  Œ‘sŽ†”‚“€’SW, SW’
SWU•fKk'”N•
…yx6-3, Q3
=n?]Fat treenE
$fHPCIvx~‰fZk#fL&45
”¦ªŒ‹’ž
O:“ªŽ|PD7‹¡¦ª‹¢¨z“ªŽxw_;©9;yN6“ªŽy!ru­
c%I=€Ivs ]”¦ªŒ‹’žvcYjgl'K€4Q
n‚›¤ˆª‹¢¨q}zL.
n”¦ªŒ‹’žzL
GjglE[-^®G=-^zihe
  G_;‚›¤ˆª‹¢¨
jglB«ŸŽ“ªŽB­kmBC¬z9g9
  Hb%®b\Z€)yrtRP
”¦ªŒ­™„¥‹’ž5&zb<z(`
  ]zF1™„¥yHpc—¨•$
  ‰¨‹’¨‹
  N6“ªŽ‚›¤ˆª‹¢¨
  Ÿ ¤
  ˆª£˜¤’ƒ®*¯*‡£„‚¨”
“ªŽ©ŸŽ“ªŽzW%S
]€Xp§ª‡“ªŽzcYjgl
  †¨•©‘ª©†¨•z+%Sd
V=>+€4
  …‡œ„¨”©¤Žª”7I
‚›¤ˆª‹¢¨zJ–›‹¢”€cYy
n”¦ªŒ5&zRPv4SŠ„‡¥
f‚›¤ªžvzURP¬
 ‚›¤zjgl0
 %IM@{~
L80©T
 a#5&
 ˆª£š¥5&
]©7I©%I©
3
RP
5&'Kz”¦¨•
"/zHPCI‹’žzo~,zU2?A
§©°½«·²žŸ›
  ›¹Ã¤È§ÁƂ—a:
  g>Ç@e
 x€+]n «·²žŸ›©¬®¢BIŒ1+
  »ÅÈ°œÆ£§©°½ÊLinux
 ¥¿±œ°œºÈ©‹l“/_rR}«·²
žŸ›iOš9FP
 BISrRNǯÈĚP†ŠŠ}
º¢²ÄJ9+]8o•32
 A‚Š5¨Á¸xK^
 A~Xw}ƒ…5¨Á¸›Æ
¦Æ¸Ä^
–  ¾¿Ã7$,›³Å®§Æ£
–  OS¨®¬jH
–  »È¨¦ªg6D]
¯ÈÄ
¯ÈÄ
QBI/_FP
›¹Ã
›¹Ã
¯ÈÄ
¯ÈÄ
 ›¹ÃrR32ÇN
  QBINšP]Œ‡™a6M
–  Fortran2008, C/C++11
–  GNU¥Æ¶Â0&D]1¦¼È²
  bC›¹Ã+]c<.Eg>
 §©°½mP
©¤¨ÀÈÂ
ÎÏÌ
9ËÐ
  SWiOFP‰”ŽW?+Ç1+4
–  BIS5d[¸ÂÃÉMPI-3ÉOpenMP
z{y„'
›¹Ã
›¹Ã
  HW+]š%ƒ‡'7qg>Œ`@e
  AmP7q’!*]¨Á¸©¤¨ÀÈÃÆ£
|ÍÑÒÓÔ|
|¸ÂÃ
(v
||||§©°½¥ÈÄ
4k
¡È´Ä
+]
!*
µÈ³žŸ›
¥Æ¶Â
–  x€Y
KšTATš…ˆŽL
  \tD]–‘Ghup)7$Œ=Vf
–  s#©²ÅȨšFP‡™­Ÿ®¢¼Æ²Ã©¬È²
–  u)Ž–™TumP
§©°½«·²žŸ›©¬®¢
";HPCI§©°½˜7g>UZ
-#
L
M
2014 2015 2016 2017 2018 2019 2020
DKC:;8
23$FK>
%#
(%#N
L*%#M
(%#O
L%#M
'
"+
&
44444444
<IA9@9HIJ
?EB:;8
!
-
,"+
%#
(%#N
L*%#M
(%#O '
L%#M "+
&
!
-
,"+
&
%#
(%#
&
"+.01/
44444
6HPCI=>@G6576)
"! '
1
(񨛭
Ä14~16nmÅ
GJ
2015~16.‡‰(]WgC(Fab)ƒjI¾
²½‡h~uJT†Yf~
Ç
rnFe6U
GJ
i=Z
Mn’€ª»•­(Tx)/¾ŸÃ­(Rx)b’
_eŸµ¹¾ÃŸºÁƒN`
3
e6U
GJ
3X„f
4T’%HTx/RxÉxŽŠÍ
i=Z ÌÏÊËÎzJTƒv|„’N`
4
P*·¸¼6U
Ä3DP*Å
2
GJ
2014.oyP*·¸¼ˆjI)kzYdŒ‘.
3DP*ÄTSVÅ6Uˆ_N`’%>
Ç
MnTx/Rxb‰LSIle
2014
~2017 6U„~‚)kT
ICTElˆ8R6U„~‚u
2014
~2017 e6U‰-/{)kT
2014
~2017
A!#ˆ6U’ICK‹6
UOcTÈTSV6U‰2u
-/wWƒ)kz?1}‘
Ÿ¼œÁ•Á¤³Ãž
GJ
=Z
i+ )kz"Œ‚wÈ·¸¼¸ ¹Ã½ˆ
@6U„~‚_N`’%>
q'0LSI¸ ¹Ã½6U„
2014
~2017 ~‚)kz?1}‘
6
²™©½±¿¢¦
^[6U
=Z
¤Ã›¦©±¿¢¡ƒ5$~€aˆ²™©½±¿¢¦
kLzT†Yf~
GJ´•™¿±¿¢¦GPU
2014
~2018 ‡)kzT
7
·¸¼°Ÿ¡¨
¶^[6U
=Z
˜¡¤¶·¸¼¸ ¹Ã½ˆ%VB\’·¸¼·Ã˜Ã 2014
q·¸¼,’3X„W
„%>È%HT†Yf~
~2018 ‹ˆ)kzT
8
¬Ãªl«¦©ÀÃ
™^[6U
=Z
q<¡•¦¥LSI%H4ÆmÂSQf
:9ET 2014
mÂSQf
ET†…!ZDŸ
ÄHW/f
»•°»¼Åˆ%HT†Yf~
~2018 ¡¨¶‹ˆ)kzT
9
¡©¾Ã Ÿ¡¨¶
(¯“•½Ÿ¡¨¶)
5 6U(2.5D%V)
10 Ÿ¡¨¶£¯©–—
”
GJ(HW) HW‰GJÈ;¯“•½Ÿ¡¨¶ˆkL
=Z(SW) &’B\~u%H4’N`
=Z
ˆ;¯“•½Ÿ¡¨
2014
~2018 ¶‹)kzT
œÁ®•»6Uu¡š ¹Ã»†…
Linuxˆ7JuœÁ®•»u¡š ¹Ã»u§Ã½ 2014
pˆETB\Â%H4’N`
~2018 Ÿ¡¨¶‹ˆ)kzT
HPCI#$%& "
st
HPCI
>KQASDPR(/7)DEHM&/
&//AP(/
  FS)LSEU
FSBGJ>KQ14136 %-
  COI?H?NOQU FSBGJ>KQ1466 %-
%->KQASDPR8
%-970%
:4T+1620%"T',CEJ=30%"
AP(/
(/
@Q>
$0.
;853<.
8HPCIDEHM82<8*!#
<rsuownjkmq^(1/3)
|JLNM=CABD;>\^/%6|
  pvlk=BAA?AAAOPNK>[0XY^GH#\JLNM=>#^/%6
 0 8yE7 8{(.* 8>f3
 JLNM#^7 8_GH#^7 8\\XRig/RVc`rsu/
yF@G
zWgpuhxjtw/aUe:f4"
'59SYd^/
JLNM
$2/@I
$2/
/
GH#
JLNM=>
4
PeakPF/proc
1TF
0.36GF
2.79
PeakPF/100,000proc
100PF
35.84PF
2.79
Node/100,000proc
25,000
11,111
2.25
200PB/s
3.4PB/s
58.6
2.0
0.09
21.1
3.2TB
0.8TB
4.00
Total
%)
4
B/F
Thread/proc
Total MemBW
JLNM
Q1&B/FW<TSeism3DRMSSG^
'59SYd^/_FS#^
W3|8<T
Q1&B/FWTTurbine]VTZbFS#
_Xeon\-^//'59
!^HPCIjkmq^Sd^4"+,
L”•˜ŽšŒ†‡Š“x"(2/3)
¡]^baNRPQWKOux"@.F¡
  ]^ba’›‡w%nq.F†‡Š“wihsf6‘™ˆ‡&{nqx"@
 A(HœYG
(Hž2=5(HOC
 ]^ba%-xG
(Hy[\-xG
(Huu#
VPPM
]^baN%O
\^_c`SZ
UPPM
B/(H W(H
TPPM
SPPM
RPPM
QPPM
30¡40MW
]^ba%- „–‰†—‰‹3
€|p
QPRTPP
RPTWPP
TPXVPP
WQXRPP
QVSWTPP
290MW
PM
VUUSVPP
‘™ˆ‡&
eXeon%-6hsFS-u<xA(H4o~qzwyŸ
FS-x64x‘™ˆ‡&(640‘™ˆ‡f›…"@3.2EFlop/s8 j!B
640›Œx†‡Š“ 1EI291MW dMJ47
e‘™ˆ‡&{olut„–‰†—‰‹3jnA(Hj9?m~jŸ
)>7wy„–‰†—‰‹tkvh˜…ƒ‡‹x”•˜‚…ˆ‡(Hj"@0z~
HWx$r”•˜jkh†‡Š“j*
+xHPCI†‡Š“xg}'xD,:;
<‘•‰™‡}„m(3/3)
PRUT>DBCE;?im1(6
  ›‹™my›ˆ–m1(6œKO&>DIAK?=WV@=PRUT>?
  m˜€u
  PRUT>?h'3
[›‹™m˜|”+\
š=!–›9HFCib^
š=z’ƒ}“Šƒ†cqd^
š=PRUThnOLMJ
$npivjkc
–›_`^
'31
:w‡—*
NRQS1(GD@E
[Kernel2\
ZZ2)B/F =0.88(}„lfe)
MemB/F =0.03(FSmVLSBŠƒ†,0)
Y=VLSBmŠƒ†,_<a,core1
Y=:w‡—*(”™‚w{€)lcgVLSB
_"
l&1
ZZX
–›ƒ†m
#mHPCI}„m]s
[Kernel8\
ZZ2)B/F =0.71(}„lfe)
MemB/F =0.08(FSmVLSBŠƒ†,0)
Y=–›Ž…x_`^
ZZZZXXeonhn—~5lrt‘•om
ZZZ=78(—~Œ–)_-
m4%./
/3FS¡²ª‘©¥™§­˜0~‰=*
{™§­¡²ª‘™§­ž²Ÿ«°³/3™§­´|
A7@'
?8)
,+7M
³wVUV]´
:#yyyOQVP
>.ONPMOQWP
\(
š¦®œ²I‘C¶VU^
VUUUU
XWS]MH
]ZS^MN
^URUUU
O^UdbpstTvP
J9¶VUURUUURUUU
VS\
YSWMH
V[SYMN
VUURUUU
OVUUdbpstTvP
§¯¬ª
uqlvqMkmrlnirslsum
efcah
/3FS™§­I‡–?!
`dg
OdmjoMdbpstTvP
OQVPM~ˆ—“W_TbŸ £ª
OQWPM+7F‘>.
MMMMMMM
xM%zG‘™§­‚Œƒ‹~–”~
±M¯²¤¨¢§1
BE…—‹~–G˜;<†‰™§­‘
xM™§­‘-‘LµCK26‚4Š‹~–”~
±MŽ‘”Ÿ £ª‘-˜CŒƒ–‘6‘‘
MMMMMMMxM™§­€„–"@'C‘‰’‘ ›²ª‚4Š‹~–”~
±M™§­˜0~‹µŽ‘”"@'€„–=˜‡–‘‘&‘4
"‘HPCIŸ £ª‘}•‘D$35
XX
gdhd`c
2012
2013
2014
[7$[[[š[[[3$[O[4$[O[5$[O[6$[O[7$[O[8$[O[9$[O[10$[O[11$[O[12$[O[1$[O[2$[O[3$
LI?f#
G'
•—˜
‡ˆ‹ˆu‰‘Œf
>(BF9
‘|%CA
UY%(B
•—˜‡ˆ‹ˆu‰‘Œf
N=,HM
(B
‘|t…‰‘w
[[=*fF9De
–™t…‰‘wfIeik
[[[_a‘|t…‰‘w
tvy†‚ŒD.f*7
[[[[–™t…‰‘wfF9CA
WZnwƒ‘sQT‡ˆ‹
WZnwƒ‘sQT‡ˆ‹
D
E
o‘~Œ…}m‹l/]a‘|
‚ŒDdtvy†=
SVXt…‰‘w
–™t…‰‘w
CAK0
@8?f(B
o‘~Œl/]arm
SVX‘|D
tvy†K0
Ž‘|„xf
jgdh
’tvy†)
CAD
"“
m‹p‘tŠ
fo‘~Œ
tvy†‚Œf>
m‹Deb^=M
rv{f#J(B
w‘qx{m‹=@+”
41”51<f!
3
CA
o‘~Œ…}m‹l/]a
tvy†‚ŒD
o‘~Œ…}m‹’:;“P
-2…}m‹l/]a
tvy†‚ŒfD
m‹p‘tŠf
o‘~Œ…}m‹
D.
tvy†
z€nv
z€nv
&fHPCItvy†f\j
D
m‹
m‹
fG'26
m‹fŽ‘|
„x’4
51<“
jgdh
gdh
QR