MarkGoveL+ Advanced+Compu)ng+ › research › reviews › 2010 › presentations ›...

9
Advanced Compu)ng Mark GoveL

Transcript of MarkGoveL+ Advanced+Compu)ng+ › research › reviews › 2010 › presentations ›...

  • Advanced  Compu)ng  

    Mark  GoveL  

  • GFDL    R&D  

    NOAA  HPC  Resources  and  where  Boulder  fits  

      System  supports  OAR  science  acIviIes    Tolerates  lower  reliability    Berer  price-‐performance  

      Proving  ground  for  new  technologies    Computer  systems    Mass  Storage    Networking    File  systems  

    March  9-‐12,  2010  NOAA  Earth  System  Research  Laboratory  Review  -‐  Boulder,  Colorado   Page  79  

     System  Size  /  Capacity  

    REL  I  AB  I  L  I  TY  

    Research

    Operations

    NSF  TACC    

    DOE  Oak  Ridge    

    NCEP    R&D  

    ESRL    R&D  

    NCEP  Operations  

  •   1992:  Purchased  NOAA’s  first  Massively  Parallel  Processor  (MPP)  super-‐computer    Low-‐cost  alternaIve  to  expensive  vector  machines  

      2000:  First  NOAA  Linux  cluster    Used  Commercial  Off-‐The-‐Shelf  technology  (COTS)  

      8th  fastest  computer    (2002:  TOP500  list)    2008:  Began  exploring  the  use  of  Graphics  Processing  Units    (GPUs)  

    March  9-‐12,  2010  NOAA  Earth  System  Research  Laboratory  Review  -‐  Boulder,  Colorado   Page  80  

    Linux Cluster (2000)

    MPP System (1992)

    Computer  Systems  Cost  effecIve,  cutng-‐edge,  innovaIve  

  • PetaFlop  Compu)ng    Required  for  global  cloud  resolving  scales  (3-‐4km)  

      Large  CPU  systems  (~200  thousand  cores)  are  unrealisIc  for  operaIonal  weather  forecasIng    Power,  cooling,  reliability,  cost  

      CPU  chip  performance  flat   GPUs  appear  to  be  the  future  of  HPC  

    March  9-‐12,  2010  NOAA  Earth  System  Research  Laboratory  Review  -‐  Boulder,  Colorado   Page  81  

    GPU:  2008  933Gflops  150W  

    CPU:2008  ~45  Gflops  160W  

      8x increase in double precision   2x increase in memory bandwidth   Error correcting memory

    Tesla (2008) Fermi (2010)

  • Sotware  Development  from  Vector  to  MPPs  (1990s)  

      Developed  the  Scalable  Modeling  System  (SMS)    DirecIve-‐based  code  parallelizaIon    Handle  inter-‐process  communicaIons,  I/O  

      Distributed  memory  paradigm  

      Demonstrated  good  performance  and  portability  

    March  9-‐12,  2010  NOAA  Earth  System  Research  Laboratory  Review  -‐  Boulder,  Colorado   Page  82  

    Intel Paragon (1992) Cost: $1M

    Cray XMP Cost: $20-40M

    CPU#1 CPU#2

    File System

    Inter-process communications

    I / O

      Demonstrated  MPPs  were  a  cost-‐effective  technology    Led  to  NCEP  moving  away  from  expensive  vector  machines  

    Outcomes

  • Sotware  Development  from  MPPs  to  Linux  Clusters  (2000s)  

      Worked  with  vendors  to  develop  soXware  infrastructure    Node  management,  file  systems,  batch  systems  

    March  9-‐12,  2010  NOAA  Earth  System  Research  Laboratory  Review  -‐  Boulder,  Colorado   Page  83  

    IBM Cluster (2008) Vendor Solution

    Linux Cluster (2008)

    Outcomes    Demonstrated  Linux  clusters  could  be  assembled  and  

    managed  at  a  huge  cost  savings    enables  more  science  at  Boulder  facility    HRRR  using  900  CPUs  for  hourly  cycled  runs  

      Many  large  research  systems  are  now  Linux  clusters  

    TACC Ranger (2008) Linux Cluster 62,976 CPU cores 579 TFlops peak

    COTS Solution 2-5 times cheaper

  • Sotware  Development  from  CPUs  to  GPUs  (2010s)  

      Purchased  16  node  GPU  system  in  2008    Developed  Fortran  to  CUDA  compiler  

      Commercial  compilers  now  available  

      Parallelized  all  of  NIM  dynamics    Runs  34  Imes  faster  on  a  GPU  than  CPU  

      Single  GPU,    CommunicaIons  only  for  I/O  

    March  9-‐12,  2010  NOAA  Earth  System  Research  Laboratory  Review  -‐  Boulder,  Colorado   Page  84  

    Outcomes    Public  release  of  Fortran-‐GPU  compiler  

      Noted  on  NVIDIA  site,  technical  papers    Downloads  worldwide  

    Current  Efforts    Run  NIM  dynamics  on  multiple  GPU  nodes    Parallelize  FIM,  HYCOM,  GFS  physics  for  GPU  

    CPU#1 CPU#2

    GPU to GPU communications

    SMS  

    CPU#1

    Input Output

    Single GPU communications

    GPU#1 GPU#2

    GPU#1

  • ENSEMBLES  

    Models  &  Ensembles    Sotware  Investment  

      Models  are  becoming  increasingly  complex    Increasing  emphasis  on  sharing  models,  components  

      Portability  &  performance  important  to  NOAA    2008  GSD  port  of  FIM  to  TACC  took  3  days  (HFIP)  

      Interoperability    Global  Interoperability  Program  (GIP)  

    March  9-‐12,  2010  NOAA  Earth  System  Research  Laboratory  Review  -‐  Boulder,  Colorado   Page  85  

    Portability   Performance  

    Interoperability  

    NSF  TACC    

    DOE  Oak  Ridge    

    NCEP    R&D  

    GFDL    R&D  

    NIM  

    Boulder    R&D  

    NCEP  Operations  

    FIM  

    GFS  

    WRF  

    NOAA systems

    Models

    HYCOM  

    chemistry

    dynamics

    physics

  • Final  Thoughts  

     GSD  plays  a  vital  role  for  NOAA  in  Advanced  CompuIng    Support  OAR  science  with  low-‐cost,  high-‐performance,  cutng-‐edge  systems  

      ConInue  to  provide  leadership  in  HPC      Exploring  new  hardware  technologies    Developing  support  tools  

      Enhancing  model  portability,  performance  and  interoperability  

      These  acIviIes  conInue  to  be  very  beneficial  for  NOAA  and  the  wider  community  

    March  9-‐12,  2010  NOAA  Earth  System  Research  Laboratory  Review  -‐  Boulder,  Colorado   Page  86  


Io T EDG E COMPU TI NG R E QU IREM ENT S - GSMA...Io T EDG E COMPU TI NG R E QU IREM ENT S JULY 2019. PAGE 2 IoT EGE CMPUTIG REUIREMENT S Introduction The edge offers a multitude of

Io T EDG E COMPU TI NG R E QU IREM ENT S - GSMA...Io T EDG E COMPU TI NG R E QU IREM ENT S JULY 2019. PAGE 2 IoT EGE CMPUTIG REUIREMENT S Introduction The edge offers a multitude of

Il Cognitive Computing per gli Atenei · 2017-02-24 · Compu,ng alla trasformazione dei processi degli Atenei italiani. Il nostro obievo è quello di creare un “Cogni,ve Compu,ng

Il Cognitive Computing per gli Atenei · 2017-02-24 · Compu,ng alla trasformazione dei processi degli Atenei italiani. Il nostro obievo è quello di creare un “Cogni,ve Compu,ng

Applicaon Development for Mobile and Ubiquitous Compu(ngts2/admuc/seminar1516/first/group02.pdf · and Ubiquitous Compu(ng First Presentaon: PaYourShare Group No.2 Team: EVRARD &

Applicaon Development for Mobile and Ubiquitous Compu(ngts2/admuc/seminar1516/first/group02.pdf · and Ubiquitous Compu(ng First Presentaon: PaYourShare Group No.2 Team: EVRARD &

Introduc)on to the Environmental Compu)ng Workshop @ ISGC 2016€¦ · 6 Possible Solu)on – Environmental Compu)ng n Combine meteorology, hydrology, hydraulics through computer

Introduc)on to the Environmental Compu)ng Workshop @ ISGC 2016€¦ · 6 Possible Solu)on – Environmental Compu)ng n Combine meteorology, hydrology, hydraulics through computer

Evaluang)Green)Compu&ng)Techniques) with)Dense,)Long

Evaluang)Green)Compu&ng)Techniques) with)Dense,)Long

Compu&ng)Electricity)Consump&on)Profiles) …webdocs.cs.ualberta.ca/~oardakan/files/EnDM-Presentation.pdf · 2017. 7. 5. · Compu&ng)Electricity)Consump&on)Profiles) from)Household)SmartMeter)Data

Compu&ng)Electricity)Consump&on)Profiles) …webdocs.cs.ualberta.ca/~oardakan/files/EnDM-Presentation.pdf · 2017. 7. 5. · Compu&ng)Electricity)Consump&on)Profiles) from)Household)SmartMeter)Data

Compu&ng)Approximate)b2Matchings)in)Large)Graphs)) and)an ...sc14.supercomputing.org/sites/.../src_poster/poster... · Compu&ng)Approximate)b2Matchings)in)Large)Graphs)) and)an)Applica&on)to)kAnonymity)

Compu&ng)Approximate)b2Matchings)in)Large)Graphs)) and)an ...sc14.supercomputing.org/sites/.../src_poster/poster... · Compu&ng)Approximate)b2Matchings)in)Large)Graphs)) and)an)Applica&on)to)kAnonymity)

Reduc on of compu ng me for seismic applica ons based on the ...

Reduc on of compu ng me for seismic applica ons based on the ...

Welcome to “Solving Problems with Computers I” · Compu>ng Devices Compute (v) To make sense of ; to or reckon calculate • What was the first compu>ng tool ever? 9/28/17 Matni,

Welcome to “Solving Problems with Computers I” · Compu>ng Devices Compute (v) To make sense of ; to or reckon calculate • What was the first compu>ng tool ever? 9/28/17 Matni,

Teach A level Compu/ng: Algorithms and Data …...Week 3: Sor*ng and Searching 14/03/2017 1 Teach A level Compu/ng: Algorithms and Data Structures Eliot Williams @MrEliotWilliams Course

Teach A level Compu/ng: Algorithms and Data …...Week 3: Sor*ng and Searching 14/03/2017 1 Teach A level Compu/ng: Algorithms and Data Structures Eliot Williams @MrEliotWilliams Course

Compu&ng the size of the atomic nucleus calcium-48nuclei.mps.ohio-state.edu/content/highlights/NPhys... · Compu&ng the size of the atomic nucleus calcium-48 Cap,on: Image connects

Compu&ng the size of the atomic nucleus calcium-48nuclei.mps.ohio-state.edu/content/highlights/NPhys... · Compu&ng the size of the atomic nucleus calcium-48 Cap,on: Image connects

Distributed Compu/ng Primer

Distributed Compu/ng Primer

Wearable)Compu=ng)cpoellab/teaching/cse40816_fall11/Lecture8.pdf · Whatis)Wearable)Compu=ng?) Seven)aributes)of)wearable)compu=ng)[Steve)Mann,)1998]:)) 1. Unmonopolizing)of)the)user’s)aen=on.)User)can)aend)to)other)events.)

Wearable)Compu=ng)cpoellab/teaching/cse40816_fall11/Lecture8.pdf · Whatis)Wearable)Compu=ng?) Seven)aributes)of)wearable)compu=ng)[Steve)Mann,)1998]:)) 1. Unmonopolizing)of)the)user’s)aen=on.)User)can)aend)to)other)events.)

Context Based Compu ng - mfg.fhstp.ac.atmfg.fhstp.ac.at/cms/wp-content/uploads/2013/06/MDC2013_Schmie… · Context Based Compu ng Prof. Dr. Grischa Schmiedl DI Kers n Blumenstein

Context Based Compu ng - mfg.fhstp.ac.atmfg.fhstp.ac.at/cms/wp-content/uploads/2013/06/MDC2013_Schmie… · Context Based Compu ng Prof. Dr. Grischa Schmiedl DI Kers n Blumenstein

CMSC$110$ Introduc/on$to$Compu/ng$

CMSC$110$ Introduc/on$to$Compu/ng$

Compu&ng)Systems)) R&DLabeic20anos/wp-content/... · Compu&ng)Systems)R&D)Lab Organized)in)three) main)research)groups: • SPECS:)Special:Purpose) Compu-ng)Systems,) Languages)and)Tools)

Compu&ng)Systems)) R&DLabeic20anos/wp-content/... · Compu&ng)Systems)R&D)Lab Organized)in)three) main)research)groups: • SPECS:)Special:Purpose) Compu-ng)Systems,) Languages)and)Tools)

Compu&ng)Minimalism)sandiway/mpp/cuny2012.pdf · 2012. 3. 15. · Compu&ng)Minimalism) Sandiway)Fong) Departments)of)Linguis&cs)and)Computer)Science) University)of)Arizona 25th)Annual)CUNY)Conference)on)Human)Sentence)Processing

Compu&ng)Minimalism)sandiway/mpp/cuny2012.pdf · 2012. 3. 15. · Compu&ng)Minimalism) Sandiway)Fong) Departments)of)Linguis&cs)and)Computer)Science) University)of)Arizona 25th)Annual)CUNY)Conference)on)Human)Sentence)Processing

CompungEfficiency)) andSoware ) - IEEE Computer …Examiner)for)APMG)Cloud)Compu&ng)Founda&on) Cerficaon) adsfadsfa’ Efficient)Assembly) EfficientEcosystem) Efficiency’Defined’and’Redefined’

CompungEfficiency)) andSoware ) - IEEE Computer …Examiner)for)APMG)Cloud)Compu&ng)Founda&on) Cerficaon) adsfadsfa’ Efficient)Assembly) EfficientEcosystem) Efficiency’Defined’and’Redefined’

1 Cloud&Compu)ng&and&the&SmartGrid:& … · TheCloudisComing!& • Cloud&compu)ng&permits&“consolidaon”& – 10x&or&be\er&reduc)ons&in&costof&operaon&& – Far&be\er&equipmentu)lizaon&and&management&

1 Cloud&Compu)ng&and&the&SmartGrid:& … · TheCloudisComing!& • Cloud&compu)ng&permits&“consolidaon”& – 10x&or&be\er&reduc)ons&in&costof&operaon&& – Far&be\er&equipmentu)lizaon&and&management&

COMPU SHOW - cdb.s3.amazonaws.comcdb.s3.amazonaws.com/ItemRelatedFiles/11757/compu-show-cut-s… · the Compu Show software. Compu Cue Basic and Compu Cue interfaces allow for limited

COMPU SHOW - cdb.s3.amazonaws.comcdb.s3.amazonaws.com/ItemRelatedFiles/11757/compu-show-cut-s… · the Compu Show software. Compu Cue Basic and Compu Cue interfaces allow for limited