Slide 1: Intel® HPC Orchestrator Webinar
Intel® HPC Orchestrator Webinar Simplifying Integration, Validation and Maintenance of Your HPC System Software Copyright© 2017, Intel Corporation. All rights reserved.
Slide 2: Legal Notices and Disclaimers
Legal Notices and Disclaimers • Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Learn more at intel.com, or from the OEM or retailer. • No computer system can be absolutely secure. • Software and workloads use
Slide 3: Logistics for questions
Logistics for questions Submitting Questions During the Webinar Step #1 Identify Submission Location Step #2 Write Your Question in Text Box Step #3 Click Button Marked “Send” Copyright© 2017, Intel Corporation. All rights reserved. 3
Slide 4: Welcome!
Welcome ! Ed De La Fuente, Intel® Tom Krueger, Intel® Nivi Muthu Srinivasan, Intel® HPC Platform Software Group, Datacenter Group HPC Platform Software Group, Datacenter Group Datacenter Eng. Solutions Group, Datacenter Group Sr. Product Manager Sr. Business Development Manager Technical Support Man
Slide 5: A Quick Poll
A Quick Poll I’m an HPC . . . . • Site Director • System Architect or System Admin • Researcher/User • Application Developer/ System SW Developer • Installation Engineer/Technician for System Vendor Copyright© 2017, Intel Corporation. All rights reserved. 5
Slide 6: Agenda
Agenda • State of HPC System Software Ecosystem • The Open Source Project: OpenHPC* • The Product: Intel® HPC Orchestrator • Similarities and Differences • How to use a pre-validated system SW stack • Q&A Copyright© 2017, Intel Corporation. All rights reserved. 6
Slide 7: HPC System Architecture
HPC System Architecture •Provisioning Head Node •Resource Management •Fabric Manager •Power Control DB •Console Access •Monitoring Sub-Master Nodes Login Nodes User LAN Access Privileged Access Lustre* Parallel File System Router Nodes Eth Compute Nodes Fabric Security Perimeter Planned Copyright© 2
Slide 8: State of System Software Efforts in HPC Ecosystem
State of System Software Efforts in HPC Ecosystem Today Into the Future Fragmented efforts A desire to get to exascale New complex workloads across the ecosystem – performance & speed up (ML1, Big Data, etc.) “Everyone building their software adoption of drive more complexity own solution.” hardware
Slide 9: Community HPC System Software Vision
Community hpc system software Vision A Shared Repository Stable HPC Platform Software that: Fuels a vibrant and efficient HPC software ecosystem Takes advantage of hardware innovation & drives revolutionary technologies Eases traditional HPC application development and testing at scale Extends to ne
Slide 10: Execution of Vision
Execution of Vision Intel® HPC Orchestrator products are the realization of the software portion of Intel® Scalable System Framework Intel® Scalable System Framework A Holistic Design Solution for All HPC Intel® HPC Orchestrator • Open Source Community under • Intel’s distribution of OpenHPC*; Intel
Slide 11: Participation in OpenHPC as of January’17
Participation in OpenHPC as of January’17 Linux Foundation Project initiated by Intel and gained wide participation quickly Official Members 30 current members The goal is to collaboratively advance the state of the software ecosystem Governing board is composed of Platinum members, representatives
Slide 12: Intel® HPC Orchestrator Framework: Project and Product
Intel® HPC Orchestrator Framework: Project and Product Vendor University GNU RRV Community Community Contributors include Vendor University Vendor RRV Intel, OEMs, ISVs, labs, Stack Stack Stack academia Linux RRV Parallel File system PRODUCT Integrates and PROJECT RRV tests HPC stacks Base Intel® HP
Slide 13: Intel® HPC Orchestrator Overview
Intel® HPC Orchestrator Overview Copyright© 2017, Intel Corporation. All rights reserved. 13
Slide 14: Intel® HPC Orchestrator Modular View
Intel® HPC Orchestrator Modular View • Multiple components available in standard installation across SW stack functions • Hierarchical structure (using Modules) for dynamic Dev environment configuration • Intra-stack APIs allow for customization/differentiation (OEMs enabling) • Defined external API
Slide 15: Intel® HPC Orchestrator Components List
INTEL® HPC ORCHESTRATOR Components List Functional Areas Components Base OS compatibility RHEL 7.2 BU7 / SLES12 SP1 / CentOS 7.2 Administrative Tools Conman, Ganglia, Intel® Cluster Checker, Lmod, Losf, Nagios, pdsh, prun Provisioning Warewulf Resource Mgmt Slurm, Munge, (PBS Pro coming soon) I/O Se
Slide 16: Intel® Parallel Studio in HPC Orchestrator
Intel® Parallel Studio in HPC Orchestrator Intel® Parallel Studio XE 2017 Cluster Edition is integrated in Intel® HPC Orchestrator • Most Top500 systems sites develop Apps, and optimize for Intel Xeon, Xeon Phi • HPC Orchestrator enables dynamic development and runtime environment configuration when
Slide 17: Optimized Performance Results that You Need
Optimized Performance Results that You Need Modeling & Simulation Artificial intelligence Life Science Finance Visualization TraininG scoring Up to Up to Up to g 5.0x 2.7x 5.2x Perf* Perf* Perf* LAMMPS Monte Carlo DP Embree And many Manufacturing, Engineering, Faster and Most 2 More Scalable 1 Widel
Slide 18: Intel® HPC Orchestrator installation highlights
Intel® HPC Orchestrator installation highlights What How Compute Node Provisioning Method Image based Installation Time (on head node) ~40-50 Minutes Provisioning Time (128 stateless nodes) ~4-5 Minutes Network Configuration Site-specific inputs (IP addresses, MAC addresses, BMC addresses, Provision
Slide 19: Setup default development environment using Lmod
Setup default development environment using Lmod • User environment modules available for various components like clustershell, scalapack etc. • Can be loaded using – • module load <module_name> • Default environment modules available for each of the compiler/MPI combinations lmod-defaults-gnu-mva
Slide 20: Intel® HPC Orchestrator adds to OpenHPC
Intel® HPC Orchestrator adds to OpenHPC OpenHPC 1.1.1 Features Intel® HPC Orchestrator 1.0 Features Supported OS SLES 12 SP1; CentOS 7.2 OpenHPC Base All OpenHPC features included, plus RHEL 7.2 BU7 supported, enhanced documentation. SW Architecture Hierarchical development environment uses Advanced
Slide 21: Basic Cluster Install Example
Basic Cluster Install Example Install Guide - CentOS7.1 Version (v1.0) Lustre* storage system Starting install guide/recipe targeted high speed network for flat hierarchy Master compute Leverages image-based provisioner nodes (SMS) (Warewulf) Data Center eth0 eth1 to compute eth interface Networ
Slide 22: Installation Recipe
Installation Recipe • Walks a system administrator through the steps to bootstrap a cluster • Ease of Use: • Describes what needs to be accomplished • Followed by example commands • Copy & paste the commands with site-specific inputs • For faster integration: • Edit site specific inputs file • Execu
Slide 23: Intel® HPC Orchestrator: Summary
Intel® HPC Orchestrator: Summary Benefits IT Admins - reduce R&D to build and maintain a fully integrated SW stack End Users - hardware innovation reflected in SW faster on path to exascale OEMs – reduce R&D costs and innovation time to market • Integrated open source and proprietary components • Mo
Slide 24: Learn more and engage with us
Learn more and engage with us More Information www.intel.com/hpcorchestrator FREE 6-WEEK TRIAL www.openhpc.community AVAILABLE NOW! software.intel.com/intel-parallel-studio-xe Contact your HPC System Vendor or one of our team members below makebettercode.com/parallelstudioxe-eval Sales Questions Eas
Slide 25: Copyright© 2017, Intel Corporation. All rights reserved.
Copyright© 2017, Intel Corporation. All rights reserved. 25
Slide 26: Copyright© 2017, Intel Corporation. All rights reserved.
Copyright© 2017, Intel Corporation. All rights reserved.