Building a Hive for Queen Bee

Randall Walker, Division of Administration

One Piece of Bigger Picture

• Fellow speakers will discuss some of the applications and benefits of the LONI supercomputers

• Preparations for Queen Bee just one part

.edu & .gov interface

• Working together to benefit Louisiana and its citizens

• Queen Bee is a recent example

• BOR / LONI initiative with support of CIO

Challenges

• Space • Funding• Technology• Time• Logistics• Electrical• Cooling

Physical Space

• Existing print room was best location

• Two large printers and associated equipment

• Multiple departments with server racks installed already

• 300-pound floor tiles not sufficient for all of proposed equipment

Funding

• Infrastructure costs not projected

• Change to existing contract required funding commitment

• Change orders require Legislative approval

• Regents and DOA split cost of 1st change order

• Six change orders to date

Technology

• Queen Bee is a Red Hat Linux cluster

• 680 Dell 1950 dual quad-core 2.33 GHz processors

• 50.7 Teraflops (50,700 billion operations per second)

• 240 terabytes storage

Time Constraints

• Top 500 supercomputers announced twice a year

• Next announcement was June 2007

• Deadline for submission of benchmark was May 15th

Logistics - Packaging

Logistics - Receiving

Logistics - Storing

Logistics - Assembly

• “Some assembly required”

• Find the instructions• Find all the pieces• Insert all the pieces• Verify all the pieces• Repeat 679 times

Logistics - Disposal

Electrical – 600KW UPS

Electrical - Generator

Cooling

First External 90 ton chiller

Rented Chiller

Top 500 Ranking

Rank Site Location

22 Commissariat a l”Energie Atomique

France

23 Louisiana Optical Network Initiative (LONI) Queen Bee

Louisiana

24 Atomic Weapons Establishment

United Kingdom

Announced June 27th at International Supercomputing Conference in Dresden, Germany

Media Coverage

The Advocate – June 12, 2007

Group Effort

APCBoard of RegentsCiscoComputing ServicesCorporate MechanicalDellFacility PlanningJ & J ElectricLONI Management & StaffNesbit & AssociatesOffice of Information TechnologyState BuildingsState Purchasing

Queen Bee Hero Award

Chuck Denstorff Russ Gordon David Lemoine James Morrison Danny Nesbit

Without them, the Queen Bee project would have not been successful.

Queen Bee Today

Ongoing Activities

• Definition of roles for monitoring and maintenance of infrastructure

• Fiber connection from ISB to LONI optical network

• Installation of 3rd generator to provide N+1 redundancy to both LONI and ISB

Our long-term commitment

• Our goal is to provide a home for Queen Bee where she can be happy and productive for years to come

Questions & Answers

We will entertain questions about Queen Bee after the last speaker has concluded their remarks.