IBM Autonomic Computing and Solution Installation David Cole IBM AC Customer and Partner Programs.
IBM Initiatives in Autonomic Computing
description
Transcript of IBM Initiatives in Autonomic Computing
1
© 2002 IBM Corporation© 2003 IBM Corporation
Autonomic Computing
IBM Initiatives in Autonomic Computing
Alan Ganek
Vice President, Autonomic Computing
© 2003 IBM Corporation 2
The on demand Era
Simplify infrastructure
Sense and respond to business changes
Protect privacyDeliver unique value to
customers
Ensure continuity
Improve cost structure
Accelerating advances in technology
Deeper integration of IT with business systems
Emergence of industry ecosystems
© 2003 IBM Corporation 3
The good news…Processor Storage
Communications Systems
© 2003 IBM Corporation 4
The bad news…
WorkloadsWorkloads
PricePriceComplexity
Services and Software Costs
Skills Shortage
New Workloads
© 2003 IBM Corporation 5
Business Challenges
Complex, heterogeneous environments
Outages of mission-critical systems cost quite a bit
Poorly documented legacy applications make it painful to diagnose and resolve complex cross-product problems
25-50% of IT resources are spent on problem
determination and resolution
Up to 40% of today’s outages are unscheduled stoppages
The skills needed to do manual cross-product problem determination are scarce and expensive
Missing or Loss of critical data is immeasurable
Outages & unscheduled work leads to saturation on backup systems & power systems
© 2003 IBM Corporation 6
Autonomic Vision
Focus on Mission, not infrastructure!
“Autonomic computing allows companies to operate more efficiently and achieve more from their existing IT environments, enabling increased responsiveness, business continuance and availability.”
—Rick Sturm
“Intelligent” open systems that: Manage complexity Know themselves Continuously tune themselves Adapt to unpredictable conditions Prevent and recover from failures Provide a safe environment
© 2003 IBM Corporation 7
Autonomic Computing Attributes
Increased Responsiveness
Adapt to dynamically changing environments
Business Resiliency
Discover, diagnose,and act to prevent
disruptions
OperationalEfficiency
Tune resources and balance workloads to maximize use of IT resources
Secure Information
and Resources
Anticipate, detect, identify, and
protect against attacks
Self-managing systems that deliver:
© 2003 IBM Corporation 8
How does autonomic computing help organizations?
Improved resiliency and quality of service Always there when you
need it
Safe and secure
Time to Value Improves responsiveness
Reduction in Risks
Reduction in Infrastructure Costs Better asset utilization More productive people Reinvestment of IT productivity and cost savings
“Autonomic computing is a vision that will take several years to realize, but with the model that IBM has outlined, there are benefits attainable at every step, which pay you back...fairly quickly for the investments you make.” —Mike Gilpin
© 2003 IBM Corporation 9
Open Standards
The Big Picture of Autonomic Computing Technology
Autonomic core capabilities
Products delivering autonomic features
Business policy
Au
ton
om
ic C
om
pu
tin
g A
rch
itec
ture
Solution Install
Problem Determination Admin Console
PolicyResource
Provisioning
• Define a base reference architecture model which creates a common vernacular for autonomic computing
• Deliver core infrastructure technologies that provide for an open framework for the industry
• Deliver products with built-in autonomic capabilities
• Create open standards for autonomic computing
© 2003 IBM Corporation 10
A Holistic Approach
• End-to-end automation enabled by consistent technology across all system elements
• Based on open standards
• Distributed globally into a single virtual operating environment
Pro
fessio
nal S
erv
ices
NetworkStorageServers
Web Services
Open Grid Services Architecture - OGSA
ApplicationServers
ISVSolutions
DatabaseSystemMgmt
Applications
Au
ton
om
ic C
ap
ab
ilit
ies
Architecture Framework
Customer-centric solutions, not just products Industry standards are key
© 2003 IBM Corporation 11
Autonomic Computing Architecture Overview
Managed Element
Sensors
Resource Manager
Effectors
Sensors Effectors
Knowledge
Plan
ExecuteMonitor
Analyze
Data Action
Autonomic Manager
Manageability Interface
© 2003 IBM Corporation 12
Autonomic Control Loops: next step evolution
Autonomic featuresLocal view
Global environment view and knowledge
USER RESPONS
E TIMEAVAIL.
RESOURCE
BUSINESS SLA
POLICY
© 2003 IBM Corporation 13
Multiple Contexts for Autonomic Behavior
System Elements(Intra-element
self-management)
Groups of Elements
(Inter-elementself-management)
ServerFarm
EnterpriseNetwork
StoragePool
Business Solutions(Business Policies,
Processes, Contracts)
Customer Relationship Management
EnterpriseResourcePlanning
Servers StorageNetworkDevices Middleware Database Applications
© 2003 IBM Corporation 14
ThinkPad Active Protection System…
A patented hardware and software solution that can reduce hard drive failures by avoiding fall-induced damage
Hardware: Motion Detector (or “accelerometer”) on the system board senses movement that could cause system damage
Same chip used in automobile airbags
Software: Interprets signals from the accelerometer and signals the hard drive to temporarily park the drive head when rapid system motion or vibration is detected
Can differentiate between potentially harmful movements and repetitive motion (such as in a car or airplane)
The system senses computer’s orientation and displays it on the screen real-time
Standard on all T41 and R50
ThinkPads
© 2003 IBM Corporation 15
Storage attributes
can be auto-
discovered
Storage can be aggregated into storage pools with
similar service class
Storage can be changed without
disruption to the application
server
Virtualization hides the physical
topology from the application
servers
Individual application servers do
not manage their own
file system
TotalStorage:SAN File Systems and SAN Volume Controller
The IBM TotalStorage Virtualization software is designed to automate configuration and provisioning across multiple servers.
Tasks that historically have been done manually, are automated, thus reducing complexity and increasing productivity
SAN File System and SAN Volume Controller
UNIXLinux
SUN W2K
AIX
HP
Files are automatically provisioned based upon policy based
rules
© 2003 IBM Corporation 16
WebSphere Application Server v5
Policy-driven Self-Optimizing Solution:IBM Server Allocation for WebSphere
IBM Server Allocation for WebSphere
ForecasterAdvice Application
Internet
Load Balancer WebSphere Transactional Grid
Mid priority
Low priority
High priority
DatabaseServer
Account Manager
Stock Trading
ParallelServices
ApplicationProvisioning
•Multiple WebSphere transactional applications
•Multiple Service Level objectives
•Dynamic and automated application provisioning
© 2003 IBM Corporation 17
IT Infrastructure Orchestration Business challenge Extend Events to millions of sports fans Real-time “point-by-point” scores and statistics Latest news delivered online
On demand business benefits Secure and scalable infrastructure (up to 50 times the previous
infrastructure capacity) Real-time access to all play-by-play tournament information on “as-
needed” basis Global reach with around-the-clock availability
When resources not in use,allocation is given to biotechnology research
Hour of Day
Tourcast SU Utilization Annika at the Colonial
0
50
100
150
200
0:5
91
:59
2:5
9
3:5
9
4:5
9
5:5
9
6:5
9
7:5
9
8:5
9
9:5
9
10
:59
11
:59
12
:59
13
:59
14
:59
15
:59
16
:59
17
:59
18
:59
19
:59
20
:59
21
:59
22
:59
23
:59
Allocated Thursday Friday Saturday Sunday
Tivoli Intelligent Orchestrator
© 2003 IBM Corporation 18
Intelligent Orchestration Saves Time and Costs:IBM Tivoli Intelligent Orchestrator
100 Servers at 20% Capacity
100 Software Licenses
3 Administrators
Maintenance Costs $$$$$
Add/Remove Resources in Days
50 Servers at 40% Capacityutilizing current infrastructure
50 Software Licenses
1 Administrator
Maintenance Costs $
Add/Remove Resources in Minutes
Intelligencebefore after
© 2003 IBM Corporation 19
Open Standards
Core Capabilities Enable Autonomic Behavior
Autonomic core capabilities
Products delivering autonomic features
Business policy
Au
ton
om
ic C
om
pu
tin
g A
rch
itec
ture
Solution Install
Problem Determination Admin Console
PolicyResource
Provisioning
Service Support
Solution install & maintenance
Problem determination
Common System Administration
Service Delivery
Policy-based security and management
Autonomic monitoring
Complex analysis
Provisioning
Heterogeneous workload management
© 2003 IBM Corporation 20
Building an Open Framework for the Industry… Solution Install & Maintenance
IU
IUIU
IU
IU
IU
Tooling
Installer: Dependency Checkers,Install, Configuration &Verification Actions,Updates
Solution Installed in
Hosting Environment
Managing changes through the lifecycle of the solution
One consistent software installation technology across all products Consistent and up-to-date configuration and dependency data Reduced deployment time with less errors Reduced software maintenance time, improved analysis of failed system components Component-based product install
Standards-based: OGSA, Web Services,CIM
Creation of Installable Units: descriptors and artifacts
© 2003 IBM Corporation 21
Building an Open Framework for the Industry… Integrated Solutions Console
One Stop Shopping for all Administrative Tasks
One consistent user interface across product portfolio
Common runtime infrastructure and development tools based on industry standards, component reuse
Provides a presentation framework for other autonomic core technologies
Through a unified portal
Standards-based: J2EE, JSR168
...n
Unified end-to-end customer tasks from hardware management thru middleware
© 2003 IBM Corporation 22
Building a Self-Healing System
Level 1
Data capture
Analysis
Self Healing
Common log format
StandardizationAdapters
Symptom databases
CorrelationSimple analysis
Consult PolicyTake corrective
actionClosed Loop
Remediation
Complex analysisSuggested
Corrective Action
Increasing level of automation
© 2003 IBM Corporation 23
Disparate pieces and parts
Tools focused on individual products
No common interfaces among tools
No synergies in building tools OR in creating log entries
Log Format TodayLog Format Tomorrow
Database
Networks
ApplicationServer
Servers
Storage devices
Applications Common Base Eventsubmitted to OASIS
Generic Log Adapters Common formats for
log files Common set of tools Common interfaces
among tools
Ad
ap
ters
Ad
ap
ters
common base event
© 2003 IBM Corporation 24
Log and Trace Analyzer for Autonomic Computing
Viewing, analysis, and correlation of log files
Consolidated environment that deals with logs and traces produced by various components
Easier and faster for developers and support personnel to debug and resolve problems
Link to WebSphere symptom database available today
© 2003 IBM Corporation 25
data analysis
information analysis
knowledge reasoning
Data
e.g.: Memory,
CPU
Information
e.g.:App stopped, Mem leak
Knowledge
e.g.: Restart,
command
Analyze Plan
Monitor ExecuteAction
Resource Model:Process Analysis
Resource Model:Memory Management
Resource Model:Event Log Processing
Data
Tivoli Autonomic Monitoring Engine
Knowledge
Policies
validate
action
In development
In development
Symptomservice
Knowledge
situation
actionable cause
In development
In development
© 2003 IBM Corporation 26
Autonomic Computing Self-Healing Systems
Feedback
Dat
a
Policies
Knowledge
common base event
Policyengine
Symptomservice
ApplicationServer
Servers
Storage devices
Database
Networks
Applications Ad
ap
ters
Ad
ap
ters
Tivoli Autonomic Monitoring Engine
© 2003 IBM Corporation 27
Life cycle of autonomic elements
Multi-agent learning & negotiation/conflict resolution
Software tools Testing, verification,
robustness Policies and SLA’s Availability, fault
tolerance & recovery Continuous operations Problem determination
Research ChallengesInnovationNeeded!!
Optimization & prediction End to end security Distributed resource
management & scaling Peer system interaction Context awareness Human computer interface Metering, monitoring &
control Cultural change & trust . . . .
© 2003 IBM Corporation 28
Autonomic Computing alphaWorks Zone Get started developing autonomic solutions
now
– Available on alphaWorks:• Log and Trace Tool
• Business Workload Management Developer Kit
• Tivoli Resource Model Builder
• Agent Building and Learning Environment (ABLE)
• IBM Grid Toolbox
• Web Services Tools
– Coming soon – components from:• Autonomic Computing Toolkit
• Solution Install
• Policy-based Management
• and more!
www.alphaworks.ibm.com/autonomic
© 2003 IBM Corporation 29
the journey has started……
Products, services available today
Architecture and core technologies emerging
IBM is working with business partners and standards organizations to develop
open standards for self-managing systems
Broad IT industry participation is needed – this is an industry-wide initiative
Innovation & Collaboration are a must!! Aggressive research is essential!!
Freeing people to focus on their business instead of
their infrastructure
© 2003 IBM Corporation 30
Questions?
Web sites:
www.ibm.com/autonomic
www.research.ibm.com/autonomic
www.alphaworks.ibm.com
A Vision of Autonomic Computing– IEEE Computer, January 2003
IBM Systems Journal special issue on Autonomic Computing– http://www.research.ibm.com/journal/sj42-1.html