SAS Environment Manager€¦ · Component of a Server database tables, SAS logical workspace...
Transcript of SAS Environment Manager€¦ · Component of a Server database tables, SAS logical workspace...
Copyright © 2010, SAS Institute Inc. All rights reserved.
Company Confidential – For Internal Use Only.
Copyright © 2014, SAS Institute Inc. All rights reserved.
SAS Environment Manager
Ole-Martin Hafslund
FANS Møte 10.9.2015
Oslo
2
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS Environment Manager
Overview
SAS-Specific Functions
Basic Exercises
Controlling Access
Extra
3
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS Environment Manager
Overview
SAS-Specific Functions
Basic Exercises
Controlling Access
Extra
4
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS 9.4 Environment Manager (EV)
Main nerve center of an entire SAS installation
Provides enterprise-level monitoring and control in a
web-based console
This type of comprehensive monitoring/control is new
to SAS
Will gradually replace functions of the SAS
Management Console, throughout the lifetime of the
SAS 9.4 release.
5
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS 9.4 EV Overview
Auto-discovery of resources
Personal and role-based dashboards
Monitoring of remote systems and metric collection
Event tracking and record events of interest
Alerting for events and metrics that relate to system health
Visualizations for server monitoring, memory and processor
usage
Resource control and configuration—SAS servers, third-party
servers, web application servers
Live Data (OS commands and utilities)
Environment Manager includes the following key
monitoring and management capabilities:
6
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS 9.4 EV Overview
View and browse most SAS metadata
Apply SAS authorization rules to metadata objects
Create/modify Access Control Templates
Create/delete content folders
Create new users/groups and assign to roles
Monitor SAS metadata server clusters
….much more to come soon…..
Environment Manager includes the following
additional SAS-specific functions:
7
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS 9.4 EV Overview
Components of SAS Environment Manager:
A central server to which agents report
An agent on each managed host
A store of information about managed resources (in a
database)
Plug-ins to customize which resource types are to be
monitored
Web-based administrative console
dfdadf
8
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS Environment Manager Components
Technologies:
• a web-based admin GUI
• an agent on each managed host
• solution aware plug-ins
• central server to manage and deploy the plug-ins
• centralized operational datastore
• collection of reports and graphs helping characterize
resource usage across the whole operational deployment.
• single sign-on with other SAS and customers’ enterprise
web applications
9
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
10
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Web GUI
Dashboard
Control Center
Platform 1 ( machine )
Agent
Tc
Object
Spawner
Mid-Tier
Servers
Server 1
Agent
tc Server
Instance 1
Spring
tc Server
Instance 1
Spring
tc Server
Instance 1
Spring
Platform 2 ( machine 2 )
Agent
tc S
Object
Spawner
Metadata
server
CLI
Open API
RESTful
Upgradeable
via XML and
JAVA agent
pluginsCMDB Service
Database
Inventory, Events,
Alerts
Management Server
GUI Administration,
Provisioning, Groups,
Metrics, Alerts, Events,
Logs, Agents
SAS Environment Manager Architecture
11
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Service
Database
Collects a Broad Set Of Operational Metrics
Availability
Performance
Configuration changes
Events
Log entries
Solutions
Web Application Servers
WIP Services and DB
ActiveMQ Messaging
Apache TC server
SAS Servers
• Metadata
• Object Spawner
• Stored Process Server
…
Operating Systems
• Memory
• Processor
• IO
Storage & IO systems
• LASR
• SPDS
• SAS Dataset
Virtualization
12
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS 9.4 EV Overview - functioning
Agents, installed on each machine, discover, monitor, and gather data
about the resources (OS, platforms, servers, services) that are running
on that machine.
Agents periodically send that information to the server, where it is stored
in a database as part of the inventory.
Administrators use the web-based interface to view/manage/manipulate
that data, generate reports, and construct alerts about problems
Administrators can also perform control actions via the agents, such as
starting/stopping a server, configuring various servers, or deploying
applications.
13
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS 9.4 EV Overview – Software Components
The Main SAS EV Server is a Tomcat 6 Server with custom applications
The SAS EV agents are small, standalone background processes--1 per
machine
The Database is part of the postgreSQL installation—it is the
EVManager database
The browser can be any SAS-supported web browser
Plug-ins are small Java-based modules that are installed with the agent
and the server, 1 per resource type
14
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS EV Components – Windows Services
sfdsas
sdf
asdffdadfSAS EV ServerSAS EV Agent
Database
15
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS EV Components – Linux Server
Database
SAS EV Server
SAS EV Agent
16
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
16
SAS EV Resource Inventory Model
Platform
Server
Service
Platform
Machine, OS, network switch, or SAS
Deployment
ServiceComponent of a Server
database tables, SAS
logical workspace
server, work directory,
etc.
ServerRuns on a Platform
SAS Object Spawner,
SAS Metadata server,
tc Server,– and many
others
Platforms, servers, and services are all types of Environment Manager resources,
The relation between service, server, and platform is a resource hierarchy. Plugins
typically focus on a particular Server or Server + Service.
17
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS EV Resource Examples
Platforms
– Machines (ie, sasbap.demo.sas.com)
– SAS Deployments (ie, SAS 9.4 Application Server Tier)
Servers
– tc Server, Apache server, postgreSQL, etc.
– SAS Object Spawner, OLAP Server
– SAS Config Directory, SAS Home Directory
Services
– SAS Logical (Workspace, Stored Process) Server
– postgreSQL database or database table
– Work Directory
18
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
18
PerformanceDatabase
Availability
Performance
Configuration changes
Events
Log entries
SAS Foundation Servers
Application Servers
Web Servers / Caches
Messaging Middleware
Databases & Dataset Libraries
Directory Services
SAS Local Services
Operating Systems
Virtualization
19
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
19
SAS 9.4 Plugins (M2 release):
sas-appserverqueries metadata for application server contexts and logical server definitions.
sas-serversdetects foundation servers including metadata, object spawner, wss, pwss, olap, sps details sas local servers including saswork, tmp, also provides log file tracking, and notifications of config file changes
sas-hadoopdetects and monitors hadoop nodes
emi-servicesprovides a mechanism to manage PostgreSQL high availability as well as miscellaneous general purpose monitors such as ping
sas-lasrprovides basic monitoring of SAS LASR SMP processes
emi-framework, emi-reportcenter, emi-snapshot for various functions of the new Service Architecture Framework
20
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS EV Administrative Interface
Highest-level menu consists of the following items:
Dashboard with summary portlets
Resources – main screen for monitoring resources
Analyze – events, alerts, report center, environment
snapshot
Administration – SAS metadata components
Manage – internal administrative functions
21
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
URL: http://machine.name:7080/
22
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
23
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
24
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
25
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Administration tab
26
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
27
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS Environment Manager
Overview
SAS-Specific Functions
Basic Exercises
Controlling Access
Extra
28
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS-specific management with SAS EV
Viewing SAS metadata/folders
Setting access controls on SAS metadata objects
Creating new access control templates and users
Monitor a SAS metadata cluster
Generate an environment snapshot for troubleshooting
Grid Manager SASMC plugin functionality
29
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
30
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
31
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Modifying SAS Authorization Metadata
32
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Create custom Access Control Templates
33
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Administration->Users
34
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Monitor a SAS Metadata Cluster
35
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS Environment Snapshot
36
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS Environment Manager
Overview
SAS-Specific Functions
Basic Exercises
Controlling Access
Extra
37
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Demo: Using SAS Environment Manager
Customize the Dashboard
Basic Monitoring of Resources
Configuring a Resource
Controlling Servers (start/stop/restart) and
Scheduling Downtime
Monitoring logs and event tracking
Setting up an alert
Create a mixed group of resources for monitoring
(optional)
38
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS Environment Manager
2.1 Overview
2.2 SAS-Specific Functions
2.3 Basic Exercises
2.4 Controlling Access
Extra
39
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Controlling access to the SAS EV
Mapping SAS users/groups to SAS EV users/roles
Special users: SAS administrator (sasadm) and SAS
service account (sasevs)
Using https with SAS EV
40
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
sasevs@saspw is a member
sasadm@saspw is a member
41
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
42
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Setting SAS EV role permissions
43
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS EV Users and Roles
Metadata group SAS EV Role
“SAS Environment Manager Super Users” “Super User Role”
“SAS Environment Manager App Server Tier Users” ”SAS App Tier Role”
“SAS Environment Manager Guests” “Guest Role”
44
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
agent.properties file (portion):SAS service account
45
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Securing the SAS Environment Manager
SSL can be used to encrypt/authenticate the connections to
SAS EV in two places:
The administrative (and other) users logging into the
web interface
The SAS EV agents connecting to the SAS EV server
46
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS Environment Manager
Overview
SAS-Specific Functions
Basic Exercises
Controlling Access
Extra
47
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
47
Where does SAS EV FIT today and the future?
48
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SUPPORTING BUSINESS SERVICE MANAGEMENTsas environment manager
49
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Fit EV AND APM
9.4 M0 (available Q3 via Demos & Downloads)
EV APM plug-in to monitor APM jobs
9.4 M1 – Beginning of EV / APM integration including:
Generalization of common measures - shift, datetime,
elapsed time
Common formats, autocalls area
Consolidated datamart
APM reports surfaced via EV interface
50
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Fit FUTURES
EV Datamarts available to be consumed by VA and ITRM
for:
performance “interval” data
Events/Alerts “event” data
server/service/application “availability” data
Log gathering REST webapp service
51
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Sas environment manager
ROADMAP
9.4 lifecycle goals:
Add functionality to help SAS administrators in troubleshooting problems
and begin replacing SASMC functionality
Environment Snapshot
Security visualization & lineage
User manager
Enable other development groups to use the EV infrastructure to create
administrative components that can be surfaced in the EV interface, in
other solution interfaces, and stand-alone.
Plug-ins can be available as experimental on Demos & Downloads
then production on maintenance boundary
Support for clustering, GRID, LASR
52
Copyr i g ht © 2014, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Takk for meg!