Mehr Daten… Einfacher verwalten

IBM Software Group

© 2002 IBM Corporation| Date 3.4.03 |

Mehr Daten…Einfacher verwalten

DB2 Universal DatabaseVersion 8

Joachim StumpfDM Technical SalesIBM Data Management SolutionsEMEA Region [email protected]

IBM Software Group | DB2 Data Management Software

© 2002 IBM CorporationDB2 V8 | Überblick |

DB2 Strategie

DB2 Version 8: Überblick und Neuheiten

DB2 Version 8Führende Technologie für Informations-Managementund -Integration

26. DECUS Symposium 10.4.03

www.decus.de 1-2



Windows Marktanteilswachstum ’97- 01**

Weltweiter Datenbank Markt 20018.844 Mio. US$, 1.4% WachstumIBM Wachstum: 4.3%

Kundenzufriedenheit fördert WachstumFührende Technologie, Cross PlattformStarke PartnerschaftenGünstige TCO * Quelle: Dataquest, Mai 2002

** Quelle: Basierend auf Dataquest 1998 und 2002

Oracle2829,832,0%

IBM2799,731,7%Informix

264,43,0%

Microsoft

1442,716,3%

Sybase234,22,6%

Sonstige

1272,614,4%

IBM OracleSybase

20

1

-2.9

Microsoft

Oracle Sybase

13.6

-6.7 -6.0IBM

2.1

2001 WW Datenbanken Marktanteile*UNIX Marktanteilswachstum ’97-

01**IBM führt



EnterpriseServerEdition

WindowsAIXHP-UXSolarisLinux(Intel)

withClustering-PartioningOption

DB2 Connect

Enterprise ServersDB2 UDB for OS/390 and z/OSDB2 for VM and VSEDB2 UDB for OS/400DB2 UDB for zLinux

PersonalEdition

WindowsLinux(Intel)� � � � � � � � � � � �

� � � � � � � � � � ��

� � � � � �

� � � � � � �

� � � � � � �

WorkgroupServerEdition

WindowsLinux(Intel)AIXSolarisHP-UX

EveryplacePalmOSWin CEEPOC-32LinuxWin32

IBM DB2 Familie


www.decus.de 3-4



DB2 UDB V8 Packaging/PlatformsPlatform Support

Stabilizing OS/2 and NUMA-Q/PTX at Version 7.2NUMA-Q hardware strategy is to support Windows

Tier 1 PlatformsAIXSolarisHP-UXWindowsLinux xSeries (Intel)Linux zSeries (Linux/390)

Statement of DirectionLinux iSeries (AS/400)Linux pSeries (RS/6000)

Satellite Edition Merges with Personal Edition / WorkgroupDB2 Workgroup Edition now called DB2 Workgroup Server EditionDB2 EE merges with DB2 EEE

Enterprise Server Edition (ESE)Clustering/Partitioning is an Option



DB2 Version 8 - Schwerpunkte

Entwickler ProduktivitätEntwickler ProduktivitätJava, .NETWeb Services, XML...

Robuste e-businessRobuste e-businessInfrastrukturInfrastrukturLeistung, Skalierbarkeit,Plattformen, Verfügbarkeit...

SMART ManagementSMART ManagementKonfiguration, Management,Tuning, Automatisierung...

Informations IntegrationInformations IntegrationFederationWeb Services, XMLReplikation...

438 neue Features und Funktionen438 neue Features und Funktionen


www.decus.de 5-6











Training Costs� � � � �

Upgrades� � � �

Database License� � � �

Developer Tools� � � �

Client Access� � � �Implementation� � � � �

Internal Maintenance Costs � � � �

� � � � � � � � � � � � � � � � � � � � � � � �� ! " � # $ " � � " ! � � � � % � & & � � � � � � � � � � � � � � " � � '

Server TCO:

81%

Study of a competitive DBMS product, NOT DB2

What's the Cost of Running a Database?


www.decus.de 7-8



Lots of stuff to do ... what shall we get started on?

Across theIndustry,andDBMSes ...

Sys

tem

Hea

lth

Dia

gnos

is

Tabl

eM

aint

enan

ce

Ch

gM

gm

t

Dis

aste

rR

ecov

ery

Qu

ery

Tun

ing

Sp

ace

Mg

mt

Dat

aM

ovem

ent

Use

rM

gm

t

0

10

20

30

40

50

60

Num

ber

ofC

usto

mer

Res

pons

esMost Difficult to ExecuteExecuted Most FrequentlyMost Time Consuming

A SMART DB2: What's our Focus?



SSelfelfMManaginganagingAAndndRResourceesourceTTuninguning

SMART Management

Mit weniger Skills und RessourcenMit weniger Skills und RessourcenSysteme optimal ausnutzenSysteme optimal ausnutzen

Selbst KonfigurationAutomatisches Überwachen und Tunen von Ressourcen

Selbst HeilungEntdeckung und Diagnose von und Reaktion auf Störungen

Selbst OptimierungAutomatische Anpassung an veränderliche Systemumgebung

DB2 V7 ist schon SMART...Query Optimizer, Query RewriteAutomatische ParallelisierungControl CenterZahlreiche Wizards etc...


www.decus.de 9-10



SSelfelfMManaginganagingAAndndRResourceesourceTTuninguning

DB2 V8...noch SMARTer

Configuration AdvisorVereinfacht das TuningStellt dutzende von Parametern einAutomatische HW Erkennung

Health Center und MonitorÜberwacht & optimiert DB2Automatische Regel-basierteKorrekturen oder Benachrichtigung

DB2 ToolsDB2 Performance ExpertDB2 Recovery Manageru.a.

und mehr...



it's important to understand we're on an evolutionary path

we need to gain your trust, and give you control when necessary

we need to crawl before we walk, and walk before we run

The Steps to Autonomic Computing


www.decus.de 11-12



Control Center Enhancements

Event Monitor GUI rewritten in JavaUpdated Panels

Script CenterJournal

New panelsReplication centerDevelopment center

New Wizardscreate tablespace wizard for EEEsummary table wizardperformance configuration wizard for EEE

Memory Visualizergain insight into memory usage within DB2

Web-based Administrationmaintain DB2 from an HTML session



Health Monitoring: Automating PD&R

monitorsystem

executestrategy

determinefeasible

resolutionstrategy

analysisproblem

recognition

Health & Welfare Problem Determination & Resolution

how and why did this happen?what are the implications of encountering this problem?does this affect anything else or is it isolated?how do I fix it, and what is the "best" fixwhen do I fix it?

Automatic

what to monitor?how to achieve low overheadmonitoring?how do I know there's a problem?

Feedback Loop

Manual or Automaticautomatically, cheaply monitor health w/o setup/configurationallow for automatic resolution of unhealthinessCaveat: not all resolutions can be automated!

require manual intervention (hard limit like disk full)too complicated (many interrelations, interactions)too risky


www.decus.de 13-14



Health Center

(horman@healthy) /home/horman $ db2 get heal t h snapshot f or DBM

Database Manager Health Snapshot

Node type = Database Server with local clientsInstance name = hormanSnapshot timestamp = 03-27-2002 13:24:51.799180

Database Manager Health Indicators:

Health Indicator ID = 2 (db2.sort_privmem_util)Value = 86Evaluation timestamp = 03-27-2002 13:20:07.910561Alert state = warning



mult. Platform

platform dependentfunctions

Performance Expert - System Overview


www.decus.de 15-16



Recovery Expert - Overview



database_nametable_name

file.out1fast unload

Source can also be:

TablespacesAll or selectedpartitionsTables

IndividualMultiple tablesSummary tablesAlias tables

BackupsFull image copy

High Performance Unload - transformations

IXF

file.out2

ASCDEL

file.out1

named_pipe

tape


www.decus.de 17-18



DB2Optimizer

SQL Workload

� � � � � � �

� � � � �

� � �

DatabaseStructure

Indexes/MQTs Designedby DB2 for YOUR

Environment

Platform specific exploitationAutomatic Configuration of Client SupportDynamic memory utilizationAutomatic statistic collectionmuch, much more

PLUS

Comprehensive ToolsTraditional DBA ToolsPerformance Config. WizardsIndex AdvisorMaterialized Query Tables Advisormuch, much more

SMART Management



Online configuration parameters: BASIC

OverviewConfiguration parameter changes will be effective without stopping the instance or database.

Key configuration parameters can be set online.Focus was on the ones that customers change most often.

Several can now be made automatic. DB2 manages their value.For example, MAXAPPLS. Set it to automatic, and there is no limit to the number of applications.

How to enableCLP, Control Center or C APIWhen do they take effect?

IMMEDIATE (default)Must be explicitly attached to the instance, or connected to the database.

The Control Center will automatically form a attachment or a connection if you select the immediate option.DEFERRED

At next db2start or database activation as in prior versions.

ReferenceAdmin guide: Performance


www.decus.de 19-20



Online changes : USAGE TIPS

Usage tips:Changes in DBM configuration for clients only take effect during client code initialization.Some configuration changes may take a noticeable amount of time to take effect due to overhead in allocating space.The optimizer is sensitive to sort heap, bufferpool , etc.

Static SQLRebind packages.

Dynamic SQLAccess plans are cached.The FLUSH PACKAGE CACHE command invalidates the plans in the cache. They are compiled next time they are used.

32 bit versus 64 bit.32 bit systems have a fixed shared memory. Online changes cannot exceed this, but can reallocate within it.On 64 bit systems the shared memory can be changed dynamically. Online changes can take advantage of this.



New SHOW DETAILS option of GET DB/DBM CONFIGDB example:

Database Configuration for Database AutoDescription Parameter Current Value Delayed Value------------------------------------------------------------------------------------------Database configuration release level = 0x0a00Database release level = 0x0a00

Size of database shared memory (4KB) (DATABASE_MEMORY) = AUTOMATI C(8416) AUTOMATI C(8416)Catalog cache size (4KB) (CATALOGCACHE_SZ) = (MAXAPPLS*4) (MAXAPPLS*4)Package cache size (4KB) (PCKCACHESZ) = (MAXAPPLS*8) (MAXAPPLS*8)Max number of active applications (MAXAPPLS) = AUTOMATI C(40) AUTOMATI C(40)

Automatically-Tuned Configuration Parameters


www.decus.de 21-22



convenient to have deadlock info captured automatically

5) Deadlocked Connection ...Deadlock Id: 6Deadlock Node: 10Participant no.: 1Participant no. holding the lock: 2Deadlock detection time: 08-22-2000 16:45:56.251972Table of lock waited on : STAFFSchema of lock waited on : RIIHITablespace of lock waited on : USERSPACE1Type of lock: RowMode of lock: XMode application requested on lock: NSNode lock occurred on: 0Lock object name: 39Application Handle: 6Deadlocked Statement:Type : DynamicOperation: CloseSection : 201Creator : NULLIDPackage : SQLC2D01Cursor : SQLCUR201Cursor was blocking: FALSEText : select name from staff

List Of Locks:Lock Object Name = 3Node number lock is held at = 0Object Type = TableTablespace Name = USERSPACE1Table Schema = RIIHITable Name = STAFFMode = ISStatus = GrantedLock Escalation = NOLock Object Name = 13Node number lock is held at = 0Object Type = RowTablespace Name = USERSPACE1Table Schema = RIIHITable Name = DEPARTMENTMode = XStatus = GrantedLock Escalation = NOLock Object Name = 4Node number lock is held at = 0Object Type = TableTablespace Name = USERSPACE1Table Schema = RIIHITable Name = DEPARTMENTMode = IXStatus = GrantedLock Escalation = NO

Automatic Deadlock Identification



SMARTOnline


www.decus.de 23-24



Robuste e-business Infrastruktu

UtilitiesDynamische Buffer Pool KorrekturenDynamische TablespacekorrekturenIn-place Tabellen ReorgIndex ReorgLoad & AST WartungRunstatsOnline Inspect



Online buffer pool changes

OverviewBuffer pool changes will be possible while the database is active.

You can add a new buffer pool or resize an existing one.This change, plus the ability to adjust database and instance configuration parameters online, allow you to change memory allocations while the system is active.

How to useCREATE and ALTER BUFFERPOOL SQL statement.

IMMEDIATE is the default.DEFERRED option also available.

Changes are effective at the next database activation.DROP BUFFERPOOL

Buffer pool is dropped immediately as it is today.However, memory will be immediately made available to the database shared memory.


www.decus.de 25-26



Online buffer pool changes : Sample scenario

Exploitation examplesCustomize memory usage to the task.

Prime shift memory allocation is optimized for query performance(large buffer pool)Use an off shift script that:

Reduces the buffer poolIncreases utility heap and sort heapRun loads with the configuration optimized for load.Returns parameters to prime shift values



Database Container Operation

ALTER TABLESPACE mytsREDUCE (FILE 'cont1' 500,

FILE 'cont2' 500)

ALTER TABLESPACE mytsBEGIN STRIPE SET

(FILE 'cont3' 2500,FILE 'cont4' 2500)

no rebalancing

ALTER TABLESPACE mytsDROP (FILE 'cont2')


www.decus.de 27-28



Inplace Table Reorganization (Patent Pending)Rows moved within existing table object to reestablish clustering,reclaim free space, and eliminate overflows (only moved rows arelocked)

Can start, stop, resume, and pauseAdvantages over the Shadow Table Approach:

Minimal extra storage requirement (shadow table approach typicallyrequires double the space)Incremental: benefit of effects seen immediately (unlike shadowtable approach where benefits only seen after completion)No quiesce for 'switch over' at end

Table available forTable available forfull S/I/U/D accessfull S/I/U/D access

during reorgduring reorg

Online Table Reorganization



Online Table Reorganization

� � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ��

� � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ��

VACATE PAGE RANGE: MOVE & CLEAN to make space

FILL PAGE RANGE: MOVE & CLEAN to fill space in index order

� � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ��

freespace

TIME


www.decus.de 29-30



"REORG Indexes"Shadow index is created concurrent with normal database updatesWhen index creation is complete, old index is swapped out for thenew

final synchronization via DB2 log fileFull read/write access to table & index during index reorganizationTemporary space required to build or reorganize the new index

BenefitsTable is never "offline" from user or batch access

no more weekend reorgs to ensure end users always haveaccess

Compacted index pages improves Performance

DB2 log

end user update

DB2 table table index shadow index

Online Index Creation / Maintenance



Tablespace available for full accessExisting table/index data available for read accessASTs refreshed incrementally

Incremental maintenance of Immediate ASTs on Load APPENDDeferred incremental AST (via staging table)

Online Table Load and Incremental AST Maintenance

Tabl eavai l abl ef or r ead

accessdur i ng l oad

append

I nser t ed dat avi si bl e when

l oad compl et es( or const r ai nt s

checked)


www.decus.de 31-32



RUNSTATS Enhancements

Enhanced featuresCollect additional statistics, such as statistics on columncombinations, and prefetching statistics on the table, index, andindex-to-table relationshipAccept a list of index namesAccept a list of columns on which statistics are to be collectedAccept distribution statistics limits: NUM_FREQVALUES andNUM_QUANTILES values at the table level (without having tochange the configuration parameters, and then disconnect andreconnect all users)Accept individual column NUM_FREQVALUES andNUM_QUANTILES valuesPerform a faster (sampled) collection of DETAILED index statistics










www.decus.de 33-34



Robuste e-business Infrastruktur

Installation

DB2 ClientVollständig überarbeitetConnection Concentrator

Multidimensionales ClusteringSchnellere Abfragen

Automatic Summary Tables/Materialized Query TablesNicht nur "Summaries" auch Joins...Inkrementelles Update

Null & Default KomprimierungMinimiert Festplatten Bedarf



What's New in V8 Installation, Up and Running

t

DAS (DB2 Administration Server) is no longer based on an instance(dasicrt, dasidrop or dasilist have been replaced with dascrt,dasdrop anddaslist).Java based GUI install for all products/platformsAbility to uninstall individual products and componentsImproved ability to diagnose problems through improved tracing andadditional loggingAbility to save an install session in a response file


www.decus.de 35-36



Unix Multiple FixPaks

Support Co-existence of DB2 GA and different FixPak levels on thesame Unix workstation

For testing fixes before replacing in production DB2 code levelFor supporting multiple development groups requiring different levelsof DB2

V8 ImplementationCan think of each as a "mini-release"Two FixPaks will be created at FixPak releaseThey are identical in terms of contents and code level.Regular FixPak - this is business as usualAlternate FixPak

Full install image at FixPak code level (not a delta) - equivalent toGA plus regular FixPak (which is a delta)Installs to a different pathHas different fileset/package nameBuilt-in rpath is modified so DB2 will find the right binaries



64-bit Support

Full 64-bit databaseLarger buffer pools, sort heap, other resourcesAIX, Solaris, and HP-UX was supported as of Version 7.1

64-bit Product AIX SUN HP Linux(Intel)

Windows

Personal Edition N/A N/A N/A yes yesWorkgroup Edition no no no no noEE / ESE yes yes yes yes yesConnect Enterprise yes yes yes yes yesApp. Dev. Client yes yes yes yes yesAdministration Client yes yes yes yes yesRuntime Client yes yes yes yes yesDB2/Informix Connectors yes yes yes yes yesSpatial Extender yes yes yes yes yes


www.decus.de 37-38



Connection ConcentratorN:M architecture is very efficient and supports 1000s of concurrent connectionsFast performance, less memory utilization, and total cost of ownership savingsEnable by setting MAX_CONNECTIONS > MAX_COORDAGENTS, e.g.:

UPDATE DBM CFG USING MAX_CONNECTIONS 5000 MAX_COORDAGENTS 500

N Client Connections

� � � � � � � � � � � ��

Page Cleanersand Prefetchers

Tablespaces

Bufferpool(s)

N CoordinatorAgents

N Client Connections

f(N) Subagents

� � � � � � � � � � � ��

Page Cleanersand Prefetchers

Bufferpool(s)

K CoordinatorAgents

f(K) Subagents

Tablespaces

Client Unterstützung



Engine Enhancements

Type 2 Indexesprereq for online reorg

Prefetching Enhancementsprefetching can exploit block based buffer poolswill use block I/O instead of prefetching pages

NULL and Default value compressionreduce storage for typical data warehousing scenarios - sparsetablesincrease performance of large scans


www.decus.de 39-40



QUIESCE allows administrators to force all users off theinstance/database and put it into a quiesced mode.

SYSADM, SYSMAINT, and SYSCTRL will always have access toinstance while it is quiescedSYSADM and DBADM will always have access to database while it isquiesced.

UNQUIESCEGRANT/REVOKE QUIESCE_CONNECT command

Only users with authority in this restricted mode are allowed toattach/connect to the instance/database.

Commandsdb2start admin mode <user userid | group groupid>db2 quiesce <defer | immediate > <force connections><instance instance_name>

for < user user_id | group group_id>db2 quiesce <defer | immediate > <force connections><database database_name>db2 unquiesce <instance instance_name | databasedatabase_name>

Maintenance Mode: QUIESCE



Complete Split of db2diag.log into 2 separate logs:db2diag.log - intended for IBM customer service and L3Administration notification log (admin log)

intended for end users (DBAs and sysadmins)Administration notification log is NLS-enabled and translated intoinstallation languageUse NOTIFYLEVEL database manager configuration parameterfor granularity control of administration information that is logged(like DIAGLEVEL for db2diag.log)

Diagnostic Logging EnhancementsNOTIFYLEVEL Description

0 Disables admin notification logging.

1 IT'S TOO LATE - This level is reserved for logging fatal and/or unrecoverable errors. It ispossible that some of these conditions would require assistance from DB2 service.

2 IMMEDIATE ACTION REQUIRED...OR IT COULD GET WORSE - This level is for thoseconditions that require immediate attention from the SYSADM or /DBA.

3 IMPORTANT INFORMATION, BUT NO IMMEDIATE ACTION IS REQUIRED -This levelis for non-threatening conditions that do not mandate immediate action, but may indicatea sub-optimal system

4 FOR YOUR INFORMATION - Routine information that can often be safely ignored.


www.decus.de 41-42



Backup, restore and rollforward

RestoreCode page independent restore.

For example, restore 819 database on 850 system.Table space recovery

Only the log files required to recover the table space are processed.Rollforward will skip over log files that are not required.

Rollforward does not request that the user exit retrieve them.Rollforward to localtime

Allows the user to rollforward to a PIT that is local time versus GMT time.Planned improvement via FixPaks

Backup compression.Please check the description of this in the FixPak release notes for further details.



Logging

Dual loggingIntroduced in V7.2 (V7 FixPak 3) - UNIX only

Set registry variable NEWLOGPATH2 to yes to enable.Second log path defaulted to value specified in logpath with '2' appended.

In V8All platforms are supported.Second log path enabled and configured via DB configuration parameter mirrorlogpath

If set, dual logging is enabled when database is activated.Changes in the value take effect at next database activation.

Migration considerations from V7:The derived path name for the second log path will be moved to mirrorlogpath

Value will be value in logpath with a '2' appended if NEWLOGPATH2 was yes in Version 7.

V8 increase max log space from 32 to 256 GBSupport more active transactions and longer running transactions that do more work.

Logging scalabilityEnhanced log bandwidth (parallel I/O on the log)


www.decus.de 43-44



Logging (con't)

Infinite active logIn V8, an active unit of work can span an infinite number of logs and there is no logging limit to the number of concurrent units of work.

Concurrent units of work are no longer limited by the size of the primary log (logprimary x logfilesiz).

Enable this by setting secondary log files (logsecond) to -1.Usage considerations:

The user exit to archive logs must be active and capable of handling the storage of the logs.Rollback and crash recovery may require that archived logs be retrieved.Watch for:

Long running, mostly inactive applications that hold the active log space. These are more likely in development when a commit may not be issued.

A warning is written to the administration notification log when current units of work exceed primary log allocation.



Logging (con't)

Planned improvements via FixPaksTwo new database configuration parameters

numlogspan- Number of logs spanned.Number of active log files one active unit of work is allowed to span.Can prevent long running mostly inactive applications.

maxlog - Maximum log per transaction.Maximum active log space consumed by one unit of work as a percent of primary log space.Similar to maxlocks, this will limit the amount of log space a unit of work can consume.

Please check the description of these in the FixPak release notes before utilizing them.There may be minor changes made during their implementation.


www.decus.de 45-46



SQL Enhancements

Merge SQL (UPSERT)Ability to update base tables with transaction data from another table(MERGE into...)

An UPDATE operation for those rows already existing in themaster tableAn INSERT operation for those rows that do not exist in themaster table

Insert through UNION ALLSeparate tables can be included in a view, but maintained as onetableAbility to "partition" data across different tables

Instead of Triggerscontrol update, delete and inserts against Views instead of basetables

Informational Constraintsgive DB2 information about constraints found in the data, rather thanhaving DB2 maintain themcan result in better optimization decisions

SQL in User-Defined Functions (Insert, Update, Delete)



Snapshot table functions

Common DB2 API commandsmany table functions are now available to check the status of DB2objects

Sample Table FunctionsSNAPSHOT_AGENT(<dbname>, <partition>)

Returns agent information from application snapshotSELECT AGENT_ID FROM

TABLE(SNAPSHOT_AGENT('MYDB', 0)) AS S;

SNAPSHOT_APPL(<dbname>,<partition>)

SNAPSHOT_BP(<dbname>, <partition>)

SNAPSHOT_CONTAINER(<dbname>, <partition>)


www.decus.de 47-48



Provides range partitioning on multiple dimensionsReduces need for indexing (including clustered indexes),reorgainzations, and index maintenance

CREATE TABLE MDC1 (Date DATE,Region CHAR(2),Color VARCHAR(10),YearAndMonth generated as INTEGER(Date)., . )

ORGANIZE BY DIMENSIONS (YearAndMonth, Region, Color)

Region

Year

East

97

East North South West

98 99 99 00

Prior to MDCClustering in one dimension onlyclustering NOT guaranteed(degrades once page free space isexhausted)

Region

Year

All records in this blockare from the East regionand from the year 97

With MDCClustering guaranteed !

Smaller indexesFaster query response

Simple definition syntaxFast roll-in & roll-out

MDC

Multidimensional Clustering (MDC)



SKU Store Date Qty Amt

101 21 04/02 1 1.50101 21 04/02 1 1.50101 21 04/02 3 4.10


101 7 04/01 6 8.11101 7 04/01 2 3.00


101 7 04/02 2 3.00101 7 04/02 1 1.50

Data blocks - without MDC Data blocks - with MDC

keys

rows


101 21 04/02 1 1.50101 21 04/02 1 1.50101 7 04/02 2 3.00101 7 04/01 6 8.11


101 7 04/02 1 1.50101 21 04/02 3 4.10101 7 04/01 2 3.00

A CREATE TABLE optionCo-locates rows with same key values in same data block

Primary & foreign keysTransparent to applications and end user tools

Multidimensional Clustering (MDC)Clustering rows via dimensions


www.decus.de 49-50



Row Indexes -one index entry per row

Block Indexes -one index entry per block

� � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ��

� � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ��

= Row

Multidimensional Clustering (MDC)Row Indexes, Block Indexes










www.decus.de 51-52



ProviderProvider

ConsumerConsumer

SOAPSOAP

DB2…DB2…

Informations IntegrationOptimierter transparenter Zugriff integriert e-business Informationen

Schreib-/Lesezugriff auf verteilte DB2 und IBM Informix IDS DatenbankenSchreib-/Lesezugriff via Web Services

Erweiterte XML IntegrationSQL Funktionen vereinfachen XML VerarbeitungIntegrierte XML Schema Validierung & XML Transformationen via XSLTFlexible Speicheroptionen, Federated Sources / DestinationsWebSphere Studio bietet DB2 XML Productivity Tools

Replikation

Informations IntegrationInformations Integrationvereinfacht dievereinfacht die

AnwendungsentwicklungAnwendungsentwicklung



Convenient, transparent, high speed data accessUniform Access

Connect From Anywhere, To AnywhereUniform Functionality

Regardless of Data SourceUniform Performance where possible

Informations Integration - Was ist Federated Access?

Databases-Datamanagement

Oracle

DB2

Teradata

AsingleDBMSimage

� � � � � � � �

� � � � � � � �

� � � � � � � �

� � � � � � � �

Flat ASCIIData-Files

HierarchicalASCII

Data-FilesIntegration


www.decus.de 53-54



Oracle

DB2 UDB

Informix,Sybase,MicrosoftSQL Server

Query processorQuery processorParserParserSemantic processorSemantic processorOptimizerOptimizer

Execution engineExecution engineSort engineSort engineResidual predicateResidual predicate

CatalogCatalogData managerData managerLockingLockingLoggingLoggingBuffer managerBuffer manager

Client accessClient access

Transaction CoordinatorTransaction Coordinator

Query gatewayQuery gatewayInterface to sourcesInterface to sources Supports Advanced SQLSupports Advanced SQL

Recursive SQLUser Defined FunctionsCommon Table Exp.

DB2 SQLDB2 SQL

LifeSciencesDatabases

Informations Integration - Federated Databases



CREATE NICKNAME O_EMP FORDB2OS390. J15USER3. EMP

SELECT

O_EMP. EMPNAME, S_OFFI CE. OFFI CENO

WHERE

O_EMP. EMPNO= S_OFFI CE. EMPNO

A table EMP exists on DB2 for OS/390

EMPNO EMPNAME

100200300400500

Owner is J15USER3

Smi t hJonesAdamsMi l l erBennet t

A table OFFICE exists on Informix:

EMPNO

100200300400500

OFFICENO

C200C202C204C206C208

Owner is J15USER1

CREATE NICKNAME S_OFFICE FORI NFORMI X. J15USER1. OFFI CE

Smi t hJonesAdamsMi l l erBennet t

EMPNAME OFFICENO

C200C202C204C206C208

"Live", high-performance retrieval of data from multiple DBsApplication sees a single database

Other data sources can be accessed using Table FunctionsBroad source selection (e.g. OLE DB Table Functions)

Informations Integration - Federated Databases


www.decus.de 55-56



SERVERCLIENT

Data management client

Customer client application

SQL(X)

XQuery

DB2 Server

XMLInterface

RelationalInterface

XMLStorage

RelationalStorage

Object–relational implementation (present)Store,retrieve,compose,decompose,validate,extract,transformStorage options

Store intactStore as a collection of columns

Hybrid XML-relational store (future)SQL or XQueryXML capabilities inside the engine

XML specific storage,query,indexing,privileges,transformation,schema,interfaces,searchCarries DB2 UDB engine coreattributes:scalability,availability,reliability,manageabilityPlus performance

SERVERCLIENT

Data management client

Customer client application

SQL DB2 Server

XMLExtender

RelationalInterface

RelationalStorage

With XMLExtenderUDFs and SPs

Informations Integration - DB2/XML Technology -Present & Future



PerformanceMulti-threaded transaction based CaptureMultiple Capture SchemasReduced need for joins

UsabilityNew Replication Admin featuresMonitoringLess rules, product more adaptiveLong name support

ReliabilityEmphasis on continuous operationImproved restart and failure algorithms

ServiceabilityDynamic Trace Facility

SecurityImproved password management

Target DB

DB2DataPropagator

Apply

CAPTUREDB2

StagingTables

DB2DataPropagator

DB2 Family

SourceData

Informations IntegrationReplication Enhancements


www.decus.de 57-58



cmdsthread

monitorthread

lockingthread

Tx1: insert T1Tx2: update T2Tx3: delete T1Tx2: update T2Tx1: commitTx3: undo T1Tx3: rollback...

LOG

Capture program

1018 1000 I - 5

commitseq intentseq OP xc1 c1

T2CDT1CD

Tx2: update T2Tx2: update T2

Tx3: delete T1Tx3: undo T1Tx3: rollback

Tx1: insert T1Tx1: commit

pruningthread

logreaderthread

MONITOR

TRACE

SIGNAL

tran statsmemory statslatency stats

Capture tables

I - 5

OP xc1 c1

U 5 8

uowid commitseq

1 1018 ' bour bon'

authidUOW

Main process threadHandles commandinputStarts other threads

Multi-Threaded Capture

A



DB2DB2� � � � � � � � � � � � � � � ��

� � � � � �� Private UDDI

Public UDDIs

EmployeeTable

Dept Table

Stored Procedure "A"Stored Procedure "A"

Stored Procedure "B"Stored Procedure "B"

XMLXMLExtenderExtender

XMLXMLExtenderExtender

Generic SPGeneric SPInvokerInvoker

Generic QueryGeneric QueryInvokerInvoker

SO

AP

Ro

ute

rS

OA

PR

ou

ter

Virtual WebVirtual WebDataData

ServiceProviders

SOAP Requests/Replies

SOAPSOAPClientsClients

DB2DB2ClientsClients

Informations Integration - DB2 Web Services


www.decus.de 59-60




Robuste e-businessRobuste e-businessInfrastrukturInfrastrukturLeistung, Skalierbarkeit,Plattformen,Verfügbarkeit...







Entwickler Produktivität

Development CenterWizards vereinfachen Entwickleraufgaben

Java & SQL Stored ProceduresUser Defined Functions (Tabellen, MQ Series Messages, OLE DB Quellen, XML Dokumente

Add-ins zu gängigen Entwicklungsplattformen bietennahtlose Integration

WebSphere StudioMicrosoft Visual C++, Visual Basic, Visual InterDev

Verbesserte SQL Hilfen

Zahlreiche SQL Erweiterungen


www.decus.de 61-62



IBM WebSphere Lösung



Package Support

Version Identifier for packagesallows different "versions" of the same package to exist in thedatabaseproduction plan can be different from test planexplain output will identify which version of a plan is being used

New command to flush current active package cacheFLUSH PACKAGE CACHE


www.decus.de 63-64



DB2 Version 8

DB2 Strategie

DB2 Version 8: Überblick und Neuheiten

Weitere Neuheiten aus der DB2ProduktfamilieDB2 EveryplaceDB2 Warehouse ManagerDB2 Olap Server

Führende Technologie für Informations-Managementund -Integration



DB2 Everyplace V8.1

Die relationale Datenbank für den mobilen EinsatzDie relationale Datenbank für den mobilen Einsatz

KomponentenDB2 Everyplace Datenbank

nur ca. 180 KB großkein Administrationsaufwand

DB2 Everyplace Sync ServerJDBC kompatiblen Datenquellen, DateienLotus Domino Datenbanken (neu)

DB2 Everyplace MobileApplication Builder

Neu in Version 8.1Anwendungsentwicklung

neben Java und C/C++ jetzt auch mitVisual Basic, WebSphere Studio, Appforge

Verschlüsselbare Tabellenmehrere DB-Verbindungen & Wahl des Zielverzeichnisses

Server Plattformen:AIXLinuxWindows NT/2000/XPSolaris (beta)

Client Plattformen:Palm OSWindows CE/Pocket PCSymbian V6QNX Neutrinoembedded Linux, LinuxWin32 (XP) undJ2ME MIDP

DB2EveryplaceDatenbank

DB2 UDB,JDBC oder

eigeneDaten

Quellen

MobileEndgeräte

SynchronisationsServer

DatenQuellen

ibm.com/software/data/db2/everyplace

DB2Everyplace

SyncServer


www.decus.de 65-66



DB2 Warehouse Manager V8.1

Erweitert die integrierte Data Warehousing FunktionalitätErweitert die integrierte Data Warehousing Funktionalitätvon DB2 für komplexere Umgebungenvon DB2 für komplexere Umgebungen

DB2 Warehouse Mgr. StärkenErweitert Funktionen desDB2 Data Warehouse CentersAgentenbasiertes ETML ToolIntegrierte Metadatenverwaltung

Neu in Version 8.1DB2 ESE Split & Load

schnelles Laden in multi-Partition Tabellen

Warehouse Server auf AIXbisher nur Windows NT/2000

Neuer Linux AgentSQL Update Fähigkeit

kombinierter Update/Insert

ibm.com/software/data/db2/datawarehouse



DB2 OLAP gibt Endbenutzern die analytischenDB2 OLAP gibt Endbenutzern die analytischenMöglichkeiten, die sie benötigenMöglichkeiten, die sie benötigen

DB2 OLAP Server StärkenRAMP - Report, Analyze, Model, PlanFlexible NavigationLeistungsfähige BerechnungLese- und SchreibzugriffZahlreiche Endbenutzer Tools

Neu in Version 8.1Hybrid OLAPParalleles Laden und BerechnenAdministration ServicesEnterprise Services with High Concurrency Option

DrillDrilldowndown

multidim.aggregiert

relationalerDetail Level

Star-Schema

Detail Daten

DrillDrillthroughthrough

ibm.com/software/data/db2/db2olap

DB2 OLAP Server V8.1


www.decus.de 67-68



Erkennt Muster und Zusammenhänge in großen Datenbeständen fürErkennt Muster und Zusammenhänge in großen Datenbeständen fürTarget Marketing, Kundensegmentierung, -bindung, -rückgewinnung,Target Marketing, Kundensegmentierung, -bindung, -rückgewinnung,

Cross-Selling, Betrugs- und Mißbrauchserkennung etc...Cross-Selling, Betrugs- und Mißbrauchserkennung etc...

DB2 Intelligent Miner StärkenVielfältige Mining Algorithmen

ClusteringKlassifikationAssoziationsanalyseWerte VorhersageZeitreihenanalyse

ParallelverarbeitungReal-Time Scoring

NeuIntelligent Miner ModelingIntelligent Miner ScoringIntelligent Miner Visualization

ibm.com/software/data/iminer/fordata

Yes!

Yes!Yes!

Yes!Yes!NO

NO

NO

NO

NO

NO

??

NO ??

DB2 Intelligent Miner for Data Version 8.1



DataStorage

AdvancedAnalysis

ApplicationEnablement

JavaIntegration

DataIntegration

WebServices

ContentManagement

PervasiveComputing

WarehouseCreation &

Mgmt.

SelfManaging

PlatformExploitation

XMLIntegration

InformationIntegration

DB2 UDB

Die Rolle von DB2 - mehr Daten...einfacher verwaltenUnterschiedlichste AnwendungenSkalierbarkeit, Performance undVerfügbarkeit

Leichte Einsetzbarkeit &BenutzungTotal cost of ownership


www.decus.de 69-70

Mehr Daten… Einfacher verwalten

Documents

Transcript of Mehr Daten… Einfacher verwalten