MultiDB Stress Testing

6
Test DESIGN DOCUMENT Cross Database Stress Testing

description

Database Testing

Transcript of MultiDB Stress Testing

Page 1: MultiDB Stress Testing

TEST DESIGN DOCUMENT

Cross Database Stress Testing

Page 2: MultiDB Stress Testing

Table of Contents

1. Introduction:..................................................................................................................................3

2. Test Objectives:..............................................................................................................................3

3. Test Requirements:........................................................................................................................3

4. Test Criteria:...................................................................................................................................3

5. Test Data:.......................................................................................................................................3

6. Test System and Configuration:......................................................................................................3

7. Test Cases:......................................................................................................................................4

8. Glossary:.........................................................................................................................................5

9. Appendix:........................................................................................................................................6

Software Testing - Test Design Document

Page 3: MultiDB Stress Testing

1. Introduction:

There is a need to develop stress tests for SAP HANA MultiDB systems. The goal is to create test suite that would focus on stressing cross database querying functionality without duplicating test cases already covered in functional test suites. This test spec defines the test scenarios to be implemented for stress testing for SAP HANA Multi-DB

2. Test Objectives:

Objective is to design test suite that would:

- Add multiple connection stress (10 users)- Add data volume stress (10/100 GB scale)- Test multiple databases

3. Test Requirements:

Stress test suite has to start multiple simultaneous connections in a loop and run queries on multiple databases until the specified time has run out or encounter failure(s).

4. Test Criteria:

Stress test suite PASS criteria is defined as executing SELECT queries without server crash or Hang. If it is noticed that test does not go through execution of queries in specified time (due to machine resource limitation, etc.) then either running time should be increased or the test should exit gracefully.

5. Test Data:

TPCH schema for HANA (SAP-H) will be used for Stress testing.

Small data scales should be used in early stages of test development. Data scale will be increased once test runs successfully.

6. Test System and Configuration:

Initial testing during test development will be done on local HANA workstation having installation of MultiDB

7. Test Cases: SELECT QUERIES

Test Case # Test Case Description Priority(H/M/L)

01 Test Setup: TPCH Schema will be used for Stress Testing.

- Lineitem, Customer, Partsupp , Orders, Nations, Supplier, Region and PART in HANA

H

Software Testing - Test Design Document

Page 4: MultiDB Stress Testing

02 Select on Row/Column table where tables resides on different databases/indexserver hosted on same machine

Testing queries through multiple connections:-        Execute set of below queries :a.      select-from-where queries of supported datatypes on

virtual tablesb.      queries with predicates: IN, EXISTS, LIMIT, DISTINCT,

CASE etc. on virtual tablesc.      queries with HANA predicatesd.      Run queries with HANA set operations: UNION [ALL |

DISTINCT], INTERSECT [DISTINCT], EXCEPT [DISTINCT]e.       Execute queries with Group-by clausef.      queries with HAVING <condition>g.      queries with order by: ORDER BY, ASC, DESCh.       Execute subqueries (Correlated and non-correlated

queries)-        Run these queries randomly through each of

the connections created-        Queries should be executed without any crash and the test should exit gracefully after the designated duration

H

03 Select on table where tables resides on different databases/indexserver hosted on different machine

H

04 Select on table where tables resides on different databases/indexserver hosted on same machine with virtual tables (table exist on IQ/ASE/ORACLE)

H

05 Select on table where tables and tables resides on different databases/indexserver hosted on different machine with virtual tables (table exist on IQ/ASE/ORACLE)

H

Software Testing - Test Design Document

Page 5: MultiDB Stress Testing

8. Glossary:

SAP Database – refers to one of the internal relational databases HANA

External data source – any other database, application, data source provided by a 3rd party vendor or a custom data source

Remote Source – refers to an external data source connected to HANA server

Virtual Table – refers to an object coming from a remote source mapped to a base table in HANA

Software Testing - Test Design Document