DBMS Migration Case Study of the Total Information System … · 4 /27 Current Status of SeoulTech...
Transcript of DBMS Migration Case Study of the Total Information System … · 4 /27 Current Status of SeoulTech...
DBMS Migration Case Study of the Total
Information System (TIS) for Seoul
National University of Science & Technology
(SeoulTech) Mar 25, 2015
© 2015 TmaxSoft Co., Ltd. All Rights Reserved.
TIS DBMS Migration Background and Review of Tibero Ⅱ
TIS DBMS Migration Ⅲ
Introduction to SeoulTech Ⅰ
2015 First-Semester Class Registration Result Ⅳ
Conclusion Ⅴ
3/27
Introduction to SeoulTech
Established as Vocational Supplementary School by Emperor
Gojong’s royal decree
Reorganized as Gyeonggi Technical College and relocated to the current location
Renamed as Seoul National Industrial University
Renamed as Seoul National University of Science & Technology (SeoulTech) in
celebration of the 100th anniversary of
the school’s foundation
Transitioned to a comprehensive university
1910
1980
1988
2010
2012
“Striving for the Future” SeoulTech
Your Future, Our Vision
Progressing with Korea’s scientific and technological development for over 100 years
4/27
Current Status of SeoulTech
SeoulTech, a national university located in Seoul with 105 years of history, plans to raise its university
ranking to top 10 in Korea and top 50 in Asia by 2020.
• Ranked 2nd among national universities in Korea by
JoongAng Daily
• Ranked 2nd in Korea (42nd in Asia) in 2014 QS
University Rankings among specialized universities
• Ranked 1st by National Research Foundation of
Korea in 2014 for the number of research papers
published per professor
• Ranked 2nd in employment rate at 62.5% in Korea
for schools with between 2,000 and 3,000
graduating students
• National university located in Seoul
• Total number of people: 13,324 ( as of March 2015)
- Undergraduates: 10,958, Graduates: 1,630
- Instructors: 384, Staff: 267, TAs: 85
TIS DBMS Migration Background and
Review of Tibero
• TIS DBMS Migration Background
• Tibero Verification for DBMS Migration
Ⅱ
6/27
TIS DBMS Migration Background
SeoulTech’s Total Information System was originally built with Oracle. The school decided to migrate its
system to Tibero due to additional costs incurred from changes to Oracle’s license policy, and the
Korean government’s push towards use of domestic software.
DBMS Migration Overview
Korean Software Adoption Policy
Ministry of Science, ICT and Future Planning report to the President in April, 2014 - The main priority of the ICT policy is to develop core software technologies.
Oracle Tibero
3-1. Fostering software, the language of the 21st century, as a core industry [statute 11] Secure the world’s best software competitiveness through the advancement of software industry support system, and by finding, developing, and nurturing promising software companies. 1. Lead the way for fair pricing enforcement of domestic software through policy advancement starting with the public sector. - Strengthen monitoring of distributors for adhering to new laws such as restrictions on participation of large companies in public software projects, enforced by the Software Industry Promotion Act passed in May, 2012. - Increase software purchases by supporting distributors, promotion of excellent commercial software, and improving user recognition. -Expand growth capacity of companies through proper recognition of Korean software value. - Support fair software trade practices and improve quality by changing the hierarchical relationship between large, small and mid-sized companies to a mutual relationship.
7/27
Tibero Verification for DBMS Migration
Past Tibero case studies were reviewed before migration, and adaptability was confirmed through
Tibero training. Product reliability was also verified through a PoC test with the class registration
system.
Tibero Review
Training for Administrators & Developers
• National Education Training Institute’s
Integrated Training System
- Provides online/offline training to 700,000
teachers and staff in elementary, middle, and high
schools
- Maximum concurrent access: 25,000 users
- Daily average access: 90,000
• Hankyong National University Administrative
System
- Oracle license issues rose during development of
the administrative system
- Rapidly migrated the system from Oracle to
Tibero
- Some initial issues were completely resolved
• Training for Administrators
- Training process for Tibero DBAs
- Theoretical and practical training
- Duration: 2 days (10 hours)
• Training for Developers
- Training process for Tibero developers
- Theoretical and practical training
- Duration: 1 day (5 hours)
• Tibero POC Test
- Conducted in advance to verify Tibero’s
reliability
- Performed POC with the class registration
system
- Formed a TFT consisting of TmaxSoft
personnel and information & computing
center personnel
• DBMS Tuning
- Performed DBMS tuning to provide
optimized performance for business unit
systems
Ⅲ TIS DBMS Migration
• Migration Steps
- Pre-Analysis
- Execute Migration
- Verify Migration
- Complete Migration
9/27
TIS DBMS Migration - Migration Steps
Migration was carried out in pre-analysis, execution, verification, and completion steps.
Migration Steps of the TIS DBMS
Pre-analysis
• Analyze HW Environment
- Server system
- Integration system
• Analyze Oracle Environment
- Data size (in bytes)
- Number of objects, and programs
• Analyze Application
- Languages and number of
applications
- Functions, and procedures
•Analyze 3rd Party Solutions
- Analyze DBMS Integration
solutions
• Develop/Confirm Migration Plan
- Select migration targets and set
schedule
- Assign technical support
personnel
Execute Migration Verify Migration Complete Migration
• Migrate DBMS
- Configure test migration
environment
- Migrate Oracle objects
- Migrate Oracle data
• Migrate Applications
- Change JDBC/ODBC drivers
- Change some functions and SQL
- SQL tuning
• Migrate 3rd Party Solutions
- Change JDBC/ODBC drivers
- Change options
- Performance tuning
• Migrate Operation
- Migrate operational data
- Application integration
- 3rd party integration
• Monitor System
- Monitor system and perform
tuning
• Stabilization and Training
- Technical support
- Training support
- Maintenance
• Test Application Units
- Test application screens
- Test application functions
- Test application performance and
perform tuning
• Test System Integration
- Class registration system BMT
- Test compatibility with other
integrated systems in the school
- Measure performance and
perform tuning for the entire total
information system
10/27
TIS DBMS Migration – Pre-Analysis (Selecting Target Systems to Migrate)
Systems, excluding ERP, that use Oracle such as the total information system, electronic approval
system, and archives have been migrated to Tibero.
Target Operations for Migration
Before Current
TIS
(Including Academic System)
Archives
Electronic Approval System
DW (Statistics)
ERP (Administrative
Information System)
Systems that use Oracle DBMS
TIS
(Including Academic System)
Archives
New Homepage New Portal
Electronic Approval System
DW (Statistics)
ERP (Administrative
Information System)
Migration to Tibero DBMS
To be discontinued after completing development of the Ministry of
Education’s Resource Management System
11/27
TIS DBMS Migration – Pre-Analysis (Migration Schedule)
Starting from September 2014, it took 3 months to successfully migrate DBMS, applications, and 3rd
party solutions of the target system according to the following schedule.
Migration Schedule
Type September October November December
DBMS Migration
DBMS Verification
Compatibility Verification
Performance Verification
Operation Migration
12/27
SeoulTech’s information & computing center in collaboration with TmaxSoft, who has abundant
experience in Oracle migration, successfully migrated the university’s TIS.
Migration Type
Objects and Applications Migration Method Conducted By
DBMS Migration
Table, view, synonym,
trigger, etc.
Automatically migrate using tbMigrator
(domain index, user defined-types need
to be migrated after modifications are
made)
TmaxSoft
Procedures, functions Automatic migration using tbMigrator TmaxSoft
Data Migration Migrate using Table Migrator TmaxSoft
Application Migration
JAVA Modify queries and sources after
reconfiguring JDBC
• Functional and compatibility test: Information & computing center
• Source modification and performance verification:
Information & computing center
• SQL performance tuning: TmaxSoft
3rd Party Solutions Modify DBMS connection configuration
and perform integration test
• DBMS connection configuration: 3rd party solution engineers
• Integration Test: 3rd party solution engineers
TIS DBMS Migration – Execution
13/27
TIS DBMS Migration – Execution (DBMS Migration)
A DBMS for test purposes was developed to migrate DBMS and for compatibility test. A copy of the
operational data was used to avoid interfering with application operation and data, and a free
automatic migration tool was provided by Tmax to migrate Oracle objects and data.
Development of Test Purpose DBMS
Disk
Oracle DBMS
Oracle data & object
copies
Disk
Oracle DBMS
Oracle operational data & objects
Tibero DBMS
Tibero data & objects
for testing
Operation Administrator
① Generate a copy of the operational data
②Migrate Oracle objects
Test Engineer
In operation
Testing
Production Server Test Server
Need Tibero storage space
tbMigrator
Table Migrator
Parallel Process ③ Migrate Oracle data
14/27
TIS DBMS Migration – Execution (DBMS Migration Result)
The DBMS migration result showed a successful DBMS migration of TIS from Oracle to Tibero.
Operation Migration Result
System Obejct Oracle Tibero System Obejct Oracle Tibero
Total Information
System
TABLE 2040 ▶ 2040
Electronic Approval
TABLE 184 ▶ 184
INDEX 2071 ▶ 1909 INDEX 270 ▶ 270
VIEW 576 ▶ 576 VIEW 7 ▶ 7
MVIEW 17 ▶ 17 TRIGGER 35 ▶ 35
SYNONYM 176 ▶ 176 FUNCTION 54 ▶ 54
TRIGGER 1154 ▶ 1154 SEQUENCE 17 ▶ 17
FUNCTION 759 ▶ 759 PROCEDURE 8 ▶ 8
SEQUENCE 204 ▶ 204 PACKAGE 18 ▶ 18
PROCEDURE 253 ▶ 253
Archives
TABLE 143 ▶ 143
DW
TABLE 1240 ▶ 1240 INDEX 160 ▶ 160
INDEX 1091 ▶ 1091 SYNONYM 33 ▶ 33
VIEW 233 ▶ 233 TRIGGER 8 ▶ 8
MVIEW 175 ▶ 175 FUNCTION 4 ▶ 4
FUNCTION 47 ▶ 47 SEQUENCE 4 ▶ 4
PROCEDURE 241 ▶ 241
※ For TIS, the domain index used in the encrypted solution was not included in the migration.
15/27
TIS DBMS Migration – Execution (Application Migration)
Since Tibero supports most embedded functions and SQL supported in Oracle, applications running on
Oracle DB can be migrated simply by changing the JDBC driver without source modification.
Application Migration
Key SQL Key Embedded Functions
Type Supported Functions
Group AVG, COUNT, MAX, MIN, STDDEV, SUM, VARIANCE
Number
ABS, ACOS, ASIN, ATAN, CEIL, COS, EXP, FLOOR, TAN,
GREATEST, LEAST, LN, LOG, MOD, POWER, SIGN, SIN,
SQRT, TTRUNC
Character
ASCII, CHR, CONCAT, INITCAP, INSTR, INSTRB, LPAD,
LENGTH, LOWER, LTRIM, NLS_LOWER, NLS_UPPER,
NLSSORT, AREPLACE, RPAD, RTRIM, SUBSTR, SUBSTRB,
TRANSLATE, TRIM, UPPER
Date ADD_MONTH, EXTRACT, LAST_DAY, NEXT_DAY, ROUND,
SYSDATE, +, -
Other ROLLUP , DECODE, DUMP, NVL, NVL2, ROWNUM, RANK,
LEAD/LAG, ROW_NUMBER, PIVOT, CUBE
Type Supported SQL
Join Equi, anti, wemi, self, cartesian, inner, outer, (+)
Sub Query In-line view, nested query
Condition ANY, SOME, ALL, BETWEEN, EXISTS, IN, NULL, LIKE,
REGEXP_LIKE
Consistency Read committed, select for update, serializable
Other
Hierarchical queries (Start with ~ Connect by ~)
Parallel DML (Insert into ~ Select ~)
Dual table, CALL, merge, create table as select
PL/SQL
Basic blocks : BEGIN ~ END, DECLARE
Exception handling : EXCEPTION
Conditionals : IF THEN ELSE, ELSE IF, CASE ~ WHEN
Loops : FOR LOOP, WHILE LOOP, EXIT
Others: PROCEDURE, FUNCTION, PACKAGE, TRIGGER
Excellent Compatibility Proven in Migrating Applications from Oracle to Tibero
16/27
TIS DBMS Migration – Execution (Migrating 3rd Party Solutions)
The following table shows the integration status of SeoulTech’s 3rd party solutions. Although some
solutions had issues during the integration process, they were all resolved through Tmax’s proactive
technical support.
Solution Product Integration Key Issue Resolution
Data Encryption CubeOne Complete Cannot encrypt/decrypt • incorrect ODBC driver
Replaced the ODBC driver
WAS WebLogic 8.1 Complete Unnecessary DBMS locking with
Java applications
• missing Java application session disable routine.
Added resource cleanup routine
DW IBM Cognos 10.1.1 Complete
Cannot connect to Tibero • incorrect ODBC driver
Replaced the ODBC driver
Broken Korean characters • Missing the Cognos character set unicode configuration
Added unicode setting
ETL Tools BTL Data
Integrator Server 3.8 Complete
Cannot integrate with Tibero as the product is outdated
• Modified JDBC
Web Accelerator A10 networks
AX1000 Complete
- -
Electronic Approval/ Archives
Hi-Express V3.1 Complete Cannot integrate 3rd party
solution • Resolved with the help of the solution vendor
Homepage Search
XTEN v3.0 EE Complete Cannot integrate 3rd party
solution • Resolved with the help of the solution vendor
17/27
TIS DBMS Migration – Verification (Integration with Other Systems)
After migration, Tibero’s DB Link was used to successfully integrate TIS with other systems.
Integration with Other Systems via DB Link
Gateway Convert and send queries of the target DBMS
Convert results into Tibero data types Return converted data
Remote Database
Industry-Academic Cooperation
Library
Client
Standard Interface
Tibero
Send queries
Tibero to Oracle
Gateway Tibero gateway for Oracle
Gateway Method Local or listener method
Supported Language C, JAVA
Query support O
DML support O
JOIN support O
global tx support O (Oracle OCI)
Oracle
Heterogeneous Service
Oracle Gateway for ODBC Agent
Oracle 10g
HSODBC
Oracle 11g
DG4ODBC
Tibero ODBC Driver
Tibero
Client
1. Binaries are provided for each version
- 10g : HSODBC, 11g : DG4ODBC
2. Only supports local method
- General gateway must be installed on Oracle DBMS server
3. Distributed transaction(2PC) is not supported
4. BLOB/CLOB are not supported
Limitations of Oracle DB Link
18/27
TIS DBMS Migration – Verification (Class Registration Performance Test)
Using SeoulTech’s class registration system, approximately 5,000 students concurrently registered for
classes by dividing the school’s 11,000 students into two groups including 1st and 4th year students,
and 2nd and 3rd year students. The test was performed based on the maximum concurrent access of
1,000.
Item Description
Performance Test Tool WebLOAD (Web program performance test tool from Israel’s RadView)
Test Method Used 7,200 student IDs, each student registered 5 classes for 5 minutes.
Test Scenarios
Scenario 1
Scenario 2
Test Environment
Class Registration Test Server
Oracle DBMS
Tibero DBMS
WEB/ WAS
4 Load Generators
Test Server Specifications
DBMS Tibero 5 Oracle 9i
Server IBM P6 570 IBM P6 570
OS AIX 5.3 64 bit AIX 5.3 64 bit
CPU 3.5GHz 6-core 3.5GHz 6-core
Memory 23 GB 23 GB
Data Size 58 GB 65 GB
Login Class Registration
Menu Register Classes
View Registration History
Repeated 5 Times
Login Class Registration
Menu Register Classes
View Registration History
Repeated 5 times
19/27
TIS DBMS Migration – Verification (Class Registration Performance Test)
The class registration performance test result showed that Tibero displayed superior performance than
Oracle in average response time, and total number of class registrations for both test scenarios.
Test Result
Item Tibero Oracle
Avg. Response Time 0.83 sec 0.85 sec
Max. Number of Class Registrations Per Minute
21,257 sec 19,158 sec
Total Number of Class Registrations
31,222 sec 30,975 sec
Class Registration Performance Comparison for Scenario 1
Item Tibero Oracle
Avg. Response Time 0.78 sec 0.82 sec
Max. Number of Class Registrations Per Minute
17,664 sec 16,159 sec
Total Number of Class Registrations
31,187 sec 31,007 sec
Class Registration Performance Comparison for Scenario 2
Tibero Oracle Tibero Oracle
Max. Number of Class Registrations per Minute
Max. Number of Class Registrations per Minute
Total Number of Class Registrations
Total Number of Class Registrations
20/27
TIS DBMS Migration – Completion (Operation Migration)
After migrating DBMS, applications, and 3rd party solutions and conducting performance and
compatibility tests, DBMS operation migration was performed with consideration for down-time.
Operation Migration
Disk
Oracle DBMS
Oracle Data & Objects
Before Migration
Disk
Oracle DBMS
Oracle Data & Objects
Migrating Operations
Tibero DBMS
Tibero Data & Objects
Migrate Operations
After Migration
Disk
Tibero DBMS
Tibero Data & Objects
Install Tibero
Need Tibero Storage Space
• Installed Tibero on the server where Oracle DBMS is installed.
• Uninstalled Oracle after completing DBMS migration.
21/27
TIS DBMS Migration - Completion (Customer Appreciation Letter)
I would like to express my gratitude to Ms. Hyeji Jang who has done an amazing job in the Tibero migration project, and to recommend her for employee of the month. I believe that her friendly smiles and hard work were essential to a very successful database migration project. In fact, our staff gave Ms. Jang a nickname, the Tibero mascot. Moreover, all Tmax employees who were assigned to this project did an excellent job, and we would like to thank all of them. Through successful migration of SeoulTech’s database, I hope that many other universities will consider migrating to Tibero. I will be more than happy to promote Tibero. Please include me as a PR ambassador for Tibero.
23/27
2015 First-Semester Class Registration Result
SeoulTech’s class registration system for the first semester of 2015 was performed in two groups,
including 1st and 4th year students, and 2nd and 3rd year students.
Item Description
Class Registration Period
January 19, 2015 ~ January 22, 2015
- Class Registration Phase 1: Performed class registration for 1st and 4th year students.
- Class Registration Phase 2: Performed class registration for 2nd and 3rd year students.
Class Registration
Users
Specifications for Class
Registration Servers
Comparison of Class Registration Server Specifications
Category 2015 First Semester 2014 First Semester
DBMS Tibero 5 Oracle 9i
Server IBM P6 570 IBM P6 570
OS AIX 5.3 64 bit AIX 5.3 64 bit
CPU 3.5GHz 12-core 3.5GHz 12-core
Memory 46 GB 46 GB
Comparison of Number of Class Registrations
Category 2015 First Semester 2014 First Semester
1st & 4th year students 4,516 4,893
2nd & 3rd year students 5,605 5,477
Total 10,121 10,370
24/27
2015 First-Semester Class Registration Result (Compared with First Semester of 2014)
Compared to class registrations during the first semester of 2014, class registrations in 2015 showed
faster and more reliable performance.
Class Registrations of First Semester of 2015
Number of Class Registrations Processed per Minute for 1st and 4th Year Students
Number of Class Registrations Processed per Minute for 2nd and 3rd Year Students
Superior Processing Performance Compared to Oracle Superior Stability Compared to Oracle
Processed more registrations compared to Oracle
during the 1st minute of class registration
Maintained lower number of transactions compared to
Oracle after the 1st minute of starting class registration
2015 1st Semester (Tibero)
2014 1st Semester (Oracle)
1st Semester, 2015 (Tibero)
1st Semester, 2014 (Oracle)
26/27
Benefits
SeoulTech’s TIS DBMS migration to Tibero helped break its dependence on foreign DBMS product and
diversify the DBMS market in Korea, while achieving enhanced system performance and TCO savings.
Benefits of Adopting Tibero
• Huge TCO reduction
compared to other vendors.
• More TCO savings through
continuous use of Tibero.
• Reliable operation of the
academic information
system.
• Reliable operation of major
systems, such as the
homepage and electronic
approval, after DBMS
migration.
• Complete integration with
other academic systems.
• Migrated the information
system built with Oracle to
a domestic DBMS.
• On-site support by technical
personnel during projects.
• Fast and efficient technical
support during failure.
27/27
Conclusion
Standard of excellence!
A new model for national universities in the 21st century, Seoul National University of Science & Technology
“Higher Expectations”
The only national comprehensive university in Seoul - Seoul National University of Science & Technology We aspire to develop future talents through comprehensive education in science, technology, and social sciences, and are different from a countless number of universities that focus on just theory or hands-on learning. We take pride in turning ideas into reality. Seoul National University of
Science & Technology
Pride