OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure...

41
MICHIGAN ORACLE USERS SUMMIT WEDNESDAY, OCTOBER 30, 2019 / 7:30AM – 5:30PM SCHOOLCRAFT COLLEGE – VISTATECH CENTER 18600 HAGGERTY ROAD, LIVONIA, MI 48152 OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS TO REST, ATOM FEED AND SOAP BASED INTEGRATIONS COMPANY: NSF INTERNATIONAL

Transcript of OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure...

Page 1: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

MICHIGAN ORACLE USERS SUMMITWEDNESDAY, OCTOBER 30, 2019 / 7:30AM – 5:30PMSCHOOLCRAFT COLLEGE – VISTATECH CENTER18600 HAGGERTY ROAD, LIVONIA, MI 48152

OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS TO REST, ATOM FEED AND SOAP BASED INTEGRATIONS

COMPANY: NSF INTERNATIONAL

Page 2: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Speakers

Lakshmi Akkena

Sr. Oracle Applications Developer

NSF International

2

Sasanka Reddy Thavva

Sr. Oracle Applications Developer

NSF International

Page 3: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

NSF Overview

NSF’s Mission and History

NSF Systems Architecture

Before & After Moving To Cloud

What Next?

Our Future Direction

Early Design of System Integrations

Asynchronous Integrations

Solution Approaches

SOAP, REST and ATOM Feeds

Q&A ?

Agenda

Page 4: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

NSF OVERIVEW

Page 5: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

A GLOBAL LEADER IN PUBLIC HEALTH AND SAFETY

Page 6: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

NSF

Around

the Globe

2800 Employees

63 Locations

31 Countries

6 Languages

3200 Contractors

71 Countries

Page 7: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Our Mission

NSF International is a global, independent, public health and safety organization.

NSF International is dedicated to being the leading global provider of public health and safety-based risk management solutions while serving the interests of all stakeholders, namely the public, the business community and government agencies.

Our mission and focus has always been protecting and improving human health.

7

Page 8: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

NSF helps people live safer.

We carry out this human health and safety mission by:

STANDARDS CERTIFICATION CONSULTING TRAININGAUDITING

Writing standards to promote food, drinking water,

indoor air, dietary supplements,

consumer products and

environmental safety

Certifying products to these

standards

Conducting safety audits for the

food, water and consumer goods

industries

Providing strategic and technical

consulting for the dietary supplement,

pharmaceutical, medical device,

food and beverage industries

Developing training and education programs

8

TESTING

Testing products to these and other

standards

Page 9: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

NSF SYSTEMS ARCHITECTURE

(BEFORE AND AFTER MOVING TO CLOUD)

Page 10: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Systems Before Moving to Cloud HCM

Oracle EBS

Finance

HR

Core HR Benefits

Performance Management

i-Recruitment

LearningManagement Time & Labor

Employee & Manager Self-Service

General Ledger

Account Payables

Account Receivables

Projects

NSF In-house Applications

ADP(Payroll)

Other Third Party Applications

Active Directory

Compensation Management

EXCEL

Other Third Party Applications

(Concur, Org Publisher, etc.)

Page 11: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Integrations Before Going to Cloud

5 more benefit vendors

SFTP Connection (File based)Web Service Call

Direct DB Connection

Manual File

Page 12: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Oracle EBS

Finance

LearningManagement

Time & Labor

GL AP

AR PA

NSF In-house Applications

ADP(Payroll)

Other Third Party

Applications

ORACLE Cloud HCM

Compensation Management

Performance Management

Core HR Benefits

Employee & Manager Self-

Service

Benefits Vendors (15 Files)

Recruitment

Onboarding

Taleo (TEE)

Absence Management

Active Directory

HR

Talent Management

Mobile Access

Mobile Access

Systems After moving to the Cloud

Other Third Party

Applications

INV

FAPO

Third Party Applications

TCC (Taleo Client Connect)

Page 13: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

SFTP Connection (File based)Web Service Call

Integrations After Going to Cloud

➢ VSP

➢ BCN➢ UNUM➢ Maestro➢ Legal Shield ➢ Basic

Direct DB Connection

Manual File

5 more benefit vendors

Page 14: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

EARLY DESIGN OF SYSTEM INTEGRATIONS(ASYNCHRONOUS INTEGRATIONS)

Page 15: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Fusion to EBS IntegrationsSFTP Connection (File based)

Job Scheduled - 07:00 AM/01:00 PM

PurposeTo maintain Timesheets, Financials and in-house applications

• Synch Employee data (Person, Assignment, Salary etc..) – 10 files• Synch Work Structures data (Job, Location, department & Salary basis)

Design Issues• Fusion - maintenance/outage, BIP jobs failure• Moveit– server busy, outage, delays, network congestion• EBS - maintenance/outage, Concurrent program failure, processing partial data

Job Scheduled - 07:20 AM/01:20 PM

Frequency – 15min

Page 16: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Fusion HCM and ADP US Payroll

Direct DB Connection

SFTP Connection (File based)

Manual File

Design IssuesAs discussed in “Fusion to EBS” integration.If Payroll Team need to run payroll on demand, they need to process 3 more systems

Job Scheduled – Alternate Friday 05:00 AM

Frequency – 15min

Job Scheduled – Alternate Friday 05:20 AM

Page 17: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

EBS To Fusion Integrations

Job Scheduled – 09:00 PM

BI PUBLISHER

Direct DB Connection

Web Service Call

PurposeUpdate email addresses in fusion from Microsoft Active Directory (Active Directory - > Oracle EBS)

Design Issues• HDLDI – limitation to get the status of the request, process subsequent actions and inability to send error

notification.

Job Scheduled –08:00 AM/02:00 PM

HDLDI Tool

Page 18: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Chained Integrations involving Fusion and EBS

Job Scheduled - 11:00 PMJob Scheduled - 11:30 PM

HDLDITool

Job Scheduled – 09:00 PM

Direct DB Connection

SFTP Connection (File based)

Web Service CallFrequency – 15min

Design IssuesAs discussed in both “Fusion to EBS” and “EBS to Fusion” integration slides

PurposeUpdate PTO Balances in fusion from ADP (ADP- > Oracle EBS→Fusion)

Manual File

Page 19: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Lessons Learned

❖ Unable to detect system and program failures.

❖ Asynchronous Communications.

❖ No real time response or Error feedback.

❖ Systems are Distributed.

❖ Architecture limitations to identify data deletion

• Ex:- Assignment , Address, Phone deletions etc

Page 20: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

SOLUTION APPROACHES

Page 21: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Solution Approaches

Synchronous Communications

(Real time Response)

Track Data Changes

Ex: Deletion of Emp Record

Single Source to connect every

System

Web Services (SOAP/REST)

Event Based (ATOM Feeds)

Integration Tool

Page 22: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Integration Tool Approaches

Integration Tool

Third PartyInhouse Integration

Application

Mule Soft

Page 23: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Integration Tool Evaluation - Oracle Cloud Integration (OIC)

Uses a Configuration approach

Provides an intelligent, drag-and-drop data mapping tool

Out-of-the box adapters for Oracle Fusion HCM, Oracle E-Business Suite, SOAP and REST Adapters

Provides pre-built integrations

Offers an online market place to buy and sell integrationsImage Source: Oracle Corporation

Page 24: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Infrastructure Limitations using OIC

1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

2. Install and run OIC agent on on-premise of Oracle E-Business suite.

Pre-Req’s

1. Secured http connection (https) is ONLY supported in ISG of EBS 12.2 and above.

2. We are running on EBS 12.1.3 and it doesn’t support httpS connection. NSF network admin raised concerns calling EBS http connection from cloud (OIC). We need to wait till 12.2 upgrade.

Infrastructure Limitations (HTTPS – Secured Connection)

Page 25: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

NSF Inhouse Integration Application (Current Solution)

Proposed solution was to develop NSF Inhouse Integration Application using JAVA Client

11 January 2019 : Oracle announced any Inbound connections using TLS 1.0/1.1 are disabled for all Fusion SAAS environments

NSF EBS version 12.1.3 is currently running on TLS 1.1 and moving to TLS 1.2 needs system level upgrade

Deployed Inhouse Integration application to stand alone on-premise server (outside EBS)

Where to Deploy the Tool? EBS Stand AloneOR

Page 26: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

NSF Inhouse Integration Application (NIA)

Inhouse Integration Application (On-Premise Server)

Page 27: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

NSF Inhouse Integration Application

Features:

1. Single Source to initiate any integrations2. Establish synchronous communications between Fusion HCM, MoveIT and EBS

systems3. Able to consume any SOAP and REST Web Services of Fusion HCM application4. Able to consume any REST service in MoveIT application5. Being in on-premise server with direct DB connection to EBS, able to invoke any

API’s in EBS6. Ability to notify issues or errors on real time basis

Page 28: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Fusion HCM Web-Services consumed by

NIA

Web Service Type WSDL/End Point

Content Manager(To stage files in Cloud)

SOAP https://{host}/idcws/GenericSoapPort?wsd

HCM Data Loader(To load data and validate load

status)

SOAP https://<server>/hcmService/HCMDataLoader?WSDLimportAndLoadDatagetDataSetStatus

BI Publisher Service(Run the reports and deliver

files to the FTP Servers/Emails)

SOAP ReportService:http://<host>:<port>/xmlpserver/services/v2/ReportService?wsdlScheduleService:http://<host>:<port>/xmlpserver/services/v2/ScheduleService?wsdl

User Object(Create, Read, Update, Delete)

REST https://<server>/hcmRestApi/scim/Users

Employee Object(Create, Read, Update, Delete)

REST https://<server>/hcmRestApi/resources/11.13.17.11/emps

Assignment Object(Create, Read, Update, Delete)

REST https://<server>/hcmRestApi/resources/11.13.17.11/emps/{empsUniqID}/child/assignments

Page 29: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

MoveIt System Web-Services consumed by

NIA

Web Service Type WSDL/End Point

Request an authorization token(To establish Connection)

REST https://<your-webadmin-server>/webadmin/api/v1/token

Start MoveIT Task(To transfer files)

REST https://<your-webadmin-server>/webadmin/api/v1/tasks/{taskId}/start

Get Task History(Run Status & Files transferred)

REST https://<your-webadmin-server>/webadmin/api/v1/reports/taskruns

Page 30: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Fusion HCM ATOM FEEDS

Atom feeds enable us to keep track of any changes made to feed-enabled resources in Oracle HCM Cloud. Here are the employee feeds available

Atom Feed Type WSDL/End Point

empupdate(To track employee Person data

changes)

REST https://<host>:<port>/hcmRestApi/atomservlet/employee/empupdate

empassignment(To track employee assignment

data changes)

REST https://<host>:<port>/hcmRestApi/atomservlet/employee/empupdate/empassignment

newhire(To track new hires)

REST https://<host>:<port>/hcmRestApi/atomservlet/employee/empupdate/empassignment/newhire

Termination(To track terminations)

REST https://<host>:<port>/hcmRestApi/atomservlet/employee/empupdate/empassignment/termination

Page 31: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Fusion HCM ATOM FEEDS

Image Source: Oracle Corporation

Page 32: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

INTEGRATION APPROACH USING SOAP, REST AND

ATOM FEEDS

Page 33: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Integration Flow - Sending data from Fusion to EBS

Inhouse Integration Application

Step1: Run BI Publisher report in Fusion to generate data to send to Oracle EBS

Step2: Get the Job run status and file delivery status to MoveIT Server

Step3: Kick Start MoveIT job to transfer Files generated from Fusion to EBS Server

Step4: Get the status of MoveIT(Success or Failure and number of files sent)

Step5: Kick start EBS Concurrent Job to process Fusion Data

Step6: Get the Concurrent Job status

*** If Oracle Integrated SOA gateway is enabled, EBS concurrent program can consumed as a REST service

Send Notifications for every failure

BI Report Service (SOAP)

Authorization, Start Task, File Activity (REST)

*** PL/SQL API or REST service SFTP Connection (File based)Web Service Call

Direct DB Connection

Manual File

Page 34: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Integration Flow - Sending PTO balances from EBS to

Fusion

Inhouse Integration Application

Step1: Run BI Publisher report in Fusion to generate data to send to Oracle EBS

Step2: Get the Job run status and file delivery status to MoveIT Server

Step3: Kick Start MoveIT job to transfer Files generated from Fusion to EBS Server

Step4: Get the status of MoveIT(Success or Failure and number of files sent)

Step5: Kick start EBS Concurrent Job to calculate PTO balances

Step6: Get the Concurrent Job status

*** If Oracle Integrated SOA gateway is enabled, concurrent program can consumed as a REST service

Step12: Get the Job run status

Step7: Send the data generated in EBS to Fusion Content Manager

Step8: Get the File Content ID

Step9: Kick start import and load program in Fusion to load file based on Content Id

Step10: Get the Job run status

Step11: If HCM data loader errors out, kick start error report and send emails notifications

BI Report Service (SOAP)

Authorization, Start Task, File Activity (REST)

*** PL/SQL API or REST service

Content Manager (SOAP)

HCM Data Loader Service (SOAP)

BI Report Service (SOAP)

Payroll places PTO file form ADP

Page 35: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Track Data Changes (ATOM Feeds)

Step1: Fusion HCMHR deletes assignment Record or Salary record

Step2: Fusion HCM - (ATOM/RSS Server)

Changes are posted immediately(REST API’s)

Inhouse Integration Application

Step3: Poll every 5 minutes to read newest entries in a Feed

Oracle EBS*** PL/SQL API or REST

service

Step4: Kick start EBS Concurrent Job to synch with Fusion Data

Step5: Get the Concurrent Job status

Email Notifications

Send Notifications for failures

*** If Oracle Integrated SOA gateway is enabled, concurrent program can consumed as a REST service

To retrieve entries within a specific range, use the updated-min and updated-max or published-min and published-max set of parameters filtering on the entries' updated or published date attributes respectively. Step3: Get the

changes published in last 5 minutes

Page 36: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Use Cases – In Progress (Tableau Web Data

Connector)

Tableau Web Data Connector (On-Premise Server)

Tableau is HR Centralized Reporting tool,

- Tableau Web data Connector (WDC) has ability to call Web Services and convert the data to Tableau specific format for Data Visulaization

https://onlinehelp.tableau.com/current/pro/desktop/en-us/examples_web_data_connector.htm

BI Report Service (SOAP) BI Report Service (SOAP)

Page 37: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Future Enhancements (ADP Integration)

Inhouse Integration Application

https://developers.adp.com/articles/api/all/apiexplorer

Page 38: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Future Enhancements (Chat Bots)

REST ServicesREST Services

Oracle HCM Taleo EE

Lets us engage in natural conversations with your business.

Deployable on websites, mobile apps, messaging apps, and through voice interfaces

Oracle Digital Assistant extends and enhances the functionality of your back-end systems

Page 39: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

WWW.MOUS.US

THANK YOU

SAVE THE DATE

• COLLABORATE 20April 19-23, 2020

Mandalay Bay Resort & Casino

Las Vegas, NV

• MOUS 2020October 28, 2020

Schoolcraft College -VisTaTech Center,

18600 Haggerty Rd, Livonia, MI

Page 40: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

WWW.MOUS.US

THANK YOU

SURVEYS

• Session SurveysPlease complete the session survey for this

session using Guidebook.

https://guidebook.com/g/mous2019

• Conference SurveyPlease complete the hard copy conference

survey at the end of the conference and

turn it in at the MOUS registration desk.

Page 41: OUR TRANSFORMATION FROM FILE BASED INTEGRATIONS … Transformation From File Based...1. Configure Oracle E-Business Suite Integrated SOA Gateway (ISG) to enable the REST service features.

Questions?

Sasanka Thavva

[email protected]

Lakshmi Akkena

[email protected]