EfficientNodes EfficientArchive V3.2.3e Praesentation · increase in information (metadata about...
19
Transcript of EfficientNodes EfficientArchive V3.2.3e Praesentation · increase in information (metadata about...
2
What´s EfficientArchive® ?
EfficientArchive is a backend software provides solution for the data center, the unstructured data (file systems) ensures, archived, and at the same time a quick "Disaster Recovery".
About ArchiveNodes are corresponding power chains (Chained Processes) displayed (e.g. from disk to disk, then to tape)
By hardware integration (Hitachi HNAS API) is a particular increase in efficiency and reduction in system load possible because e.g. no longer constantly has to search the filesystem for new or changed files. Because EfficientArchive gets from HNAS API this information.
By application integration via the supplied Communications Server (Orchestra by Soffico) it is possible for any external systems and protocols (DB, SOAP, ftp, http, CSV, EDIFACT, HL7, DICOM ...) to integrate.
This leads not only to an increase in efficiency (see hardware integration) in addition to a significant increase in information (metadata about the files).Thus, it is only possible as with people affected files deal after applicable data protection regulations (mandatory data erasure).
This information in acquired over the unstructured data, can always be passed through the same methods to other applications and solutions (Third Party Integration - e.g. BigData, Data Warehouse, SAP HANA).
Referenzliste
• Sozialstiftung Bamberg - Klinikum Bamberg(> 100 TB > 50 Mio. Files > 20 ArchiveNodes)
• mobil isc, Hannover (> 150 TB > 500 Mio. Files > 10 ArchiveNodes)
• Klinikum Bayreuth (> 70 TB > 50 Mio. Files > 10 ArchiveNodes)
• Kreiskrankenhaus Erding (new 2015)
• Elektronische Werke Fritz Driescher & Söhne GmbH, Moosburg (new 2015)
• Barmherzige Brüder München (new 2015)
• Uniklinik München Großhadern (EA 2015 expected, TimeStamps 2012)
• Krankenhaus LK Weilheim-Schongau (2015 expected)
3
4
EfficientArchive® Problems with unstructured data
• uncontrolled exponential growth of unstructured data- backup processes only hardly practical - operational time much too long- thus even the largest problems with Disaster Recovery - so you have long downtimes and high costs
• can not be soved by using features of the storage manufacturer- mirroring of the data always requires additdional backup the data (Backup to Disk and Backup to Tape)
• mandatory audit-proof storage of data- prorietary special hardware solutions are usually very exptensive, very slowly and lead to dependence on a single manufacturer
• free, unrestricted use of the data - BigData- data on slow systems can not be used for BigData
5
EfficientArchive®
Vorteile
• Audit-compliant long-term archive without proprietary hardware (WORM), through the use of signatures
• no backup of the archived data required - thus great cost savings in backup concept
• fastest restore of the data from Efficient Archive by "Recovery and remapping" for productive systems
• met 3-2-1 rule: 3 copies of the data, 2 of them on different storage systems, 1of them to another location or offline
• met Privacy Policy - Mandatory data erasure
• Archiving at racing speed (> 450 MByte reading of CIFS, with simultaneous 450 Mbyte writing on CIFS = 900 MB throughput for standard files medium size)
• "Data is the oil of the 21st century" synergies, not a data graveyard, by "Third Party Integration" - Big Data Solutions, Data Warehouse, Viewing
6
EfficientArchive®
Overview
• Tamper-proof long-term archiving solution with TÜV Rheinland certificate
• Powerful interfaces (XML, SAP ArchiveLink, HL7/MDM, DICOM, HTTP, CIFS/NFS)
• Automatic signature of all incoming Data - optional with fully qualified time stamps (AuthentiDate)
• Redundant archiving (in a multy - tier way) the data on different storage and tier classes (i.e. disk, tape, Strongbox, HCP), this gives a maximum security at top speed level
• Use of open standards for data storage and archiving(CIFS, NFS, LTFS) - not proprietary
• fastest recovery of data from EfficientArchive® by recovery and remapping of the file systems
• EfficientArchive® Content Repository (storage for meta data) for intelligent use of information (Big Data)
• Highly scalable over many petabytes and billions of files
EfficientArchive® for BigData
Infrastruktur EbeneBlock Storage - HUS/VSP
File EbeneHNAS Fileoperationen
Metainformationen über Dateien(Name, letzter Zugriff, Typ)
BigData EbeneEfficientArchive®
Informationen der Dateien
8
EfficientArchive®
What is a ArchiveNode?
An ArchiveNode is a logical object and comprises:
• Windows Server 2008/2012 (physical or VM)
• Associated file system - there are stored or archived files. (Network share SMB or NFS)
• Associated database - the metadata is stored. (usually not locally on the Windows server, but on a central DB server)
• XML import folder
• XML export folder(s)
DB
ArchiveNodeLevel 1CIFS/NFS
XMLExport
XMLImport
XMLExport
9
DB
ArchiveNodeLevel 1CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
DB
ArchiveNodeLevel 2CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
DMS
EfficientArchive®
ArchiveNodes®
Chained Processes classical
EfficientArchive Gen Service creates XML Files
EfficientArchive Sync Service use XML Files to backup and archive
10
DB
ArchiveNodeLevel 1CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
DB
ArchiveNodeLevel 2CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
DMS
EfficientArchive®
ArchiveNodes®
Hitachi HW-Integration API
EfficientArchive JetCopy/JetArchive feature uses HNAS Changed File List tocreate XML Files
EfficientArchive Sync Service use XML Files to backup and archive
HNASChanged File List
API
11
DB
ArchiveNodeLevel 1CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
DB
ArchiveNodeLevel 2CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
DMS
EfficientArchive®
ArchiveNodes®
Application SW-Integration
EfficientArchive Communication Server Modul (soffico orchestra) works with applications to get files with metadata objects and then creates XML Files
EfficientArchive Sync Service use XML Files to backup and archive
12
EfficientArchive®
DMS
SAP
XMLExport
ArchiveNodeLevel 2
Tier 4 Tape
XMLImport
DB
)(
DB
ArchiveNodeLevel 1CIFS/NFSTier 1 SAS
XMLExport
XMLImport
XMLExport
CommunicationServer
Integration
embeddedMiddleware
13
DB
ArchiveNodeLevel 1CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
Apple IOSIphoneIpad
ViewingNode
DMSPRO TIFFJPEG 2000DICOM, PDF ...
MicrosoftWindows
XMLImport
DB
DB
ArchiveNodeLevel 1CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
DB
ArchiveNodeLevel 1CIFS/NFSTier 1 SAS
XMLExport
XMLImport
XMLExport
DB
ArchiveNodeLevel 2CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
XMLExport
ArchiveNodeLevel 2LTFSTier 4 Tape
XMLImport
DB
DMS
ERP
SAP
XMLExport
ArchiveNodeLevel 3DataCenter
XMLImport
DB
EfficientArchive®
ArchiveNodes®
Chained Processes Overview
Hitachi HDS
Storage APIHW-Integration
Compute BladeLPAR
OrchestraCommunication
Server
ApplicationSW-Integration
embeddedMiddleware
EA TimestampNodeLevel 3
XMLExport
ArchiveNodeLevel 3HDS HCP
XMLImport
DB
ArchiveNodeLevel 2CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
14
Backup Process Classicalwith HDS HCP
100 TB
structured andunstructured
DataDB, VMware,Filesystems,
Files …
Liz Backup SW300.000€
Backupto Disk
Tape500 TB
capacity requirements
4 week retention time
(4 * full, 24 * incbackup)
1 PB
capacity requirements
400 * LTO 6 Tapes (2.5 TB)
50.000€
HDS HCP
24 TB
capacity requirements
no D/R capability
100.000€
500 TB
200 * 4TB
250.000€
EfficientArchive®
[email protected]@brandl-systemhaus.de
15
Applikationsintegration HW-Integration Communication Server Hitachi API*
CIFS / NFS Backup Archiv D/R
Efficient Archive unstrukturiert
SQL, Exchange, SharePoint, Domain Ctlr.
VMware HyperV Backup Veeam
virtualisiert
Daten
16
DB
ArchiveNodeLevel 1CIFS/NFSTier 2 NSAS
XMLExport
XMLImport
XMLExport
XMLExport
ArchiveNodeLevel 2LTFSTier 4 Tape
XMLImport
DB
EfficientArchive®
EfficientNodes®
structured and unstructured Data
HDPS20 TB
structuredData
DB, VMware …
Liz Backup SW80.000€
EfficientArchive80 TB
unstructuredData
FilesystemsFiles
Liz EA80.000€
Backupto Disk
Tape
HNAS100 TB
capacity requirements
4 week retention time
(4 * full, 24 * incbackup)
LTO Library100 TB
(200 TB)
capacity requirements
80 * LTO 6 Tapes (2.5 TB)
HW 25.000€
HNAS100 TB
capacity requirements
(includes versioning)
40 * 4TB
HW 50.000€
100 TB
40 * 4TB
HW 50.000€
CrossroadsStrongbox
100 TB(200 TB)
80 *LTO 6Tapes (2.5 TB)
HW 50.000€
EfficientArchive®
Guidelines
• Principle of the separation of technical archives and productive storage
• Data remain in production system - HSM (Stub File) only optional
• Archiving in a multiple redundancy way on different storage classes via asynchronous processes
• Implementation of privacy policies - Duty of data erasure for data privacy act
• Fundamental decision: Privacy duty before compliance rules for companies
• Preference signature methods before use of WORM technologies
• Check the duration of the complete recovery of data from archive
• Archiving processes replaces backup processes
• Availability to changes in legislation
17
EfficientArchive®
Problems when deciding on a specificnetwork storage and archiving concept
• Which manufacturer of storage systems I choose?
• Can products be combined from different manufacturers?
• should i opt for a NAS, ISCSI or SAN-based architecture?
• When purchasing products with all-embracing functionality (all-rounder) - I make myself then not dependent? - Problem of so called "egg - Legend - jack of all trades".
• What if I want my data audit proof archiving?
• Should you buy a stand-alone solution for longterm archiving?
• If the annual demand for memory correctly assessed (30 - 50% growth per year) - demand is usually calculated only linear, e.g. annually 5TB
• If the whole thing then sometime priceless?
• If this solution is then in a few years even the right one? Or man must then time the stored data and migrate costly?
• If a solution once begun an open and flexible to adapt upcoming new technical possibilities, or I move to a dead end?
• ....
18
19
EfficientNodes GmbHKagerser Hauptstraße 2a
D-94315 Straubing
Tel.: +49 9421 33035 0Fax.: +49 9421 33035 52
www.brandl-systemhaus.de
Albin BrandlTel.: +49 9421 33035 12Mobil:+49 171 [email protected]
EfficientArchive®
Contacts and Information
Partner:
