14 Tips for Planning ECM Content Migration to SharePoint

34
14 Tips for Planning an ECM Content Migration to SharePoint Joel Oleson Hershey Technologies @joeloleson

Transcript of 14 Tips for Planning ECM Content Migration to SharePoint

Page 1: 14 Tips for Planning ECM Content Migration to SharePoint

14 Tips for Planning an ECM Content Migration to

SharePoint

Joel Oleson

Hershey Technologies

@joeloleson

Page 2: 14 Tips for Planning ECM Content Migration to SharePoint

About Hershey Technologies• Founded in 1991

• Certified Microsoft Partner

• IT Solution Provider with deep expertise in…

• End to End SharePoint Consulting Services

• Document and Image Capture:

• Scanning and Imaging

• OCR solutions for automated document and data capture

• ECM and Document Management

• BPM / Workflow

• Contact us…

• Follow us on Twitter: @HersheyTech

• www.hersheytech.com

[email protected]

Page 3: 14 Tips for Planning ECM Content Migration to SharePoint

Agenda

• SharePoint ECM – SharePoint Online & SharePoint 2016

•Why migrate content from legacy ECM systems into SharePoint?

• 14 Planning tips for ECM content migration to SharePoint

Page 4: 14 Tips for Planning ECM Content Migration to SharePoint

About Joel Oleson

• Director of Marketing & Product Strategy @ Hershey Tech

• Adventure Traveler Explorer

• First SharePoint Admin

• Rode a bike down the World’s Most Dangerous Road

• Architecting Customer ECM Solutions since 2000

• Launched SP Communities in Jamaica, Kenya, Jordan, Philippines, Uruguay, and many more…

• Sharing best practices blogging, speaking, tweeting…

@joeloleson

Collabshow.com

[email protected]

Page 5: 14 Tips for Planning ECM Content Migration to SharePoint

Source and Destination

Page 6: 14 Tips for Planning ECM Content Migration to SharePoint

Common Legacy ECM Applications

EMC - Documentum • D5/D6/D7• ApplicationX

tender

Hyland• OnBase• Liberty

Fortis• Fortis• File Magic FileBound LaserFiche

Hershey Technologies• XenDocs

Content Server

Xerox• DocuShare

Canon• ImageWare

IBM – • FileNet• Content

Manager

OpenText

Perceptive Software• ImageNow

Page 7: 14 Tips for Planning ECM Content Migration to SharePoint

Why SharePoint for ECM?Powerful taxonomy

featuresManaged metadata

Site content types and columns

Business Connectivity Services

Lookup columns

Document Sets

Powerful search engine

Workflow

Versioning

Check-In / Checkout

Records Management

eDiscovery and Holds

Site Mailboxes

Content Organizer Rules

Metadata Navigation / Filtering

Partner Eco-system

Platform

Page 8: 14 Tips for Planning ECM Content Migration to SharePoint

SharePoint Online – Office 365

• Your company may already have licenses… 80% of SharePoint CALs cover SharePoint Online

• TB of storage per user in OneDrive for Biz

• 10 GB file upload

• Always up to date… Microsoft does the upgrades without additional fees

• You get it first! O365 early adopter customers have had access to Delve for over a year!

• Mobile just works

Page 9: 14 Tips for Planning ECM Content Migration to SharePoint

Coming Soon… SharePoint 2016 !

1.Durable Links

2.Compliance – DLP is the key term.  Monitoring, and protection of data through deep analysis of content.

3.Increased Boundaries – List views increased, single file sizes up to 10GB, TB databases, and list thresholds

4.Minimal patching with Zero Downtime

5.Hybrid Deployment Automation

Page 10: 14 Tips for Planning ECM Content Migration to SharePoint

SharePoint Migration Planning

Tips

Page 11: 14 Tips for Planning ECM Content Migration to SharePoint

Tip # 1 – Information Architecture is Key - Consider Refactoring such as splitting one legacy repository into multiple SharePoint libraries

AVOID item level

permissions

Reduce number of documents per library (improves

performance)

SharePoint allows unified search across

multiple libraries

File Share SP List

Page 12: 14 Tips for Planning ECM Content Migration to SharePoint

Vendor

PO #

Invoice #

Division

Alpha, LLC

3456617

74584 ACSC

Bravo, Inc

3456633

88363 ACMO

Charlie Co.

3456641

56546454 ACSC

Alpha, LLC

3456648

74584 ACSC

Delta Signs

3456652

675676 ACTX

Echo Ink 3456661

INV-324454 ACTX

Bravo, Inc.

3456670

456546464 ACMO

Vendor

PO # Invoice #

Alpha, LLC

3456617

74584

Charlie Co.

3456641

56546454

Alpha, LLC

3456648

74589

ACSC Invoices

Vendor

PO #

Invoice #

Delta Signs

3456652

675676

Echo Ink 3456661

INV-324454

Vendor

PO #

Invoice #

Bravo, Inc

3456633

88363

Bravo, Inc.

3456670

456546464

ACMO Invoices

ACTX Invoices

Legacy RepositorySharePoint Libraries

Tip # 1 - Use folders, libraries or content types for security

Page 13: 14 Tips for Planning ECM Content Migration to SharePoint

Tip #2 Permissions/Security Considerations

•Consider Adding AD Groups to SP Groups (instead of AD Users) 

• Adding AD users to SP Groups causes incremental/continuous crawl to update to crawl ACLs.  Crawl may go from 3 minutes to 2 hours.

CC: Helloturkeytoe

Page 14: 14 Tips for Planning ECM Content Migration to SharePoint

Tip #3 If you want Scale you need to PLAN!

• Even if you are migrating content with rich metadata, plan to import the content into SharePoint using folders.

• SharePoint allows around 25M documents per library

• With 5,000 root level folders and 5,000 documents per folder this gives you 25M documents/library

• Without use folders, Incremental/Continuous Crawls may perform a table scans

• Easiest approach is to use Content Organizer Rules

Page 15: 14 Tips for Planning ECM Content Migration to SharePoint

Content Types

Inheritance

Workflow Processe

s

Retention Policies

Custom template

s

Legacy Document Types

Tip # 4 –Consider converting legacy “document types” into SharePoint Content Types.

Page 16: 14 Tips for Planning ECM Content Migration to SharePoint

DocumentYourCompa

ny Document

Contract

NDA

Retention: 5

YearsWorkflow

: none

MSA

Retention: 7

YearsWorkflow

: Approval

FieldsPartyNameContactNumberEffectiveDateExpirationDate

Tip # 4 –Consider converting legacy “document types” into SharePoint Content Types.

FieldsNameTitle

FieldsNameTitle

Page 17: 14 Tips for Planning ECM Content Migration to SharePoint

Tip # 5 – Optimize…Consider converting “choice” fields into Managed Metadata, Lookup or External data columns

Managed

Metadata

Lookup External Data (BCS)

Hierarchical YES NO NOReference other columns

NO YES YES

Scope Farm Site Collection Enterprise

Page 18: 14 Tips for Planning ECM Content Migration to SharePoint

Tip # 6 Normalize with site columns or content types for consistency

Policy#

Policy No

PolicyNumber

Legacy ECM System

Policy Number

SharePoint Site ColumnRepository Field

Name

Auto Policies PolicyNumber

Medical Policies

PolicyNo

Home Policies

Policy#

Page 19: 14 Tips for Planning ECM Content Migration to SharePoint

Tip # 7 – Don’t migrate Junk…Age out, Archive, and Optimize…

“Garbage in = Garbage Out!”

cc: Swamp school

Page 20: 14 Tips for Planning ECM Content Migration to SharePoint

Tip # 8 – Understand the Environment:Use Cases

Workflow automation and validation

Ensuring Terms and Metadata consistency

Ensuring there is NO Data or Metadata loss during migration

What does inbound data & capture look like? Scan/Fax/Email

Are there any specialized indexing needs

Page 21: 14 Tips for Planning ECM Content Migration to SharePoint

Tip # 9 - Understand the Environment: Key Metrics

Dbs, folders, files and items

Structure and size of repository

Rate of change

Growth over time

Usage rates and concurrency

Page 22: 14 Tips for Planning ECM Content Migration to SharePoint

Tip #10: Migration Gotchas!

•Invalid Characters in the filenames

•Error handling

•Broken Links

•File Size

•Compliance and Sensitivity of documents

!@#$%^&*(){}+=?><:;~`/|[]

Page 23: 14 Tips for Planning ECM Content Migration to SharePoint

Migration GotchasFile Conversions or third party viewer may be needed

Scanned Documents

PDF• Searchable• Image-Only

TIF• Multi-Page (1

file per document)

• Single-Page (multiple files per document)

Engineering

Auto-Cad• Dwg

Email andAttachments

msg

eml

Multimedia(Consider non MS formats)

Audio• mp3• wmv• wav

Video• avi• mpeg• mp4

Page 24: 14 Tips for Planning ECM Content Migration to SharePoint

TIP #11 Infrastructure Considerations for large scale

• Lessen impact existing SharePoint site collections when starting large ECM migration

• Allocate dedicated WEB front end servers to support higher throughput

• Allocate dedicated SQL Server for legacy content

to host content DBs to avoid disk contention

timothymorgan

Page 25: 14 Tips for Planning ECM Content Migration to SharePoint

Tip # 12 –Consider extending Search… Buy or Build

Consider Search

Refinement and Rich filtering

SharePoint formats Search

results like a “search

engine”, not a DMS.

SharePoint metadata

filtering does not scale for

large libraries

Page 26: 14 Tips for Planning ECM Content Migration to SharePoint

If you put something in how will you find it?

How many docs are

returned in typical query?

Save queries for re-use?

Search metadata vs.

full-text

How many times per day is repository

queried?

What type of users are

searching?

Page 27: 14 Tips for Planning ECM Content Migration to SharePoint

Search Refinement – BA Insight

Page 28: 14 Tips for Planning ECM Content Migration to SharePoint

Tip #13 – XenDocs ECM Search With Vizit™

Intuitively build precise

document queries

Sortable search results

Image previews for

scanned images

Page 29: 14 Tips for Planning ECM Content Migration to SharePoint

Tip # 14 –Understand migration tool options

• Existing 3rd party tools vs Custom tools

• Field mapping (different field names between source system and SharePoint)

• Filters to allow migrations to be performed in chunks

• E.g. Only migrate documents where DocType=‘Expense Report’ and DocDate>’02/13/2009’

• Control: Ability to manage and audit status of every record

• File Conversions

• Single Page TIF to Multi-Page TIF

• TIF to PDF

• Image only PDF to Searchable PDF

• PDF to PDF/A

Page 30: 14 Tips for Planning ECM Content Migration to SharePoint

Advantages of 3rd party Migration Tools• Allows you to skip versions. 2007 to 2013 or 2010 to

2016

• Incremental copy

• Fix broken and relative links

• Fix security issues

• Optimize for Search

• Remove Junk

• Refactor – Promote/demote, move/copy, split

• Remove legacy dependencies on code

Page 31: 14 Tips for Planning ECM Content Migration to SharePoint

Common Migration Tools

Page 32: 14 Tips for Planning ECM Content Migration to SharePoint

XenDocs Migration Tool

Page 33: 14 Tips for Planning ECM Content Migration to SharePoint

In Closing…

•Hope these tips were helpful, if you need more help, lets discuss…

•Demo of various migration tools

•Office 365 Hybrid strategy

•Metadata Search optimization

•Adoption strategy

Page 34: 14 Tips for Planning ECM Content Migration to SharePoint

Let’s connect

Joel Oleson

@joeloleson

Collabshow.com

[email protected]

linkedin.com/in/joeloleson