Islandora: An open source digital

repository solutionDETAILED INTRODUCTION:

WHAT IS ISLANDORA?

1 | P a g e

FULL PARTNER IN OUR D.A.M. COMMUNITY

This document introduces the Islandora Digital Asset Management (DAM) Solution, our community, and features that are available to you as a full partner. In addition you will receive our full training and support services, and we will be with you from the beginning of the planning process and beyond.

As a full partner you are not just working with us to install or set up a website. In addition to doing that we will help you plan your repository, be there to help make tough decisions, and will support you as long as you are contracted with us. We will ensure that your repository meets your needs, is flexible, adaptable, and allows you to have peace of mind that your assets are preserved.

When you become a full partner, you gain not just the Islandora DAM Solution, but a community of support. In addition you will get all the features our current partners have on their sites.

2 | P a g e

WHAT IS ISLANDORA?

Islandora is an open source digital repository that preserves, manages, and showcases your institution’s unique material. Below are examples of how some of our partners showcase their digital assets.

3 | P a g e

YOUR DAM ISLANDORA BURGER

Another way to look at Islandora is to think of it like a burger. Everyone has their favorite burger that fits their own personality and needs, and Islandora is a highly flexible and customizable DAM solution.

In addition Islandora is structured like a burger. Islandora uses Drupal for its front-end user interface, Solr for searching, and Fedora as the digital repository.

Drupal can be thought of as the top “bun” and Fedora as the bottom bun.

Solr can be thought of as the cheese (or the top layer of ingredients that you empower access to everything else).

Islandora itself is everything in the middle, or the ingredients/secret sauce that allow the Islandora DAM Solution to fit your unique needs.

Fedora, the bottom of the burger, is the digital repository software that organizes all your digital assets

4 | P a g e

THE TALKING POINTS

What does “Islandora” mean?

Islandora is an open source digital asset management system originally developed by the University of Prince Edward Island. The name “Islandora” comes from combining “Island” and “Fedora”, which is the digital repository software used by Islandora. “Island” and “Fedora” becomes Islandora.

Many different formats

Islandora supports a number of different formats including audio, video, pdfs, photographs, newspapers, and scholarly works like masters’ theses and dissertations. As open source software, Islandora can be adopted to work with additional formats that may be needed.

Solution Packs

Islandora uses Solution Packs, which are collections of Drupal modules, to provide the appropriate display tools and functionality for each data format. Solution Packs are based on best practices for each format.

For example, there is a Newspaper Solution Pack that provides the ability to browse an entire publication by date. In addition, the Newspaper Solution Pack automatically performs OCR (Optical Character Recognition) so that all issues are full text searchable.

Ingest Forms and Automatic Processes

Each Solution Pack comes with default ingest forms and unique automatic processes that occur when you add objects to your repository. You will only ever need to add the original object (either pdf, tiff, video, audio, or otherwise) to your repository. By taking advantage of Drupal, and using the Solution Packs, Islandora will generate derivatives from the original object. These derivatives include the access and use copies, technical metadata for the object, checksums, thumbnails, and metadata records.

To learn more about the Islandora ingest process, watch the following video: https://www.youtube.com/watch?v=GKugc_NmuiE

Customization/Marketing

You have total control over your repository with Islandora. Ingest forms can be customized, Solution Packs modified, and the search index, facets, and search options changed. Islandora provides granular access control. Collections and individual objects can be restricted from the public.

Islandora uses Drupal for its user interface, so extensibility is only limited by Drupal’s capabilities. Want to brand your site? No problem. Islandora allows sites to be as unique as you wish and modifications in the user interface can be made by local staff.

Adaptability

5 | P a g e

One of the major strengths of Islandora is its flexibility and ability to meet your local needs. We highly encourage you to ask us if you have ideas for enhanced or new functionality, theming, or anything else.

ISLANDORA CORE FUNCTIONALITY

Solution Packs

Islandora takes advantage of Drupal’s nature and uses “Solution Packs” to support the needs of different formats. Each Solution Pack has different tools used to display its supported content, default ingest forms, and automatic processes that result in the creation of various derivatives (also called datastreams). Solution Packs are essentially collections of Drupal modules that work together to provide robust, powerful features to manage digital objects of the same format.

For example, in the Large Image Solution Pack, used for TIFF images, you ingest (upload) the original master tiff file. At ingest, several derivatives are generated: the MODS and Dublin Core metadata records, the technical metadata, a thumbnail which gets displayed in search results, a JPG, and a JPEG2000, which is the display copy. This process is illustrated below.

Datastreams (derivatives) stored together

JPEG2000, JPG, thumbnail, TECHMD, Dublin Core, and MODS record are all “datastreams”. All are stored together on the server and can be easily managed through the Islandora administrative interface.

6 | P a g e

Below is an example of how datastreams look in the Islandora administrative web interface. This is for a photograph. The original, or master file, is a tiff image.

The OBJ datastream is the tiff image you ingested into the repository. The RELS-EXT, MODS, DC, TECHMD, JP2, JPG, and TN (Thumbnail) datastreams/derivatives are created automatically when you add the object.

Each format (audio, video, newspaper, large image, basic image, etc.) has a Solution Pack.

Each Solution Pack includes:

Default ingest (data entry) formso These can be customized

Different tools which are used to create different datastreams (derivatives) when objects get added to the repository, for example:

o ImageMagick for image derivatives

7 | P a g e

o Tesseract for OCRo PREMIS and FITS for preservation metadata

Tools to display content for that format, for example:o JW Player is used to stream videos on the web in the Video Solution Packo Adore Djatoka for JP2000

ISLANDORA CORE FUNCTIONALITY

Ingest Forms

Ingest forms, or metadata entry forms, are included with each Solution Pack. The original forms are built around best practices for each format. PALS will help customize these forms to fit your needs. Ingest forms are built through an XML Form Builder.

The ingest form is what the Islandora administrative user sees when adding objects (photographs, newspapers, etc.) to the repository. Every aspect of the form can be customized. This includes:

Which metadata standard is used What fields are required Instructions that the form user sees Links on the form to other sites Controlled vocabulary lists Default text Drop down menus

A customized ingest form, following Minnesota Digital Library Guidelines, is shown below:

PALS can easily customize your ingest forms to fit the needs of your collections. This involves deciding which metadata standard to use, which elements to use, which elements are required, what controlled vocabulary to use, what default text to use, and determining how to handle copyright.

8 | P a g e

An ingest form is never final. Changes can always be made later.

ISLANDORA CORE FUNCTIONALITY

Preservation

Technical metadata in Islandora is generated automatically when you add objects. This is enabled by the Islandora FITS module in version 1.2 and the upcoming Islandora PREMIS module in 1.3.

When you have the FITS module and PREMIS module configured properly, technical metadata will be generated automatically in all Solution Packs when you add an object.

Technical metadata is its own “datastream” and gets stored with the original object in Fedora.

Islandora FITS Module = File Information Tool Set

Extracts technical metadata information for various formats Created by Harvard University Library Office for Information

Systems for use in its Digital Repository Service This is an example of the technical metadata that gets extracted:

9 | P a g e

Islandora PREMIS Module

Produces XML and HTML representations of PREMIS metadata for objects.

Documents fixity checks performed in datastreams

Checksum Module

Gives repository managers the ability to enable creation of checksums for objects

Checksum Checker Module

Verifies checksums derived from Islandora object datastreams and adds PREMIS fixity check

Triggered periodically using Drupal cron functionality Used to check for file corruption

10 | P a g e

ISLANDORA CORE FUNCTIONALITY

Statistics

PALS uses Piwik to track web statistics. Piwik is an open source solution similar to Google Analytics. The Piwik site can be viewed at http://piwik.org/. Piwik provides usage statistics, impact statistics, and much more. Islandora also offers an easy to use dashboard with Piwik statistics from within Islandora.

Custom Dashboard

We can create a custom dashboard for you that has your most relevant statistics, and is quickly accessible.

11 | P a g e

More Statistics

12 | P a g e

Map Browse

We can now offer a map browse feature for Islandora. If you have the latitude and longitude data for an object (say a photograph or video), then its location can appear on a map.

13 | P a g e

SIMPLE WORKFLOW

We can set up the Islandora “Simple Workflow” for you. This works well if you have student workers, or perhaps faculty/staff submitting material to the repository which you would like to review before having it officially submitted to the repository.

For Minnesota State University-Mankato we have it set up so that students use their own metadata ingest form, which is simpler than what staff use. Staff at MSU-Mankato then review what goes into the Simple Workflow and approve it. Then the object will “go live” and be available and discoverable in the digital repository.

The Simple Workflow can be accessed easily through the Simple Workflow tab, when you are logged in with the appropriate permissions.

14 | P a g e

MY FAVORITES/BOOKMARKS

We can offer you a “My favorites” functionality where general users can create an account, which they can use at any time, to save a list of favorite objects. Users will then be able to share this list through email or over social media.

General users would click on a “My Favorites” link to create an account. Here is MSU-Mankato’s as an example.

15 | P a g e

Once their account is created, they can save favorites to a list. They can do so by clicking on the heart icon.

Clicking on the heart icon brings up their list, and they can add it by clicking “Add favorites.”

16 | P a g e

Users can access their list through the “My Favorites” link. Clicking on it brings them to their list. Users can have multiple lists.

This is a saved list of favorites:

17 | P a g e

From here, one can share the whole list or individual objects through email or social media.

1. Select from the drop down the appropriate choice. In this case, “Selected favorites”.

2. Click on Export/Share selected favorites. This takes you to the Export/Share screen.

18 | P a g e

You can share the object(s) through email or a wide variety of social media sites.

Twitter:

19 | P a g e

Facebook:

SUMMARY

Islandora presents an ideal balance between extensibility and flexibility – it really is possible to do most anything. Just ask and we will show you! Islandora does not hinder the imagination and innovation needed to meet your needs and build your repository.

Islandora gives you access to the value in your data. With digital asset management, your digital assets can tell a story through photographs, videos, and articles.

You have complete control over the look and feel of your website due to the flexibility of Drupal.

Collaboration among our partners is encouraged. You will no longer be alone. You will be able to do more with less by leveraging our community’s knowledge and expertise.

Examples of other Islandora sites can be found here: http://islandora.ca/islandora-installations .

CUSTOMER SATISFACTION

“We love Islandora and firmly believe it will be a very important resource for the campus in the years to come. We are capturing a lot of history of the campus and our community that could have otherwise been lost.”

- Vi Bergquist, CIO, St. Cloud Technical and Community College

20 | P a g e

“A few years ago our library began exploring a digital archive initiative. We opted to start by digitizing our university’s alumni news magazine. This was an ideal publication to begin our initiative with as it reaches a wide audience, contains valuable information on many aspects of our university, and has been consistently published since 1980. I worked with our University Foundation office to secure grant funding to get the initiative off the ground, and continue communication with our Alumni Director on ways to promote and support the digital archives.”

- Pam Gladis, University Librarian, Southwest Minnesota State University

CASE STUDIES: PERSPECTIVES ON STARTING DIGITAL ASSET MANAGEMENT INITIATIVES WITH ISLANDORA

To read more about how our partners got started with their digital asset management initiative, please read more at DAMStories.wordpress.com, here: https://damstories.wordpress.com/further-resources/getting-started-with-digital-asset-management/

CONTACT US

Contact us at https://www.mnpals.org/content/request-information, or call 507-389-2000. For more information on Islandora, see https://www.mnpals.org/products/islandora .

You can explore our sites at http://islandora.mnpals.net .

PALS ISLANDORA COMMUNITY BLOG: DAM STORIES

Follow our new site, https://damstories.wordpress.com/ , for updates on the PALS Islandora community. We’ll keep you informed on our projects and provide further resources for your digital asset management efforts.

21 | P a g e

PALS Data Center, Servers, Maintenance, and Disaster Recovery Information

IntroductionPALS assumes responsibility for the hardware and software needed to ensure the ongoing availability and quality of Islandora instances and related services that we host and support. In addition, PALS provides storage space for all ingested objects and their derivatives, metadata, and indexes. Administrative access to the system is available to our customers via the Islandora web interface, which can be used to configure Islandora and the Drupal interface. System and support functions and tasks are divided between the customer and PALS staff as mutually agreed upon.

The Data CenterThe PALS data center is co-located with the Minnesota State University, Mankato data center. We continuously work to ensure that our servers and the network perform at optimal levels. Processing power, memory and space allocations are based on customer requirements and can be adjusted dynamically as needed. The operating environment allows PALS to quickly scale our systems up to meet increasing demands. The University/PALS data center is on a 1Gb State trunk line with redundant routing available through a local ISP. The trunk line is part of the statewide network managed by the State of Minnesota Office of Information Technology.

The main data center is located in the Memorial Library building along with the University IT and PALS office space. The redundant data center is located in a different building on campus and is built to tornado shelter specifications. The data centers are secured using an RFID card access system and are separated from the office space and

22 | P a g e

other building locations. Access to the data centers is restricted to essential University/PALS server and network administrators and campus security personnel. Access to the redundant data center and off-site backup storage is restricted further on a need-to-access basis.

Application serversPALS is in the process of migration to a Linux Container (LXC) infrastructure. All of our new services entering production are based on this technology. LXC is a robust and reliable method of managing multiple software servers running concurrently on the same hardware without the need for virtualization. Our LXC implementations run on Pogo Linux server hardware. Pogo Linux is a trusted vendor with hardware designed specifically for use by Linux operating systems.

Environmental and power controlsThe data center environment is controlled by dual Liebert DS Precision cooling units. The fire detection and suppression system is a 3M NOVEC Fire Suppression System. Backup power is provided by a Powerware UPS unit.

The Memorial Library building that houses the University/PALS data center is protected by a standby power generator wired to supply power specifically to the data center and key building locations in the event of a power failure. The University has the capability of generating power using the campus Facilities Services' power plant to run off the grid when necessary.

All maintenance and testing procedures for HVAC, fire detection and suppression systems, UPS backup power, the building power generator, and campus power plant are carried out by the University IT and Facilities Services.

Server monitoringContinuous server monitoring is done at the service level using NAGIOS software. Production systems are tested every 5 minutes, development systems are tested every 10 minutes. Logs are reviewed daily by system administrators.

Maintenance and repairAll of the PALS-administered hardware is covered by warranty and includes at least next-day on-site parts service. PALS will be responsible for replacement and repair of hardware components.

Network and securitySystem security consists of:

4 CICSO Catalyst redundant gigabit switches

23 | P a g e

CISCO perimeter firewall Host-based firewall rules using IP tables on each host The PALS network is separated from the University network

PALS takes various infrastructure security measures to prevent unauthorized access to systems we manage and data we host. The PALS network is protected by a perimeter firewall that limits access to allowed ports and services. Access to individual servers and hosts is limited by port and IP to the minimum access required to perform the intended function. User access is limited within PALS only to server administrators, and production system access is limited further. Access to our database servers is limited by IP address only to application machines and local IPs for administrator access. System passwords are stored in encrypted form and access is limited on a need-to-know basis. Passwords have minimum requirements and are updated periodically.

PALS practice is to install security patches to system software within 24 hours. If a server reboot is required for a patch to be applied, the reboot may be postponed until the next maintenance window, depending on severity. To avoid unnecessary security vulnerabilities and patching, we do not install stock server configurations and do our best to limit the software installed only to software packages and dependencies required for the specific server purpose.

Disaster recoveryIn the case of a catastrophic failure which would cause the primary University/PALS data center to be unavailable for a significant amount of time, PALS would restore hosted applications to the University/PALS secondary data center. In the case of a catastrophic failure which would cause both University/PALS data centers to be unavailable, PALS would restore hosted applications to a previously agreed-upon hosting environment (e.g., Amazon AWS).

BackupsPALS currently uses disk-to-disk backup systems for Islandora, using an ORACLE SunFire Storage Server.

Our current backup procedures are as follows: Weekly (Saturday mornings) PALS takes full data dumps of all

databases and data files, production and development The data dumps are copied to two separate Virtual Tape

Libraries PALS has archive logging turned on for all production databases The files are copied to multiple physical locations as they are

generated.

24 | P a g e

Offsite data replicatesPALS stores all weekly backups off-site going two weeks back, and is willing to customize this process to meet customer needs based on reasonable assessment of risk to our primary data center.

Data ownershipPALS makes no ownership claims to customer data. Under no circumstances would PALS share customer data outside of our organization without customer authorization.

Data IntegrityAll data stored on the PALS servers is subject to PALS, University, Minnesota State, and State security and privacy regulations.

Patron PrivacyAll data hosted on PALS servers is subject to the Minnesota State Security and Privacy of Information Resources policy. The full policy and additional related materials are available at http://www.mnscu.edu/board/policy/523.html .

Scheduled DowntimeRoutine maintenance, that requires server rebooting, is performed on Sunday mornings. Any downtime required for software upgrades is scheduled around customer hours and currently is performed on Saturday evenings or Sunday mornings. PALS fully accommodates the customer’s schedule for any planned service interruptions.

Operating System Patches and UpdatesRoutine Ubuntu patches, including security patches, are released several times a week and are applied as they become available. The patches are first applied on development servers. If the patches have no impact on the application or underlying services, they are pushed to production after light testing.

Any major version upgrades to operating systems and hardware changes that directly impact customers would be coordinated with the customer.

25 | P a g e