NimbleOS 4.5.6.0 Release Notes...Valid license from Hewlett Packard Enterprise required for...

NimbleOS 4.5.6.0 ReleaseNotes

Version 4.5.6.0

Published May, 2020

Legal Notices

© Copyright 2020 Hewlett Packard Enterprise Development LP. All rights reserved worldwide.

Notices

The information contained herein is subject to change without notice. The only warranties for Hewlett PackardEnterprise products and services are set forth in the express warranty statements accompanying such productsand services. Nothing herein should be construed as constituting an additional warranty. Hewlett Packard Enterpriseshall not be liable for technical or editorial errors or omissions contained herein.

Confidential computer software. Valid license from Hewlett Packard Enterprise required for possession, use, orcopying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documen-tation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standardcommercial license.

Links to third-party websites take you outside the Hewlett Packard Enterprise website. Hewlett Packard Enterprisehas no control over and is not responsible for information outside the Hewlett Packard Enterprise website.

Acknowledgments

Intel®, Itanium®, Pentium®, Intel Inside®, and the Intel Inside logo are trademarks of Intel Corporation in theUnited States and other countries.

Microsoft® and Windows® are either registered trademarks or trademarks of Microsoft Corporation in the UnitedStates and/or other countries.

Adobe® and Acrobat® are trademarks of Adobe Systems Incorporated. Java® and Oracle® are registered trade-marks of Oracle and/or its affiliates.

UNIX® is a registered trademark of The Open Group.

Publication Date

Monday May 18, 2020 17:16:55

Document ID

fsy1582324544199

Support

All documentation and knowledge base articles are available on HPE InfoSight at https://infosight.hpe.com.To register for HPE InfoSight, click the Create Account link on the main page.

Email: [email protected]

For all other general support contact information, go to https://www.nimblestorage.com/customer-support/.

2Copyright © 2020 by Hewlett Packard Enterprise Development LP. All rights reserved.

Legal Notices

https://infosight.hpe.com

mailto:[email protected]

https://www.nimblestorage.com/customer-support/

Contents

NimbleOS 4.5.6.0..........................................................................................4Important Update Note.........................................................................................................................4

Special Notes.......................................................................................................................................4

Recent Release Features....................................................................................................................7

Documentation.....................................................................................................................................9

Verified Update Paths........................................................................................................................10

Known Critical Issues.........................................................................................................................12

Resolved Critical Issues.....................................................................................................................15

Resolved Issues.................................................................................................................................15

Known Issues.....................................................................................................................................15

Copyright © 2020 by Hewlett Packard Enterprise Development LP. All rights reserved.

NOS

NimbleOS 4.5.6.0

4.5.6.0Version:

Monday May 18, 2020 17:16:55Revision:

The release notes describe the major changes, fixes, and known issues for this release of the NimbleOS.They do not include all individual fixes and internal changes.

For technical support, contact us at:

mailto:[email protected] (877-364-6253) option 2.

Important Update NoteUpdating NimbleOS can involve an update to component firmware on the standby controller. This can causean email alert and automated case indicating "Standby Controller Not Available" when the firmware updateprocess takes longer than five minutes. This is expected behavior and does not affect data services. At theend of the software update, you can check status of both controllers in the Web UI under Manage > Hardware.One controller will be ACTIVE and the other STANDBY under normal operating conditions following asuccessful software update.

All third-party software notices can be found on InfoSight, from the Resources > Documentation page.

You must log into the HPE Nimble Storage Support portal, then from the Resources > Documentation page,click the Support Policy document type and select HPE Nimble Storage General Terms and Conditions.

Special Notes

DescriptionNote

Arrays must be running NimbleOS 2.3.1.0 or later to upgrade to Nim-bleOS 4.5.6.0.

CRITICAL

Internet Explorer 10 and earlier versions are not supported in NimbleOS4.x and later versions.

CRITICAL

The Snapshot rate limit - the number of snapshots that can be takenfor a given minute - is introduced in NimbleOS 4.x for distributingsnapshot load to the system.

If a group surpassed this snapshot rate limit in previous NimbleOS re-leases, the software update to 4.x is still allowed. However, a groupmerge is prevented if the source or destination group surpasses thesnapshot rate limit. The following error message can be seen duringthe group merge validation:

"INFO: Rate of snapshots in the merged group would be greater thansupported snapshot rate."

This could occur even if the source array (the array being added to theexisting group) has no volumes or volume collections. Please contactHPE Nimble Storage Support for further assistance in troubleshootingthis issue.

CRITICAL


NimbleOS 4.5.6.0 Important Update Note

mailto:[email protected]

DescriptionNote

An extended data services outage may occur with MS iSCSI initiatorand Intel NICs using the built-in Windows driver e1q60x64.sys (version11.0.5.21/11.0.5.22).

CRITICAL

A service outage may occur on Windows 2012 R2 hosts using EmulexFibre Channel HBAs with firmware 10.4. Update the Emulexfirmware/driver to 11.0 or later

CRITICAL

Due to a known Red Hat Enterprise Linux bug 1002727 while runningvirtualized in VMware ESX, manually rebooting the active controller inpresence of heavy IOs using the reboot --controller command on aFibre Channel array may trigger an incorrect retry initiated by RHELguests running the following kernel versions:

• 6.4 and earlier• 6.5 without the patch• 7.0 without the patch

This incorrect retry logic may lead to unexpected application behavior.In these environments, we recommend the failover command instead.

CRITICAL

As outlined in the current Validated Configuration Matrix, HPE NimbleStorage fully supports Windows guest operating systems on MicrosoftHyper-V, including Virtual Fibre Channel (VFC) connectivity and multi-pathing with HPE Nimble DSM and VSS support. However, Linux guestsrunning in Hyper-V VFC configurations are not qualified. Running RedHat Linux guests with the “Linux Integration Services” kit installed, orwith hv_storvsc drivers in such configurations can lead to Red Hat bug1364282, which can cause an unexpected service outage.

CRITICAL

For connections to the NimbleOS GUI, ensure that port 5392 is openfor the Group Management IP address and both diagnostic IP addresses.

Important

VMware has announced End of General Support for vSphere 5.0 andvSphere 5.1, which includes vSphere Hypervisor ESXi 5.0 and 5.1 andvCenter Server 5.0 and 5.1 respectively. To maintain your full level ofsupport and subscription from VMware, you should upgrade to a sup-ported version of vSphere. Refer to KB2145103 at VMware knowledgebase for more information.

Important

During deployment of a desktop using VMware Horizon View, a VVol(mapping to a disposable disk) is created. A clone of this VVol is alsocreated and placed within a directory under the virtual machine directorynamed sdd.

When this desktop is deleted from Horizon View, VMware fails to deletethe VVol clone of the disposable disk; only the disposable disk itself isdeleted. This will be fixed in the next vSphere release. VMware bugnumber 1807857 should be used to track this fix.

This issue occurs on all versions of VMware Horizon and vSphere thatsupport VVols:

• Horizon 6 version 6.1 and later• vSphere 6.0 and later

Important


NimbleOS 4.5.6.0 Special Notes

https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2145103

DescriptionNote

On Windows Server 2012, 2012 R2, and 2016, the disk optimizationprocess may record the following error in the Application event log: "Thevolume was not optimized because an error was encountered: NeitherSlab Consolidation nor Slab Analysis will run if slabs are less than 8MB. (0x8900002D)". Although Windows records this as an Error in theevent log, the event can be safely ignored for HPE Nimble Storagevolumes. HPE Nimble Storage volumes do not benefit from or requireslab consolidation.

Important

Numerous host integration toolkits are supported in NimbleOS 4.5.6.0.It is strongly recommended that they be installed on all Windows, Linux,and VMware hosts. Refer to the Validated Configuration Matrix, whichis available on HPE Nimble Storage InfoSight (https://infos-ight.hpe.com/tenant/Nimble.Tenant.0018000000ovsdmAAA/re-sources/nimble/validated-configuration-matrix).

Important

Hosts leveraging VSS integration with HPE Nimble Storage WindowsToolkit (NWT) 2.1 and earlier will not work with NimbleOS 3.x. and later.

Important

TRIM on ReFS is not supported by Microsoft on Windows Server ver-sions prior to 2019.

Important

Performing a group merge from a source group that contains runningHyper-V virtual machines requires additional care. Group merges requirechanges to the discovery IP address that can adversely impact runningsystems. Therefore, if you perform a group merge, you should plan amaintenance outage to gracefully stop all applications and Hyper-Vvirtual machines on the source group to eliminate unexpected downtimecaused by changing IP address during the group merge process. Atypical group merge should take only a few minutes to complete andthen virtual machines and applications can be restarted.

The group merge and pool merge operations will also have impact onSCVMM. The impact will depend on whether the source and destinationgroups or pools are under SCVMM's management.

Please refer to the SMI-S Integration Guide which includes details aboutSCVMM and the impacts in these situations before performing mergeoperations.

Important

Various timeout values affect HPE Nimble Storage targets from Windowsand Linux hosts. Before you update the NimbleOS, install the HPENimble Storage Windows Toolkit (NWT) or HPE Nimble Storage LinuxToolkit (NLT) on the host or tune the timeout values. Timeout detailsfor various operating systems can be found on InfoSight under Re-sources > Documentation. From the HPE Nimble Storage Documen-tation page, select Knowledge Base Article:

• KB-000052: Windows Host Disk Timeout Values• KB-000087: VMware Host Disk Timeout Values• KB-000304: Linux Host Disk Timeout Values

Important

The new Backup Repository performance policy introduced in NimbleOS4.2 cannot be used when replicating against a downstream array runningan older release. Replicated volumes need to be associated at the timeof creation, with a performance policy that either exists downstream orthat can be manually created on the downstream array.

Important


NimbleOS 4.5.6.0 Special Notes

https://infosight.nimblestorage.com/InfoSight/#validated-configuration-matrix



https://infosight.hpe.com/resources/nimble/docs

https://infosight.hpe.com/resources/nimble/docs

https://infosight.hpe.com/InfoSight/media/kb/active/htr1455131698674.whz/index.html



Recent Release FeaturesThe following features are available in NimbleOS 4.x releases:

Replication to HPE Cloud Volumes (NCV)

Realize your Hybrid Cloud vision by replicating data between your HPE Nimble Storage array and HPE CloudVolumes (NCV). Volumes replicated to NCV can be used with cloud compute from AWS or Azure cloudservices. Now you can build your DR, test/development or workload bursting strategies by extending yourreach to the public cloud.

In NimbleOS version 4.4.x and later, the following limitations apply to replication to NCV:

• Replicating encrypted volumes to the cloud is not supported.• To ensure that your replication set up does not fail, we highly recommend that you rename your volumes

to include your NCV customer ID and user ID.• To change the direction of replication or associate different HPE Nimble Storage arrays with data in the

cloud, contact HPE Nimble Storage Support.

Secondary Flash Array Support

NimbleOS 4.2 and later support Secondary Flash Array models SF100 and SF300, and the correspondingSecondary Flash expansion shelf, SF-ES2. Secondary Flash Arrays are cost-effective secondary storagearrays with features like deduplication, compression, and encryption, that pack performance to powersecondary workflows. These arrays also support integrated replication for a tertiary copy of the data.

FIPS Approved HTTPS to Web UI

In NimbleOS 4.2 and later, the array GUI now supports Cross Origin Resource Sharing (CORS), whichmakes it compliant with FIPS PUB 140-2, Security Requirements for Cryptographic Modules.

NPM VMware Synchronized Snapshots

NimbleOS 4.2 and later provide support for using the VMware tag feature to exclude VMs and datastoresfrom VMware synchronized snapshots. You can also exclude VMs and datastores from restore operationsbased on those snapshots. In addition, you can set a VM to be included in a restore operation even if thedatastore containing it has an exclude tag.

Volume Scalability – up to 10,000 Volumes

With this feature, HPE Nimble Storage now supports the creation of up to 10,000 volumes on the AF5000,AF7000, and AF9000 array models. This is a nearly 10x increase from the previous volume maximum of1,024.

Next Generation UI

NimbleOS release 4.1.0.0 introduces a completely new and fresh user interface (UI) for your managementtasks. The UI is not flashy, which makes it more IOS friendly. A revamped information architecture alsomakes tasks more intuitive to begin and complete.

Alarm Management

This release introduces Alarms, which can be thought of as enhanced Alerts. You can acknowledge or pausealarms, as well as disable notifications. By correlating alerts, alarms can reduce alert “noise”.

Quality of Service – IO Limits

This features enables customers to set a maximum I/O per second or maximum MB per second limit toprevent a particular volume or group from using a disproportionate share of resources. It is possible to setI/O limits, MB limits, or both, at the volume or folder level, or at both the volume and folder levels. If anapplication requests more throughput than the maximum allowed, it will be limited to the values set.

Framework for Integrating Snapshots with any Application


NimbleOS 4.5.6.0 Recent Release Features

This feature provides a framework for integrating snapshots with any application. Customers and systemsintegrators can easily implement custom linkages to notify an application prior to taking a snapshot and againafter the snapshot is taken. Applications can use the notifications to take whatever actions are required toensure application consistency in the snapshot.

Application Consistent Snapshots for Hyper-V VMs

This feature enables storage administrators operating the HPE Nimble Storage Protection Manager (NPM)to protect Hyper-V VMs residing on HPE Nimble Storage volumes in an application consistent manner.

Store all Passwords Encrypted

All passwords pertaining to a customer’s environment that the array needs to access (for example, thevCenter password) are now stored in an encrypted form in the configuration database.

Common Criteria (Login Banner)

Customers are now able to display a custom banner during the login process to the NimbleOS managementUI.

REST API for SCVMM Integration through SMI-S

The SCVMM integration through SMI-S uses new REST APIs exposed by HPE Nimble Storage.

Windows Server 2016 Support

Workloads running on Windows Server 2016 are now supported by the NimbleOS.

HPE Nimble Storage Windows Toolkit Suite Installer

HPE Nimble Storage Windows Toolkit (NWT) components have been decoupled, so that when separatecomponents are upgraded, the process does not trigger unnecessary reboots of the server. All NWTcomponents are available in a single package for download.

Windows Host Information Reporting to Array

This feature enables application- and host-specific intelligence while diagnosing issues with HPE NimbleStorage.

Windows Host-Aware Clone Automation

This feature addresses the need to query snapshots for application objects, for example, an SQL database,and automate the cloning process of those snapshots. This reduces a multistep process to a single command.

Fibre Channel iGroup Types

This feature supports setting host-specific behaviors to optimize for HP-UX hosts accessing the HPE NimbleStorage array.

NimbleOS Management REST API – Full Set

A full and robust set of Management REST APIs that make it easier to create custom scripts, third-partyplugins, and monitoring and management applications are now available. From InfoSight, choose Resources >Documentation. In the Search field, enter REST API, then click the search icon.

The REST API Reference contains a complete list of all APIs available, and information about how to usethem.


NimbleOS 4.5.6.0 Recent Release Features

DocumentationAlong with these Release Notes, and other reference information, the core user documentation set is availableon InfoSight at https://infosight.nimblestorage.com. Click Resources > Documentation to search documentsby multiple browse facets, as well as by keyword.

Document Search UI

From the Documentation search interface on InfoSight, you can search across all user documentation,including support and knowledge base articles, best practice, solution and integration guides, plus all productdocumentation (hardware, installation, administration) and configuration matrices. Click to select one or morecategories to easily find documents by type, platform, HPE Nimble Storage software and solutions, andintegration.

The following is the core user documentation set for NimbleOS:

• GUI Administration Guide• CLI Administration Guide• SNMP Reference• Command Reference• REST API Reference

Workflow Documents

Five workflow guides (with both CLI and GUI procedures) are included in the documentation set, each coveringa specific, frequently-performed task related to HPE Nimble Storage products. These tasks also reside ineither the GUI Administration Guide or CLI Administration Guide.

Hardware

Documentation for all hardware components is available on HPE InfoSight. Click the Hardware Guide link inthe Document Type category. Hardware documentation includes array and expansion shelf installation quickstart guides, installation, upgrade, and replacement guides, and comprehensive hardware guides.

Host Integration Guides

Host Integration Guides are available from HPE InfoSight. To locate these documents on the HPE InfoSightDocumentation page, scroll down the navigation pane to the section called Integration Guide. The availableguides include the following:

• Linux Integration Guide• OpenStack Cinder Driver Integration Guide• SMI-S Integration Guide• UCS Director Open Automation Module Integration Guide• VMware Integration Guide• Windows Integration Guide

Note The version numbers of the host integration guides match the version numbers of their companionIntegration Toolkit software packages.

Integration Toolkits

The following Integration Kits include a set of documents that are associated with the toolkit software,searchable by software type and version. The following integration toolkits are supported:

• HPE Nimble Storage Adaptive Flash Cinder Driver for OpenStack• HPE Nimble Storage AIX ODM• HPE Nimble Storage Connection Manager (NCM) for Linux


NimbleOS 4.5.6.0 Documentation

https://infosight.nimblestorage.com

• HPE Nimble Storage Connection Manager (NCM) for VMware• HPE Nimble Storage SRA (Storage Replication Adapter)• HPE Nimble Storage UCS Director Open Automation for Cisco UCS Director• HPE Nimble Storage Windows Toolkit (NWT)

Note To download Integration Kit software, go to HPE InfoSight (https://infosight.hpe.com) and chooseResources > Software Downloads.

Verified Update Paths

Table 1: From Versions 4.x

From Versions 4.x

To VersionFrom Version

4.5.6.04.5.5.0

4.5.6.04.5.4.0

4.5.6.04.5.3.0

4.5.6.04.5.2.0

4.5.6.04.5.1.0

4.5.6.04.5.0.0

4.5.6.04.4.1.0

4.5.6.04.4.0.0

4.5.6.04.3.1.0

4.5.6.04.3.0.0

4.5.6.04.2.1.0

4.5.6.04.2.0.0

4.5.6.04.1.0.0


From 3.x Versions


4.5.6.03.9.3.0

4.5.6.03.9.2.0

4.5.6.03.9.1.0

4.5.6.03.9.0.0

4.5.6.03.8.1.0

4.5.6.03.8.0.0

4.5.6.03.7.0.0

4.5.6.03.6.2.0


NimbleOS 4.5.6.0 Verified Update Paths

https://infosight.hpe.com

From 3.x Versions


4.5.6.03.6.1.0

4.5.6.03.6.0.0

4.5.6.03.5.4.0

4.5.6.03.5.3.0

4.5.6.03.5.2.0

4.5.6.03.5.0.0

4.5.6.03.4.1.0

4.5.6.03.4.0.0

4.5.6.03.3.0.0

4.5.6.03.2.1.0

4.5.6.03.1.0.0


From 2.1.x VersionsFrom 2.1.x VersionsFrom 2.2.x, 2.3.x Versions

To VersionFrom VersionTo VersionFrom VersionTo VersionFrom Version

2.1.9.12.8.0.02.3.18.02.1.9.14.5.6.02.3.18.0

2.1.9.12.0.7.02.3.18.02.1.9.04.5.6.02.3.16.0

2.1.9.12.0.6.*2.3.18.02.1.8.04.5.6.02.3.15.0

2.1.9.12.0.5.02.2.9.02.1.7.04.5.6.02.3.14.0

2.1.9.12.0.4.02.2.9.02.1.6.04.5.6.02.3.12.*

2.2.9.02.1.5.04.5.6.02.3.9.*

2.2.9.02.1.4.04.5.6.02.3.8.0

2.2.9.02.1.3.04.5.6.02.3.7.0

2.2.9.02.1.2.04.5.6.02.3.6.0

2.1.9.12.1.1.04.5.6.02.3.4.0

2.1.9.12.1.0.04.5.6.02.3.3.0

4.5.6.02.3.2.1

4.5.6.02.3.2.0

4.5.6.02.3.1.0

3.9.3.02.2.11.0

3.9.3.02.2.10.0

3.9.3.02.2.9.0

3.9.3.02.2.7.*

3.9.3.02.2.6.0


NimbleOS 4.5.6.0 Verified Update Paths

From 2.1.x VersionsFrom 2.1.x VersionsFrom 2.2.x, 2.3.x Versions


3.9.3.02.2.5.*

2.2.11.02.2.3.*

2.2.11.02.2.2.0

2.2.11.02.2.1.0

2.2.11.02.2.0.0


From 1.0.x VersionsFrom 1.3, 1.2, 1.1 VersionsFrom 1.4.x Versions


Contact Support1.0.7.*1.4.6.01.3.*.*2.1.9.11.4.12.0

Contact Support1.0.6.*1.4.6.01.2.*.*2.1.9.11.4.11.0

1.2.2.01.1.*.*2.1.9.11.4.10.0

2.1.9.11.4.9.0

2.1.9.11.4.8.0

2.1.9.11.4.7.0

1.4.12.01.4.*.*

Known Critical Issues

Known Critical Issues in NimbleOS version 4.5.6.0

WorkaroundDescriptionTitleComponentID

This alert can safely be ig-nored.

After activating an ES2 ex-pansion shelf, you receivean alert stating that An un-known firmware versionwas detected for compo-nent expander.... This erroroccurs since the shelf isrunning a new firmwareversion that is not yet recog-nized by the NimbleOS.This does not affect any ar-ray or shelf operations.

An unknownfirmware versionwas detected forcomponent ex-pander alert af-ter activatingES2 shelf

PlatformAS-87454


NimbleOS 4.5.6.0 Known Critical Issues



This issue has been con-firmed as cosmetic. To re-solve this issues, you mayreboot the controller(s) re-porting the illuminated overtemp LED. Please contactHPE Nimble Storage Sup-port if further assistance isneeded.

After performing a softwareupdate to NimbleOS 4.x,the over temperature LEDis illuminated on the arrayfront LED panel. However,no alerts are triggered fromthe array software.

Red overtempLED is illuminat-ed after Nim-bleOS softwareupdate to 4.x

PlatformAS-76519

Contact HPE Nimble Sup-port for assistance inrestoring array to Ac-tive/Standby status.

In rare instances the inter-connect between controllersmay be down following acontroller reseat.

Array remains insolo/stale aftercontroller reseat.

PlatformAS-51053

Not applicableIn multi-port network cards,the interfaces are initializedstarting with the interfaceclosest to the PCI slot, andending with the interfacefurthest away from the PCIslot. The 4-port 10Gbpstwisted pair NIC used in theHPE NimbleStorage arrayinitializes the ports in re-verse order, causing the ar-ray GUI and physical label-ing to show them in thewrong order.

Array GUI andCLI show quadport 10 GBTwisted Pair NICports in reverseorder

PlatformAS-87507

A failover can be initiated inorder to restart the GroupManagement Service. Youmay also contact HPE Nim-ble Storage Support torestart the service manually.

When performing a con-troller upgrade to a high-end model, the object limitswill still show the lower lim-its if the Group Manage-ment Service is not restart-ed.

Group Manage-ment Servicemust be restart-ed to unlock ad-ditional volumelimits after con-troller upgrade

System Manage-ment

AS-65615





Contact HPE Nimble Stor-age Support.

The Snapshot rate limit -Number of snapshots thatcan be taken for a givenminute - is introduced in 4.xfor distributing snapshotload to the system. If agroup surpasses this snap-shot rate limit in previousNimbleOS releases, thesoftware update to 4.x isstill allowed. However, agroup merge is prevented ifthe source or destinationarray surpasses the snap-shot rate limit. The followingerror message can be seenduring the group mergevalidation: INFO: Rate ofsnapshots in the mergedgroup would be greater thansupported snapshot rate.This could occur if even ifthe source array (the arraybeing added to the existinggroup) has 0 volumes orvolume collections.

Group mergefails if one of thegroups violatesthe snapshotrate limit

System Manage-ment

AS-69136

Not applicableDuring NimbleOS update,the internal NimbleOSdatabase migration takesplace. Low memory arraysmay see an unexpectedservice restart of the ArrayManagement or GroupManagement services if themigration scripts are largeas they cause excessivedisk operations that mayresult in timeout. Serviceswill automatically recoverafter the restart without anyimpact to the software up-date process.

Array servicesmay restartaround comple-tion of softwareupdate to Nim-bleOS 4.x andlater versions.

System Manage-ment

AS-80338



Resolved Critical Issues

Resolved Critical Issues in NimbleOS version 4.5.6.0


Not applicableThe NimbleOS 4.5.6.0 re-lease contains fixes for criti-cal security vulnerabilitiesthat may allow remote codeexecution and unauthorizeddata access. The associat-ed HPE Nimble StorageSecurity Bulletin numbersare: HPESBST03991 (HPENimble Storage, RemoteAccess to Sensitive Informa-tion) and HPESBST03992(HPE Nimble Storage, Re-mote Code Execution)

Security Fixes inNimbleOS4.5.6.0

SecurityAS-108017

Resolved IssuesThere are no resolved issues in NimbleOS version 4.5.6.0

Known Issues

Known Issues in NimbleOS version 4.5.6.0


Please contact NimbleStorage Support to increasethe scratch page pool size.

Under unique customerworkloads, the index foot-print may exhaust defaultscratch page allocation inmemory. As a result, theData Service may restartunexpectedly.

Data Servicemay restartwhen the arrayruns out ofscratch pages

Data ServiceAS-49046

Not applicableIf IO to disk are slow or fail,the Data Service mayrestart to try to recover thecondition.

Data Servicerestart due toslow disk IO ordisk IO failure


Remove downstream repli-ca using the correct stepsordered below. 1.Claim the replica volume. 2.Delete all of the snapshotsfor the replica volume. 3.Delete the replica volume.

The service may restartwhen removing the down-stream replica using thesteps below. 1.Deletion of all snapshots forthe replica volume. 2. Claimthe replica volume 3. Deletethe replica volume

Very rare racebetween Volclaim (with allsnapshotsmarked for dele-tion) and spacerecalculation onreplica down-stream volume



NimbleOS 4.5.6.0 Resolved Critical Issues



Not applicableUnder certain circum-stances, an aggressive inter-nal assert may lead to unex-pected restart of the DataService.

Aggressive as-sert may lead tounexpectedrestart of the Da-ta Service


Contact Nimble StorageSupport if there is a need torecover space.

In case of a network failureand the bin migrationsource cannot reach thedestination, bin migrationwill abort. This could lead tothe locking of space at thebin migration destination.The following alert will beissued if bin migration failsrepeatedly. Data Migrationis delayed because of re-peated restarts. ContactNimble Storage Support.

Bin migrationdestination couldlock up spaceand blockbranch deletions(internally) if binmigration sourceaborts as it cannot reach desti-nation


Perform Enable/DisableiSCSI digest operation on aper-host basis using theHPE Nimble vCenter pluginin the web or thick client. Ifthe issue persists, retry theoperation when the systemis not under heavy load(such as performing storagevMotions, etc).

Enabling/Disabling iSCSIdigest on each datastoreinvolves disconnecting iSC-SI sessions and reconnect-ing for header/data digestto take effect. This opera-tion could fail with timeouterrors when performed ona heavily-loaded system atthe datacenter level. Thiswill not cause any disruptionto the data access, and theoperation can be retried.

Enabling/Dis-abling iSCSI di-gest using Nim-ble vCenter plug-in intermittentlyfails when doneat the datacenterlevel

Host IntegrationAS-64230

Contact Nimble StorageSupport to identify the rea-son for the partition fillingup and to clean up the logpartition.

Log files generated by pro-cesses in the Nimble Oper-ating systems are rotatedand archived using certainparameters. Under someconditions, if processes logmore than normal, this canresult in the log partitionsbeing filled up, leading toother issues with criticalprocesses.

Log partitionmay fill up

PlatformAS-50033


NimbleOS 4.5.6.0 Known Issues



1. Reseat one of the powersupplies to clear the hangcondition. 2. Or updateNimbleOS to version 3.6.0.0or later to minimize thenumber of internal com-mands that can trigger thisissue.

Under certain circum-stances, internal commandsmay cause the integratedcircuit to hang which causesboth power supplies of thehead shelf to appear asmissing. The problem doesnot impact the power sup-plys ability to deliver powerto the array.

Both power sup-plies showing upas missing

PlatformAS-53621

Not applicableOn very rare occasions ofHBA error handling, inter-rupts could be turned offlong enough for the NVRAMdriver to timeout while tryingto complete direct memoryaccess operations. Thecontroller recovers after areboot is initiated by thekernel.

Kernel panicswhile processinghost bus adaptererrors

PlatformAS-46629

Active controller will operateas expected after the faultystandby controller is dis-abled. (1) Remove the re-booting standby controllerfrom the chassis or contactHPE Nimble Storage Sup-port to remotely power offthe rebooting standby con-troller from the arrays activecontroller. (2) Then reseator disk --remove | add thefailed SSDs to recover theSSDs.

In a rare case, when thestandby controller is in areboot loop, this may dis-rupt the Data Service. As aresult, the array will reportseveral failed SSDs.

Data Servicedisrupted whenstandby con-troller is in a re-boot loop

PlatformAS-49747

1. Reboot or reseat con-troller. If the controller hav-ing the issue is the activecontroller, perform afailover, which will rebootthe controller. If the con-troller is standby, reboot viathe HPE Nimble CLI byrunning the following com-mand: reboot --array ar-ray_name --controller [A|B]2. If rebooting does not re-solve the issue, change theSFP module on the NIC andreboot again.

In very rare cases, a 10GSFP+ module may not bedetected properly. Whenthis happens, the affectedport will not show up in thesystem.

10G SFP+ mod-ule may not bedetected proper-ly

PlatformAS-33858





Address the network storm,and then perform a con-troller failover.

On lower-end platforms witha lower number of CPUcores, a network stormcould keep the kernel busyserving network interruptrequests, and ultimatelydelay IO requests. This inturn causes IOs to timeoutand causes a Data Servicerestart to recover.

Network stormcauses writes toslow down to apoint where Da-ta Servicerestarts due to ahealth check fail-ure

PlatformAS-55765


In rare cases, heavy loadcompounded by unalignedworkloads on high-endplatforms with many CPUcores can cause theNVRAM driver to becomeoverloaded when all coresare busy. The Data Servicemay restart unexpectedlywith a health check error.

NVRAM over-loaded on highend platformsunder heavystress

PlatformAS-56600


In rare cases, multi-bit ECCerrors on the NVRAM cardmay cause the Data Serviceto restart unexpectedly.

Multi-bit Error-Correcting Code(ECC) errors onNVRAM cardcaused DataService restart

PlatformAS-56942

Removing and reinsertingthe drive sled will discoverthe drive correctly. If situa-tion permits, please contactNimble Storage Support.

In rare occasions, whenbooting the array or replac-ing a SSD sled, the SSDdrive may appear as 0GBand offline. The system willfunction without the SSD.

SSD drive mayappear 0GB andoffline

PlatformAS-53578

Schedule time for a SalesEngineer to field-image thearray.

Upon removing an arrayfrom a group and removingany expansion shelves fromthat array, the array willneed to be re-imaged priorto any array reuse.

Removing an ar-ray from a groupleaves the arrayin an unusablestate.

PlatformAS-32895






When the SAS HBA detectsfaulty states, to recover, thearray needs to reset theSAS HBA’s firmware. TheSAS HBA firmware resetcan block disk I/Os signifi-cantly longer than our HighAvailability monitoring time-outs allow. Instead, a con-troller reboot is triggeredimmediately if this state isdetected, resulting in anunexpected takeover event.

Unexpectedcontrollertakeover due toincorrect state ofthe SAS HBA

PlatformAS-33725

None required. The processis shutting down.

While the group manage-ment process is shuttingdown, it may experience afault that causes a restartattempt.

Group Manage-ment restartswhile shuttingdown

SecurityAS-56019

Not applicableWhen created with theREST API, by default thecloned volume inherits theACL from the parent vol-ume. There is no way to setor change the ACL for theclone at the time of creationthrough the REST API.Clients should make twoREST calls, one to createthe clone and then one tochange the ACL to the de-sired value. In the future,we could change the RESTAPI to not set the ACL bydefault and allow the clientto set the ACL at the timeof the clone creation to thedesired value. This only ap-plies to volumes that haveagent_type set to none

REST API Cloneof volume doesnot support set-ting ACL at timeof clone creation

System Manage-ment

AS-54302

Not applicableAlerts and Alarms process-ing service may restart un-expectedly when certainoperation surpass the desig-nated health check timeout.The process will stabilizefollowing the restart.

Alerts andAlarms process-ing service mayrestart unexpect-edly

System Manage-ment

AS-50821





Re-run array removal toclear the group leadermetadata.

In some cases when thereis high load, array removalcan take longer than usualand timeout, which leads toan intermediate state wherethe group leader believesthe array still belongs to thegroup, but the array hasbeen removed.

Array removalmight not com-plete in time

System Manage-ment

AS-28992

Not applicableIn rare cases, a memory in-consistency causes an un-expected Group Manage-ment Daemon (GMD)restart.

UnexpectedGroup Manage-ment restart dueto memory incon-sistency

System Manage-ment

AS-55005

If array is queried for statis-tics, then its frequencyshould be reduced. This isspecially relevant for thesetup where script or somemonitoring tool does statsquery frequently in a loop.

There is a memory leak inthe stat (statistics) compo-nent of the Array Manage-ment service. Magnitude ofthe memory leak is propor-tional to the frequency ofstats query.

Array Manage-ment servicerestart due tomemory alloca-tion exception

System Manage-ment

AS-98297

This issue can be resolvedby aborting the handover forthe volume collection byusing the volcoll --handovername --abort command.The volcoll can then be de-moted to the new upstreamby using the volcoll --de-mote name [--partner name]command.

If the Management Processrestarts during a handover,in some rare cases han-dover pauses and does notcontinue since the olddownstream partner as-sumes ownership of thevolcoll and does not acceptupdates from the old up-stream partner. This can beidentified by looking at thepartner status, which wouldshow that the partner is notsynchronized. Further, thevolume collection in ques-tion on the old upstreamwould remain in the hand-ing-over state indefinitely.

Handover canpause in rarecases

System Manage-ment

AS-14752





Not applicableAdding or removing vol-umes to a volume collectionwhile replication is inprogress for that volumecollection could potentiallylead to a restart of theGroup Management ser-vices. This does not have asignificant impact however,since replication (and otherservices) resume wherethey left off before therestart

Adding/removingvolumes whilereplication is inprogress maycause GroupManagementrestart

System Manage-ment

AS-44941

Not applicableOn rare occasions, a veryslow network (or networkissues like dropped pack-ets) can cause a restart ofthe Group Managementservices. However, replica-tion and other services willresume where they left offprior to the restart.

Network issuesmay causerestart of GroupManagementservice

System Manage-ment

AS-28589

Refresh the HPE NimbleStorage array GUI .

Multiple snapshot deletionscan be deleted in a singlerequest. Back-to-back dele-tions of multiple batches often or more snapshot collec-tions may cause the HPENimble Storage array GUIinterface to hang.

Frequent, multi-ple SnapshotCollection dele-tions causesGUI to hang

System Manage-ment

AS-65935

Failing over the controlleror working with HPE NimbleStorage Support to restartthe Group Managementservice will automaticallycorrect this issue.

After modifying a ProtectionSchedule on a Volume Col-lection, an in-memory valueused for snapshot retentioncan be updated incorrectly.As a result, replication mayfail or the Group Manage-ment service may restartunexpectedly when this in-correct value is encoun-tered.

Replication mayfail or GroupManagementservice mayrestart aftermodifying protec-tion schedule

System Manage-ment

AS-80552





Not applicableIn rare cases, the standardmemory allocator does notreuse freed memory effi-ciently during heavy work-loads. When Group Manage-ment Daemon (GMD) utiliza-tion becomes too high,GMD may restart to recov-er.

UnexpectedGroup Manage-ment restart dueto high memoryutilization

System Manage-ment

AS-49590

Not applicableGroup management servicemay restart during softwareupdate due to race condi-tion involving unlocking thedownload lock file.

Group manage-ment servicemay restart dur-ing software up-date

System Manage-ment

AS-72559

If a timeout occurs, the up-date can be completed us-ing the software --re-sume_update command.

Due to the number offirmware updates involved,software update going frompre-3.3.x versions to 3.3.xor later could take too longand eventually timeout.These update times maytake longer in larger multi-array group configurations.Software update in smallerarray groups should com-plete without intervention.

Updating arraygroups from ear-lier NimbleOS3.x releases to3.3.x or later re-leases couldtimeout

System Manage-ment

AS-57173

This is an intermittent issue,so if the software updatefails in this manner it shouldpass if the software updateis resumed.

The timing is close enoughthat it is possible for the in-dividual array precheckduring software update totake long enough that thehealth check timeout is trig-gered, causing the groupmanagement process torestart and the software up-date to fail.

Health checktimeout maycause softwareupdate failure

System Manage-ment

AS-66997

Please contact HPE NimbleStorage Support to updatethe compression algorithmsof these older volumes.

After updating to NimbleOS4.x, volumes initially createdwhen an array was runningNimbleOS 1.3.x and earliermay experience a negativeimpact on performance.This is caused by softwarechanges made to the com-pression algorithm used bythese older volumes.

Performance is-sues for vol-umes createdwhen array wasrunning Nim-bleOS versions1.3.x and earlier

System Manage-ment

AS-84276





The impacted array informa-tion can be found on Man-age Alarms page (SelectManage > Events >Alarms tab).

Within the HPE Nimble ar-ray GUI, the IP interfacedown alarm in the top ban-ner does not specify tellwhich array is impacted.

IP interfacedown alarmdoesnt specifywhich array isimpacted

System Manage-ment

AS-62777

In order to see the table ofvolumes, use another sup-ported Internet Browser,such as Chrome or Firefox.

When adding an array to agroup, a SET OFFLINEwindow may appear, with alist of volumes that thatneed to be set offline priorto adding the array. Whenusing Internet Explorer 11,this table is not populated.

SET OFFLINEwindow is emptyin IE11

System Manage-ment

AS-67850

Delete the appropriate pro-tection schedule with asnapshot interval of lessthan five minutes to meetthe system limits of theseprotections schedules, andretry the group merge oper-ation.

The GUI shows a generalerror message during groupmerge when the total countof snapshot schedules witha snapshot interval of lessthan five minutes exceedsfive: System limits for thenumber of protectionschedules would be violatedafter adding the array. Cur-rent limit is 5.

GUI shows ageneral errormessage duringgroup mergewhen, for thetwo groups, thetotal number ofsnapshot sched-ules with a snap-shot interval ofless than fiveminutes exceedsfive

System Manage-ment

AS-21697

Not applicableWithin the HPE NimbleStorage array GUI, there isno option to increase thewidth of the columns. Thismay lead to instanceswhere the displayed namefor a volume, volume collec-tion, etc, is truncated.

HPE NimbleStorage arrayGUI does notprovide a way toadjust the widthof the columns

System Manage-ment

AS-61710

Not applicableWhen selecting a customtime, and indicating a startand end time, the chart up-dates, but keeps refreshingand does not remain static.The chart then switches toa dynamic (live) mode andcontinues updating.

Replication Mon-itor - customtime does not re-main static

System Manage-ment

AS-14360

Not applicableIn NimbleOS 4.0.0.0 andlater, mass selection of vol-umes and volume collec-tions is not supported withinthe HPE Nimble StorageArray GUI.

Mass selectionof volumes andvolume collec-tions is not sup-ported

System Manage-ment

AS-56895





If the page hangs or throwsa web server communica-tion error, try to clean thecache and refresh. If theproblem persists, restart thebrowser.

When the GUI runs for along time, the browser mayencounter an out of memoryissue.

Browser throwsa web servercommunicationerror

System Manage-ment

AS-48847

Best practice: To help elimi-nate possible performanceissues for snapshot sched-ules that synchronize withMicrosoft Exchange, run thesnapshot verification nomore than once daily.

The user should not be al-lowed to specify VerifyBackups (VSS synchroniza-tion) on too frequent aschedule since it can con-sume so much time thatbackups can overlap andfail.

Frequent Verifi-cation in VSSsnapshot sched-ule needs to beprevented

System Manage-ment

AS-1960

Click the dropdown arrowand select a location fromthe pool and folder naviga-tion tree.

In the Create ReplicationPartner wizard, the InboundLocation is no longer auto-matically populated.

In the CreateReplication Part-ner wizard theinbound locationis no longer auto-matically populat-ed

System Manage-ment

AS-67289

Please reload the page oruse another supportedbrowser, such as GoogleChrome or Mozilla Firefox

When using Internet Explor-er to view the VMware Inte-gration page within the HPENimble Array GUI, you mayreceive an error stating thefollowing: The web serviceis unreachable or very slow.This issue occurs becausethe IE browser has an issuewith CORS requests due tocertificate revocationchecks.

Intermittent webservice is un-reachable errorwhen viewingVMware Integra-tion page usingIE

System Manage-ment

AS-69729





There is no workaround. Toavoid encountering this is-sue, reduce IO load whenperforming software update.

The underlying scale-outdatabase competes withCASL and other systemprocesses for IOPS. Duringsoftware update, a migra-tion script runs against thedatabase. Under heavy filesystem load, the migrationsteps may not completewithin the expected amountof time. As a result, the mi-gration may timeout leadingto a restart of the GroupData Service. After therestart, the migration shouldeventually complete as nor-mal without any user impactor intervention.

Group Data Ser-vice may restartwhen the arrayis under heavyload during soft-ware update

System InternalsAS-86901



NimbleOS 4.5.6.0 Release Notes...Valid license from Hewlett Packard Enterprise required for...

Documents

Transcript of NimbleOS 4.5.6.0 Release Notes...Valid license from Hewlett Packard Enterprise required for...