Welcome to
Atmos 2.1 System Administration course.
Click the Notes tab to view text that corresponds to the audio recording.
Click the Supporting Materials tab to download a PDF version of this eLearning.
Copyright © 1996, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007, 2008, 2009, 2010, 2011, 2012 EMC Corporation. All Rights Reserved. EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice.
THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.” EMC CORPORATION MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.
Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. EMC2, EMC, Data Domain, RSA, EMC Centera, EMC ControlCenter, EMC LifeLine, EMC OnCourse, EMC Proven, EMC Snap, EMC SourceOne, EMC Storage Administrator, Acartus, Access Logix, AdvantEdge, AlphaStor, ApplicationXtender, ArchiveXtender, Atmos, Authentica, Authentic Problems, Automated Resource Manager, AutoStart, AutoSwap, AVALONidm, Avamar, Captiva, Catalog Solution, C-Clip, Celerra, Celerra Replicator, Centera, CenterStage, CentraStar, ClaimPack, ClaimsEditor, CLARiiON, ClientPak, Codebook Correlation Technology, Common Information Model, Configuration Intelligence, Configuresoft, Connectrix, CopyCross, CopyPoint, Dantz, DatabaseXtender, Direct Matrix Architecture, DiskXtender, DiskXtender 2000, Document Sciences, Documentum, elnput, E-Lab, EmailXaminer, EmailXtender, Enginuity, eRoom, Event Explorer, FarPoint, FirstPass, FLARE, FormWare, Geosynchrony, Global File Virtualization, Graphic Visualization, Greenplum, HighRoad, HomeBase, InfoMover, Infoscape, Infra, InputAccel, InputAccel Express, Invista, Ionix, ISIS, Max Retriever, MediaStor, MirrorView,
Navisphere, NetWorker, nLayers, OnAlert, OpenScale, PixTools, Powerlink, PowerPath, PowerSnap, QuickScan, Rainfinity, RepliCare, RepliStor, ResourcePak, Retrospect, RSA, the RSA logo, SafeLine, SAN Advisor, SAN Copy, SAN Manager, Smarts, SnapImage, SnapSure, SnapView, SRDF, StorageScope, SupportMate, SymmAPI, SymmEnabler, Symmetrix, Symmetrix DMX, Symmetrix VMAX, TimeFinder, UltraFlex, UltraPoint, UltraScale, Unisphere, VMAX, Vblock, Viewlets, Virtual Matrix, Virtual Matrix Architecture, Virtual Provisioning, VisualSAN, VisualSRM, Voyence, VPLEX, VSAM-Assist, WebXtender, xPression, xPresso, YottaYotta, the EMC logo, and where information lives, are registered trademarks or trademarks of EMC Corporation in the United States and other countries.
This course provides details on the new software administration features of Atmos 2.1. This Atmos software release offers infrastructure changes and numerous user enhancements, including Graphical User Interface (GUI) additions, event management, node configuration and disk management, channel bonding, and Atmos Content Address Storage (CAS). This course also includes a demonstrative video for navigating the new Atmos 2.1 GUI.
The Atmos 2.1 GUI has many new enhancements that will allow for field personal and customers to navigate faster and gather system information. Operations have been grouped together for quick access. System information is better organized by the use of tabs. When the user logs into the system the most important information will be displayed at the top level screen such as failed disks and Recovery Jobs. Capacity information is available on a per RMG basis and per node basis. Event summaries by time range with drill down to node level event logs are also available.
NOTE:
IS = Installation Segment - a collection of an even number, 2 to 252, of Atmos Nodes SS = Storage Services
RMG = Resource Management Group - a site specific collection of one or more Installation Segments Node = Atmos System, Virtual or Physical
MDS = MetaData Services CM = Configuration Manager VE = Virtual Environment GUI = Graphical User Interface
The functionality of event management has changed in Atmos 2.1. Logging of events is now written to the event log database, which replaces the Alert.log.
What has been removed in Atmos 2.1? The reporting framework GUI.
System-level and RMG-level dashboards have Event Summary icons located in upper right-hand corner of the GUI.
Notification configuration for events is more granular for these options. The navigation menu on the left now has screen options to select specific policies for alert notifications. To configure these policies the system software serial number must be applied first before attempting to configure any of the available notifications.
After the user logs into Atmos using a web browser, the system summary page is displayed as shown. Information Events, Error Events, Warning Events, and Critical Events can be viewed for the last 24 hours, 7 days, 30 days, or you can view all events which have occurred in the
When the system administrator wants to activate a notification policy, he/she will select the respective category and from there enable or disable:
SNMP Trap notifications Email notifications
Remote syslog notifications
Once selected, the user can test the event configuration by selecting the test button or just submit the settings.
The system administrator can also set the notification severity level for SNMP Traps and Email. There are 4 notification levels to choose from. They are:
Information Warning Error Critical
By selecting the SNMP Configuration page, the system administrator can choose the Default (system) or specific RMG-level policy to configure.
The user can then add a SNMP NMS destination by clicking on the ‘Add’ link.
The system administrator can enable the Atmos SNMP agent and configure the agent to accept SNMP requests from a remote NMS.
If the user clicks “Add” in the SNMP Trap Configuration box, a new input box will appear. Criteria to input would be:
The IP address of a NMS (Trap Destination). The remote SNMP port or the remote NMS
community name (defaults to public) or the remote SNMP port or the remote NMS community name (defaults to public).
From the left-hand “Notification” menu, the system administrator would click on “Email” On the Email Configuration page, the user then can choose Default (system) or RMG-level policy to configure.
To configure remote Syslog Configuration, from the “Notification” menu, click on “Remote Syslog”.
This will bring up the Remote Syslog Configuration page.
The user can choose Default (system) or RMG-level policy to configure. A remote hostname and respective port number can be configured.
To configure remote SYR, from the left-hand “Notification” menu, click on “System Report” On the System report configuration page the system administrator can choose Default (system) or RMG-level policy to configure.
You can enable a receipt for SYR notifications, (SMTP must be configured prior to enabling these).
The customer name, Site ID, contact email and contact name are required fields.
Users can add a Primary Forwarding Server along with the well known port number. This can be an ESRS Gateway or a SMTP server.
You can add in any number of Failover Forwarding (ESRS or SMTP) servers.
A complete rewrite of Atmos disk management layer has been put into place for Atmos 2.1. Existing python based management scripts have been replaced by a C++ library which is currently executed as part of the cluster management. This new design is more reliable and implements a well understood state machine. The new code handles disk detection, disk formatting, and disk health monitoring.
An adjunct component called the Service Configurator also handles disk and file system provisioning to the MDS and SS services.
Disk management also interacts with recovery manager to report disk and DAE failures
By design, the disk management understands and deals with hierarchical relationship between disks and DAEs and between disks, volumes and file systems.
The RMG database is updated for presentation purposes and should be in synch under normal conditions, but Disk Management behavior is no longer dependent on the contents of RMG DB. The default file system for all DAE disks is XFS (ext3 is still used for OS drives).
Note: Local Repository in /var/local/maui/atmos-diskman and copied to 2 DAE hosted file systems to support node replacement.
Logging provided in /var/local/maui/dm.log
When a disk is determined to be disconnected or failed, disk management will notify the recovery manager of the failure and if the DAE is healthy.
The recovery manager will schedule a Storage Service recovery job when notified. When the DAE is healthy the recovery job will be scheduled to start in one hour. When the DAE is determined to be unhealthy the recovery job will be scheduled to start in one week.
Only one recovery job per node will be started by the recovery manager at one time. The user can view scheduled recovery jobs in the System Summary screen of the GUI.
The SysAdmin can start pending jobs or stop active jobs and can force more than one job to be run on a node.
With MDS Management, in the event of a disk failure, MDS evacuation of a disconnected file system will wait for 10 minutes to pass before moving requests to another MDS.
Immediate evacuation for file systems with a health status failure will occur. Logging information can be found in the /var/local/maui/dm.log.
For Storage Services Management, the system will wait one minute before applying configuration changes.
Storage Services file systems will be removed from the configuration upon detection of a disconnect or health status failure.
Storage Services file systems are re-added to the configuration upon reconnection of a healthy disk.
Most service and feature configurations are now under the control of the configuration management subsystem created in the Atmos 2.0 software release.
This provides the ability to scope configurations to different sets of nodes (Node, IS, RMG, System).
Scoping allows a user to have a default system wide configuration for a feature such as SMTP or NTP as well as to create RMG specific configurations as needed.
System management automatically ensures a node has the latest configuration information on startup.
Configuration information is maintained in the Configuration Management Database and needs to be updated via the GUI, or CLI, or hand-edited changes will be lost.
Network management in Atmos 2.1 allows for bonding of multiple public Atmos interfaces. VLAN tagging is at Layer 3 of the network stack.
With embedded network management, you now have the ability to channel bond across Ethernet interfaces 1,2,3. Support for VLAN tagging is supported across all external Ethernet interfaces. You can also modify the internal Atmos IP address ranges if so desired.
What this gives the customer is complete network management control. It is supported by an embedded CLI. Network configuration information is sent via connectHome to SYR for system records. The network management configurations are preserved with upgrades/node
The master node can be installed with optional VLAN tagging information for the initial public interface during a new installation. If configured at this time, the VLAN information is
propagated automatically for all slave nodes in the segment. A single public IP address will be shared for the management, data and access traffic. All other network management
You can modify the public (eth1 and above) network by using the network management CLI (netmgr).
The network management CLI lets you:
Bond physical interfaces for failover and to increase the bandwidth for the public network. You can bond eth1, eth2, and eth3, or any subset of these interfaces. Once the interfaces are bonded, you can create virtual interfaces, assign IP address, and optionally assign VLAN tags. You can also separate the network traffic on eth1, so that access, data, and system
management use different IP addresses.
In this example eth1, eth2, and eth3 can be bonded to form bond0.
The bond0 interface is assigned three virtual interfaces bond0, bond0:1, and bond0:2. Each bond0 virtual interface must be assigned its own IP address.
Here is a list of limitations for each type of network modification.
Ethernet channel bonding and network separation (VLAN tagging) is an industry standard and now a supported feature of Atmos 2.1.
Amazon S3 (Simple Storage Service) is an online storage web service offered by Amazon Web Services. Amazon S3 provides storage through web services interfaces (REST, SOAP, and
BitTorrent). Amazon launched S3, its first publicly available web service, in the United States in March 2006 and in Europe in November 2007. S3's design aims to provide scalability, high availability, and low latency at commodity costs.
Note:
REST - REpresentational State Transfer, is a style of software architecture for distributed systems such as the World Wide Web. REST has emerged over the past few years as a
predominant Web service design model. REST has increasingly displaced other design models such as SOAP and WSDL due to its simpler style.
SOAP - Simple Object Access Protocol, is a protocol specification for exchanging structured information in the implementation of Web Services in computer networks.
Atmos S3 native API support is an Atmos API module similar to the REST API, which supports the majority of the most commonly used S3 calls. This API module enables Atmos
compatibility with commercial or open source S3 applications. It also enables increased security with private cloud implementations. The benefits for customers are that the API is fully integrated and a supported feature of Atmos. You can now migrate existing custom S3 applications to the Atmos platform environment.
When using Atmos 2.0 software, S3 was supported by Atmos using a S3/Atmos Proxy server, which is a dedicated service that acts like a S3 API gateway and transforms S3 REST API calls into Atmos REST API calls. It is implemented as a web application that can be deployed in any of the servlet containers that conform to the Java Servlet API specification of version 2.5. For better scalability, S3/Atmos Proxy used a distributed centralized storage.
EMC source licensed the S3 Proxy code for existing Atmos customers. The licensing is similar to the ACDP portal licensing.
The proxy provided a mechanism to migrate applications from S3 to Atmos without requiring application modification or additional development.
The client/app just needs to replace the S3 credentials (Access Key ID/Secret Access Key) with the Atmos credentials (userid/shared secret).
The native implementation of the S3 API is contained in the Atmos 2.1 software. The S3 native API does not require application modification or additional development for existing S3
applications to work with Atmos.
The client/app just needs to replace the S3 credentials (Access Key ID/Secret Access Key) with the Atmos credentials (userid/shared secret).
Atmos Storage Administrators can now register tags per CAS application. They can define more granular information for search criteria provided by a combination of subtenantid and UID information. Both System and User metadata tags can now be registered.
Once tags are registered with a application, only new objects (CDF and Blobs) will have the tags transmitted to MDS. This transmission of new objects with metadata is a background process. The maximum number of tags that are allowed per application is 100. The removal of tags also supported.
With the new capabilities, adding or removing tags will result in audit logging.
Now there is support in the GUI for customers to define the set of CAS metadata to be
With these CAS enhancements, monitoring has been enhanced to support this feature. There are alerts which leverage the Atmos Event Manager.
C2A is the migration of objects from a single Centera virtual pool to a single subtenant on the Atmos 2.1 system configured and running CAS.
In this course we discussed then demonstrated the Graphical User Interface enhancements with a video tour
Explained key components of Event, Configuration and Disk management features Defined the Network Management capabilities and showed configuration with a video demonstration
Reviewed S3 and the features incorporated into the Atmos 2.1 software Explained the Atmos CAS enhancements
