Transcript
®
USER’S GUIDE
ServeRAID M5110 SAS/SATA Controller for IBM System x
First Edition (March 2012) © Copyright International Business Machines Corporation 2012. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
ii
Preface
This book contains installation instructions and specifications for the ServeRAID M5110 SAS/SATA Controller for IBM® System x®. For details on how to configure the storage controller, refer to the ServeRAID-M Software User’s Guide. For information about the operating system drivers, refer to the ServeRAID-M Device Driver Installation User’s Guide.
Organization
This document has the following chapters and appendices:
Chapter 1, Overview, provides a general overview of the ServeRAID M5110 SAS/SATA controller. Chapter 2, ServeRAID Controller Hardware Installation, describes the procedures for installing the ServeRAID M5110 SAS/SATA controller. Chapter 3, ServeRAID M5110 SAS/SATA Controller Characteristics, provides the characteristics and technical specifications for the ServeRAID M5110 SAS/SATA controller. Appendix A, Getting Help and Technical Assistance , explains how to get help and technical assistance with your ServeRAID products. Appendix B, Notices , contains information about warranties, trademarks, particulate contamination, and electronic emission notices. Appendix C, Glossary of Terms and Abbreviations , lists and explains the terms and abbreviations used in this manual.
ServeRAID M5110 SAS/SATA Controller for IBM System x User’s Guide
iii
Related Publications
ServeRAID-M Device Driver Installation User’s Guide This document explains how to install the ServeRAID-M device driver for your operating system. The information in this document is independent of the back-end bus and applies to the ServeRAID-M controllers. ServeRAID-M Software User’s Guide This document explains how to use the MegaRAID Storage Manager and WebBIOS configuration utilities to configure, monitor, and maintain the ServeRAID-M controller and the storage-related devices connected to the controller. ServeRAID MegaCLI User’s Guide This document explains how to use the MegaCLI (Command Line Interface) utility to configure, monitor, and maintain the ServeRAID-M controller and the storage-related devices connected to the controller. Safety Information This document contains translated caution and danger statements. Each caution and danger statement that appears in the documentation has a number that you can use to locate the corresponding statement in your language in the Safety Information document.
Notices and Statements
The caution and danger statements in this document are also in the multilingual Safety Information document, which is on the IBM Documentation CD. Each statement is numbered for reference to the corresponding statement in your language in the Safety Information document. The following notices and statements are used in this document: Note: These notices provide important tips, guidance, or advice.
iv
Preface
Important: Attention:
These notices provide information or advice that might help you avoid inconvenient or problem situations. These notices indicate potential damage to programs, devices, or data. An attention notice is placed just before the instruction or situation in which damage might occur. These statements indicate situations that can be potentially hazardous to you. A caution statement is placed just before the description of a potentially hazardous procedure, step, or situation. These statements indicate situations that can be potentially lethal or extremely hazardous to you. A danger statement is placed just before the description of a potentially lethal or extremely hazardous procedure step or situation.
CAUTION:
DANGER:
Safety
Use the following safety guidelines to help protect your computer system from potential damage and to ensure your own personal safety. Note: Use your ServeRAID M5110 SAS/SATA controller with UL-listed Information Technology Equipment (ITE) products only.
Preface
v
vi
Preface
Protecting against Electrostatic Discharge – Static electricity can harm delicate components inside your computer. To prevent static damage, discharge static electricity from your body before you touch any of your computer’s electronic components, such as the microprocessor. You can do so by touching an unpainted metal surface, such as the metal around the card-slot openings at the back of the computer. As you continue to work inside the computer, periodically touch an unpainted metal surface to remove any static charge your body may have accumulated. In addition to the preceding precautions, you can also take the following steps to prevent damage from electrostatic discharge:
When unpacking a static-sensitive component from its shipping carton, do not remove the component from the antistatic packing material until you are ready to install the component in your computer. Just before unwrapping the antistatic packaging, be sure to discharge static electricity from your body. When transporting a sensitive component, first place it in an antistatic container or packaging. Handle all sensitive components in a static-safe area. If possible, use antistatic floor pads and workbench pads.
Preface
vii
viii
Preface
Contents
Chapter 1
Overview 1.1 Overview 1.2 ServeRAID M5110 Controller Description and Limitations 1.2.1 Controller Limitations 1.3 Integrated MegaRAID Mode and MegaRAID Mode 1.3.1 Supported RAID Level Upgrades 1.3.2 Summary of RAID Levels 1.4 Configuration Scenarios 1.4.1 Number of Physical Disks Supported 1.5 Benefits of the SAS Interface 1.5.1 PCI Express Architecture 1.5.2 Operating System Support 1.6 Benefits of the ServeRAID M5110 SAS/SATA Controller 1.6.1 SAS Features 1.6.2 SAS Array Limitations 1.6.3 SATA III Features 1.6.4 PCI Express Performance 1.6.5 Usability Features 1.6.6 Flexibility Features 1.6.7 Drive Roaming 1.6.8 Drive Migration 1.6.9 New Drives Attached to a ServeRAID Controller 1.6.10 Automatic Rebuilds on New Drives 1.6.11 System (JBOD) Drives 1.7 Hardware Specifications 1.8 Technical Support
1-1 1-2 1-4 1-4 1-5 1-6 1-7 1-9 1-10 1-11 1-11 1-11 1-12 1-13 1-14 1-14 1-15 1-15 1-16 1-17 1-18 1-19 1-19 1-20 1-21
ServeRAID M5110 SAS/SATA Controller for IBM System x User’s Guide
ix
Chapter 2
ServeRAID Controller Hardware Installation 2.1 Requirements 2-1 2.2 Quick Installation 2-2 2.3 Detailed Installation 2-2 2.4 Connecting a ServeRAID-M5110 SAS/SATA Controller to a Drive Backplane on an Enclosure 2-6 2.5 After Installing the Controller 2-7
Chapter 3 ServeRAID M5110 SAS/SATA Controller Characteristics 3.1 ServeRAID M5110 SAS/SATA Controller Descriptions 3-1 3.1.1 Board Layout and Connector Information 3-1 3.2 Characteristics of the ServeRAID M5110 SAS/SATA Controller 3-5 3.3 Technical Specifications 3-6 3.3.1 Controller Specifications 3-6 3.3.2 Array Performance Features 3-7 3.3.3 Fault Tolerance 3-8 3.3.4 Power Supply Requirements for the ServeRAID M5110 SAS/SATA Controller 3-8 3.3.5 Operating and Non-operating Conditions 3-9 3.3.6 Safety Characteristics 3-9 Appendix A Getting Help and Technical Assistance A.1 Before you call A.2 Using the documentation A.3 Getting help and information from the World Wide Web A.4 How to send Dynamic System Analysis data to IBM A.5 Creating a personalized support web page A.6 Software service and support A.7 Hardware service and support A.8 IBM Taiwan product service Notices B.1 Trademarks B.2 Important Notes
A-2 A-3 A-3 A-3 A-4 A-4 A-4 A-5
Appendix B
B-2 B-3
x
Contents
B.3 B.4 B.5 B.6 Appendix C
Particulate contamination Documentation format Telecommunication regulatory statement Electronic emission notices
B-4 B-5 B-5 B-5
Glossary of Terms and Abbreviations
Contents
xi
xii
Contents
Figures 1.1 1.2 2.1 2.2 3.1 Example of a SAS Direct-Connect Application 1-8 Example of a ServeRAID Controller Configured with an Expander 1-9 ServeRAID M5110 Controller Installation in a PCI Express Slot 2-4 Connecting a ServeRAID M5110 Controller Internal Connector to a Drive Backplane 2-7 Card Layout for the ServeRAID M5110 SAS/SATA Controller 3-2
Contents
xiii
xiv
Contents
Tables 1.1 1.2 1.3 3.1 3.2 3.3 3.4 3.5 3.6 Physical Devices Required for Each RAID Level 1-9 ServeRAID M5110 SAS/SATA Controller Array Limitations 1-13 ServeRAID M5110 SAS/SATA Controller Specifications 1-20 ServeRAID M5110 SAS/SATA Controller Connectors 3-2 ServeRAID M5110 SAS/SATA Controller Characteristics 3-5 ServeRAID M5110 SAS/SATA Controller Specifications 3-6 Array Performance Features 3-7 Fault Tolerance Features 3-8 Power Supply for the ServeRAID M5110 SAS/SATA Controller 3-9
Contents
xv
xvi
Contents
Chapter 1 Overview
This chapter provides a general overview of the ServeRAID M5110 SAS/SATA controller, which has RAID control capabilities. It consists of the following sections:
Section 1.1, “Overview” Section 1.2, “ServeRAID M5110 Controller Description and Limitations” Section 1.3, “Integrated MegaRAID Mode and MegaRAID Mode” Section 1.4, “Configuration Scenarios” Section 1.5, “Benefits of the SAS Interface” Section 1.6, “Benefits of the ServeRAID M5110 SAS/SATA Controller” Section 1.7, “Hardware Specifications” Section 1.8, “Technical Support”
1.1
Overview
The ServeRAID M5110 Serial Attached SCSI (SAS)/Serial ATA (SATA) controller is a high-performance intelligent PCI Express-to-SAS/SATA controllers with RAID control capabilities. This controller provides reliability, high performance, and fault-tolerant disk subsystem management. The ServeRAID M5110 SAS/SATA controller is a versatile controller that provides the backbone of server environments. It is an ideal RAID solution for the storage of workgroup, departmental, and enterprise systems. This controller offers a cost-effective way to implement RAID in a server.
ServeRAID M5110 SAS/SATA Controller for IBM System x User’s Guide
1-1
The ServeRAID M5110 controller is based on the MegaRAID first-to-market SAS IC technology and proven technology. As a second-generation PCI Express controller, it addresses the growing demand for increased data throughput and scalability requirements across midrange and enterprise-class server platforms. IBM offers a family of SAS controller to address the needs for both internal solutions and external solutions. SAS technology brings a wealth of options and flexibility with the use of SAS devices and SATA devices within the same storage infrastructure. However, SAS devices and SATA devices bring individual characteristics that make each one a more suitable choice depending on your storage needs. MegaRAID gives you the flexibility to combine these two similar technologies on the same controller and within the same enclosure.
1.2
ServeRAID M5110 Controller Description and Limitations
The ServeRAID M5110 SAS/SATA controller is a PCI-Express 3.0, halfsize, half-height RAID controller based on the LSISAS2208 PCI ExpressSAS/SATA I/O Processor chip. The controller controls eight internal 6-Gb/s SAS/SATA ports through two SFF-8087 x4 internal mini SAS connectors. The controller integrates eight high-performance SAS/SATA PHYs and a PCI Express bus master DMA core. Each of the eight PHYs is capable of 6.0 Gb/s SAS link rates and 6.0 Gb/s SATA III link rates. The ServeRAID M5110 controller brings 6.0 Gb/s Serial Attached SCSI and 6.0 Gb/s Serial ATA performance to host controller, workstation, and server designs. The controller supports internal storage devices, which allows you to use a system that supports enterprise-class SAS drives, and desktop-class SATA drives. The controller can connect to drives directly. Simplified cabling between devices is an additional benefit. The controller is based on the LSISAS2208 ROC device. This device is compliant with the Fusion-MPT architecture and provides a PCI Express x8 interface. The LSISAS2208 ROC device provides an eight-lane, 8-GT/s (1GB/s) PCI Express host interface, eight 6.0 Gb/s SAS ports or eight 6.0 Gb/s SATA ports, and a full-featured, hardware-based RAID implementation.
1-2
Overview
The LSISAS2208 ROC device provides the maximum benefits of a RAID system and enables you to configure the system to satisfy your system requirements. The LSISAS2208 ROC device increases system performance and provides fault-tolerant data storage. The LSISAS2208 supports data striping across multiple disks, which reduces disk access time because multiple disks simultaneously read or write data. In addtion, the LSISAS2208 ROC device backs up data with either data mirroring or a parity block. Either backup method enables you to recover lost data in the event of a disk failure. You can select the data backup method that best suits your needs. A hardware RAID assist exclusive-OR (XOR) engine speeds parity generation and checking and reduces systemaccess times. The controller supports the SAS protocol as described in the Serial Attached SCSI Standard, version 2.0, and the SATA III protocol defined by the Serial ATA Revision 3.0 Specification. Note: You cannot mix SAS drives and SATA drives within the same virtual drive(s).
Each port on the controller supports SAS devices and/or SATA devices using the following:
SAS Serial SCSI Protocol (SSP), which enables communication with other SAS devices SATA, which enables communication with other SATA devices Serial Management Protocol (SMP), which communicates topology management information directly with an attached SAS expander device Serial Tunneling Protocol (STP), which enables communication with a SATA device through an attached expander
ServeRAID M5110 Controller Description and Limitations
1-3
1.2.1
Controller Limitations
The ServeRAID M5110 controller has the following limitations:
You can connect only one device per SAS PHY unless you use an expander You can use a maximum cable length of six feet (using shorter cables is preferred) Cables have to meet the SAS specification You cannot mix SAS drives and SATA drives in the same virtual drive You cannot mix SAS Solid State Drives (SSDs) or SATA SSDs and legacy mechanical drives (SAS or SATA) in the same virtual drive You cannot mix Solid State SAS drives and Solid State SATA drives in the same virtual drive
See Section 3.3.4, “Power Supply Requirements for the ServeRAID M5110 SAS/SATA Controller,” for information about the power requirements, and Section 3.3.5, “Operating and Non-operating Conditions” for information about the minimum and the maximum temperature ranges.
1.3
Integrated MegaRAID Mode and MegaRAID Mode
You can run this ServeRAID SAS/SATA controller in either integrated MegaRAID (iMR) mode or in MegaRAID (MR) mode. Integrated MegaRAID is a highly integrated, low-cost RAID solution made possible by Fusion-MPT™ architecture. Integrated MegaRAID is a processor-based, hardware RAID solution designed for system environments requiring redundancy and high availability where a fullfeatured RAID implementation is not desired or might be cost prohibitive. The major advantage of Integrated MegaRAID is that iMR provides RAID at the processor level, so it does not burden the CPU, which allows for more efficient operation.
1-4
Overview
The major advantage of MegaRAID mode is that the MR mode supports more RAID levels than iMR mode. iMR mode supports RAID levels 0, 1, 5, 10, and 50. MR mode supports RAID levels 0, 1, 5, 6, 10, 50, and 60. Note: Note: Note: iMR RAID 5 requires purchase of the Feature on Demand (FoD) upgrade. MegaRAID RAID 5/50 requires a transportable memory module (3 options). MegaRAID RAID 6/60 requires a transportable memory module (3 options) and the Feature on Demand upgrade.
See Section 1.3.1, “Supported RAID Level Upgrades” for information about these upgrades. See Section 1.3.2, “Summary of RAID Levels” for information about the supported RAID levels.
1.3.1
Supported RAID Level Upgrades
To use RAID levels 5, 6, 50, or 60 with this controller, you need to install a Feature on Demand (FoD) upgrade and/or a transportable memory module (TMM), depending on the RAID level. This controller supports iMR RAID levels 5 and 50 with the following installed Feature on Demand upgrade: – ServeRAID M5100 Series Zero Cache/RAID 5 Upgrade for IBM System x
This controller supports MegaRAID RAID levels 5 and 50 with any of the following installed transportable memory modules: – – – ServeRAID M5100 Series 512MB Cache/RAID 5 Upgrade for IBM System x ServeRAID M5100 Series 512MB Flash/RAID 5 Upgrade for IBM System x ServeRAID M5100 Series 1GB Flash/RAID 5 Upgrade for IBM System x
Integrated MegaRAID Mode and MegaRAID Mode
1-5
This controller supports MegaRAID RAID levels 6 and 60 with any of the following installed transportable memory modules and the Feature on Demand upgrade: – – – – ServeRAID M5100 Series 512MB Cache/RAID 5 Upgrade for IBM System x ServeRAID M5100 Series 512MB Flash/RAID 5 Upgrade for IBM System x ServeRAID M5100 Series 1GB Flash/RAID 5 Upgrade for IBM System x ServeRAID M5100 Series RAID 6 Upgrade for IBM System x (FoD)
1.3.2
Summary of RAID Levels
RAID levels describe a system for ensuring the availability and redundancy of data stored on large disk subsystems. RAID 0 uses striping to provide high data throughput, especially for large files in an environment that does not require fault tolerance. RAID 1 uses mirroring so that data written to one drive is simultaneously written to another drive. This is good for small databases or other applications that require small capacity but complete data redundancy. RAID 5 uses disk striping and parity data across all drives (distributed parity) to provide high data throughput, especially for small random access. RAID 6 uses distributed parity, with two independent parity blocks per stripe, and disk striping. A RAID 6 virtual drive can survive the loss of two drives without losing data. A RAID 6 drive group, which requires a minimum of three drives, is similar to a RAID 5 drive group. Blocks of data and parity information are written across all drives. The parity information is used to recover the data if one or two drives fail in the drive group. RAID 10, a combination of RAID 0 and RAID 1, consists of striped data across mirrored spans. A RAID 10 drive group is a spanned drive group that creates a striped set from a series of mirrored drives. RAID 10 allows a maximum of eight spans. You must use an even number of
1-6
Overview
drives in each RAID virtual drive in the span. The RAID 1 virtual drives must have the same stripe size. RAID 10 provides high data throughput and complete data redundancy but uses a larger number of spans. RAID 50, a combination of RAID 0 and RAID 5, uses distributed parity and disk striping. A RAID 50 drive group is a spanned drive group in which data is striped across multiple RAID 5 drive groups. RAID 50 works best with data that requires high reliability, high request rates, high data transfers, and medium-to-large capacity. RAID 60, a combination of RAID 0 and RAID 6, uses distributed parity, with two independent parity blocks per stripe in each RAID set, and disk striping. A RAID 60 virtual drive can survive the loss of two drives in each of the RAID 6 sets without losing data. It works best with data that requires high reliability, high request rates, high data transfers, and medium-to-large capacity. Note: Having virtual drives of different RAID levels, such as RAID 0 and RAID 5, in the same drive group is not allowed. For example, if an existing RAID 5 virtual drive is created out of partial space in an array, the next virtual drive in the array has to be R5 only.
1.4
Configuration Scenarios
There are two main scenarios in which you can use this ServeRAID controller:
Low-end, internal SATA configuration: In this configuration, use the ServeRAID controller as a high-end SATA compatible controller that connects to several SATA disks. This type of configuration is mostly for low-end or entry servers. Enclosure management is provided through out-of-band I2C bus. Side bands of both types of internal SAS connectors support the SFF-8485 (SGPIO) interface. Midrange, internal SAS configuration: This configuration is like the internal SATA configuration, but with high-end disks. This type of configuration is more suitable for low-range to midrange servers.
The following figure shows a direct-connect configuration. The Inter-IC (I2C) interface communicates with peripherals. The external memory bus provides a 32-bit memory bus, parity checking, and chip select signals
Configuration Scenarios
1-7
for pipelined synchronous burst static random access memory (PSBRAM), nonvolatile static random access memory (NVSRAM), and Flash ROM. Figure 1.1 Example of a SAS Direct-Connect Application
SAS/SATA III Device SAS PCI Express RAID Controller
SAS/SATA III Device SAS/SATA III Device
32-Bit Memory Address/Data Bus I 2C Interface
Flash ROM/ PSBRAM/ NVSRAM I2 C
SAS/SATA III Device
PCI Express Interface
1-8
Overview
The following figure shows an example of a ServeRAID controller configured with an expander that is connected to SAS disks, SATA disks, or both. Figure 1.2 Example of a ServeRAID Controller Configured with an Expander
PCI Express Interface 8 Peripheral Bus 72-bit DDR/DDR2 with ECC Interface
SAS RAID Controller
PCI Express to SAS ROC
Flash ROM/ NVSRAM/ I2C/UART SRAM SDRAM SRAM
Expander
SAS/SATA Drives
Expander
SAS/SATA III Drives
SAS/SATA III Drives
SAS/SATA III Drives
SAS/SATA III Drives
1.4.1
Number of Physical Disks Supported
Your configuration planning for your ServeRAID controller depends in part on the number of physical disks that you want to use in a RAID array. The number of drives in an array determines the RAID levels that can be supported by this controller. Only one RAID level can be assigned to each virtual disk. Table 1.1 shows the minimum number and the maximum number of drives required for each RAID level. Table 1.1
RAID Level 0 1 5
Physical Devices Required for Each RAID Level
Minimum # of Physical Devices 1 2 3 Maximum # of Physical Devices 32 2 32
Configuration Scenarios
1-9
Table 1.1
RAID Level 6 10 50 60
Physical Devices Required for Each RAID Level (Cont.)
Minimum # of Physical Devices 3 4 6 6 Maximum # of Physical Devices 32 32 32 32
1.5
Benefits of the SAS Interface
SAS is a serial, point-to-point, enterprise-level device interface that leverages the proven SCSI protocol set. SAS combines the advantages of SATA, SCSI, and Fibre Channel, and is the future mainstay of the enterprise and high-end workstation storage markets. SAS offers a higher bandwidth per pin than parallel SCSI, and it improves signal and data integrity. The SAS interface uses the proven SCSI command set to ensure reliable data transfers, while providing the connectivity and flexibility of point-to-point serial data transfers. The serial transmission of SCSI commands eliminates clock-skew challenges. The SAS interface provides improved performance, simplified cabling, smaller connectors, lower pin count, and lower power requirements when compared to parallel SCSI. The ServeRAID M5110 SAS/SATA controller leverages a common electrical and physical connection interface that is compatible with Serial ATA technology. The SAS protocols and SATA protocols use a thin, 7-wire connector instead of the 68-wire SCSI cable or 26-wire ATA cable. The SAS/SATA III connector and cable are easier to manipulate, allow connections to smaller devices, and do not inhibit airflow. The point-topoint SATA III architecture eliminates inherent difficulties created by the legacy ATA master-slave architecture, while maintaining compatibility with existing ATA firmware.
1-10
Overview
1.5.1
PCI Express Architecture
PCI Express is a local bus system designed to increase data transfers without slowing down the central processing unit (CPU). You can install your ServeRAID M5110 controller PCI Express SAS/SATA controller in PCI Express computer systems with a standard bracket type. With this controller in your system, you can connect SCSI devices and SATA devices over the bus. PCI Express goes beyond the PCI specification in that it is intended as a unifying I/O architecture for various systems: desktops, workstations, mobile, server, communications, and embedded devices.
1.5.2
Operating System Support
To check for the latest list of supported operating systems and to download the drivers for those operating systems, see http://www.ibm.com/systems/support/. The ServeRAID M5110 controller uses Fusion-MPT™ architecture for all major operating systems, thinner drivers, and better performance.
1.6
Benefits of the ServeRAID M5110 SAS/SATA Controller
This section provides a summary of the features and the benefits of the ServeRAID M5110 SAS/SATA controller. It contains information on SAS features, SATA features, PCI performance, integration, usability, and flexibility. The controller offers the following features:
PCI Express x8 lane width PCI Express performance up to 8 GT/s (1 GB/s) per lane Two internal connectors Support for RAID levels 0, 1, 5, 10, and 50 in iMR mode Support for RAID levels 0, 1, 5, 6, 10, 50, and 60 in MR mode Note: To use RAID levels 5/50/6/60 with this controller, you need to install a Feature on Demand (FoD) upgrade and/or a
Benefits of the ServeRAID M5110 SAS/SATA Controller
1-11
transportable memory module (TMM). See Section 1.3.1, “Supported RAID Level Upgrades” for information about these upgrades.
Advanced array configuration and management utilities Online RAID level migration Drive migration Drive roaming Media scan No reboot necessary after expansion More than 200 Qtags per array User-specified rebuild rate 32-Kbyte nonvolatile random access memory (NVRAM) for storing RAID system configuration information; the MegaRAID SAS firmware is stored in flash ROM for easy upgrade.
1.6.1
SAS Features
The following list describes the SAS features of the ServeRAID M5110 controller:
Provides eight fully independent PHYs Supports 6.0 Gb/s SAS data transfers per PHY Supports SSP to enable communication with other SAS devices Supports SMP to communicate topology management information Provides a serial, point-to-point, enterprise-level storage interface Simplifies cabling between devices Supports wide ports consisting of 2, 3, or 4 PHYs within a single quad port Supports narrow ports consisting of a single PHY Transfers data using SCSI information units
1-12
Overview
1.6.2
SAS Array Limitations
This section describes the array limitations of the controller. These include limitations such as the number of physical disks supported, the maximum number of disks per controller, and the maximum number of virtual disks allowed per controller. Table 1.2 lists the array limitations for the ServeRAID M5110 controller. Table 1.2 ServeRAID M5110 SAS/SATA Controller Array Limitations
Specification Maximum virtual disks per controller Maximum arrays per controller Maximum virtual disks per array Maximum physical devices per array Maximum physical devices per controller ServeRAID M5110 SAS/SATA Controller 64 128 16 32 128 Note: Can support up to 64 devices, but only 16 can be used in a RAID configuration. 128 8 2
Maximum hot spares per controller Maximum spans per virtual disk Maximum ports
Note:
The maximum number of hot spares per array is equal to the maximum number of physical drives per array.
The controller supports 64-bit logical block addressing (LBA), which makes it possible to connect a large number of drives to the RAID controller, directly and through expanders. However, the actual number of drives that you can attach depends on the limits listed in Table 1.2 rather than by the actual RAID volume capacity. The maximum numbers in Table 1.2 depend on how many physical devices you have connected to the controller. For example, the maximum number of arrays per controller is equal to the number of physical disks supported by the controller up to the limit of 128 arrays per controller. In addition, though you can have up to 16 virtual disks per
Benefits of the ServeRAID M5110 SAS/SATA Controller
1-13
array, and up to 128 arrays per controller, there is a limit of 64 virtual disks per controller.
1.6.3
SATA III Features
The following list describes the SATA III features of the ServeRAID ServeRAID M5110 controller:
Supports SATA III data transfers of 6.0 Gb/s Supports STP data transfers of 3.0 Gb/s Provides a serial, point-to-point storage interface Simplifies cabling between devices Eliminates the master-slave construction used in parallel ATA Allows addressing of multiple SATA III targets through an expander Allows multiple initiators to address a single target (in a fail-over configuration) through an expander Displays activity and fault indicators for each PHY Supports Port Selector (for dual-port drives) Each port on the controller supports SAS devices, SATA devices, or both using SSP, SMP, STP, and SATA. SSP enables communication with other SAS devices. Enables the controller to communicate with other SATA devices. Supports staggered spin-up Supports hot plug
1.6.4
PCI Express Performance
The following list describes the PCI Express performance features of the ServeRAID M5110 controller:
Provides a PCI Express 3.0 interface that: – – – – Supports a dedicated PCI Express bus Supports x8 lane configuration Supports transfer rates of up to 8 GT/s (1 GB/s) per lane Complies with the PCI Express Specification, Revision 3.0
1-14
Overview
Provides unequaled performance through the Fusion-MPT architecture Provides high throughput and low CPU utilization to offload the host processor
1.6.5
Usability Features
The following list describes the usability features of the ServeRAID M5110 controller:
Simplifies cabling with point-to-point, serial architecture Supports smaller, thinner cables that do not restrict airflow Provides drive spin-up sequencing control Provides up to two LED signals for each PHY to indicate link activity and faults Provides an I2C interface for enclosure management Supports the external SAS Sideband signal SFF-8485 (SGPIO) interface
1.6.6
Flexibility Features
These features increase the flexibility of the ServeRAID M5110 controller:
Supports a Flash ROM interface, a nonvolatile static RAM (NVSRAM) interface, and a pipelined synchronous burst SRAM (PSBRAM) interface Offers a flexible programming interface to tune I/O performance Allows mixed connections to SAS targets or SATA III targets Leverages compatible connectors for SAS connections and SATA III connections Allows grouping of up to four PHYs in a single quad port to form a wide port Allows programming of the World Wide Name
Benefits of the ServeRAID M5110 SAS/SATA Controller
1-15
1.6.7
Drive Roaming
Drive roaming occurs when the physical disks are changed to different ports on the same controller. When the drives are placed on different channels, the controller detects the RAID configuration from the configuration data on the drives. Note: In a clustering environment, drive roaming is supported within the same channel only.
Configuration data is saved in both the NVRAM on the RAID controller and on the drives attached to the controller. This action maintains the integrity of the data on each drive, even if the drives have changed their target ID. Note: If you move a drive that is being rebuilt, the rebuild operation restarts; it does not resume from where the rebuild operation stopped.
Follow these steps to use drive roaming: Step 1. Turn off the power to the server and all physical disks, enclosures, and system components. Disconnect the power cords from the system. Open the host system by following the instructions in the host system technical documentation. Move the drives to different positions on the backplane to change the targets. Determine the SAS target requirements. Perform a safety check. a. Make sure that the drives are inserted correctly. b. Close the cabinet of the host system. Step 6. Step 7. Reconnect the power cords to the system. Turn on the power to the system. The controller then detects the RAID configuration from the configuration data on the drives.
Step 2. Step 3. Step 4. Step 5.
1-16
Overview
1.6.8
Drive Migration
Drive migration is the transfer of a set of drives in an existing configuration from one controller to another. The drives must remain on the same channel and must be reinstalled in the same order as in the original configuration. The controller to which you migrate the drives cannot have an existing configuration. Note: Note: Only whole virtual disks can be migrated automatically; partial virtual disks can be migrated manually. Drive roaming and drive migration cannot be supported at the same time.
Follow these steps to migrate drives: Step 1. Make sure that you clear the configuration on the system to which you migrate the drives, to prevent a configuration data mismatch between the drives and the NVRAM. When you migrate drives, move only the disks that make up the virtual disk (not all of the physical disks in an array), so that you do not have an NVRAM mismatch error (providing a configuration is on the destination controller). The NVRAM mismatch error appears only if you move all of the drives to the other controller.
Note:
Step 2.
Turn off the power to the server and all physical disks, enclosures, and system components. Disconnect the power cords from the systems. Open the host system, following the instructions in the host system technical documentation. Remove the SAS cable connectors from the internal drives that you want to migrate. a. Make sure that pin 1 on the cable matches pin 1 on the connector. b. Make sure that the SAS cables conform to all SAS specifications.
Step 3. Step 4.
Step 5.
Remove the physical disks from the first system, and insert them into drive bays on the second system.
Benefits of the ServeRAID M5110 SAS/SATA Controller
1-17
Step 6. Step 7. Step 8.
Connect the SAS cables to the physical disks in the second system. Determine the SAS target requirements. Perform a safety check. a. Make sure that all of the cables are attached correctly. b. Make sure that the RAID controller is installed correctly. c. Close the cabinet of the host system.
Step 9.
Reconnect the power cords to the system. The controller detects the RAID configuration from the configuration data on the drives.
Step 10. Turn on the power to the system.
1.6.9
New Drives Attached to a ServeRAID Controller
In the Integrated RAID mode, when you insert a new drive with valid metadata into a ServeRAID system, the drive state of the new drive is either foreign or unconfigured bad. The specific drive state depends on the Maintain PD Fail History setting, and whether the drive had been inserted in the system before. The Maintain PD Fail History setting, when enabled, maintains the history of all drive failures. A foreign configuration is a storage configuration that already exists on the new drive that you install in the system. The configuration utilities allow you to import the foreign configuration to the controller, or to clear the configuration so you can create a new configuration using the new drive. Note: See the ServeRAID-M Software User’s Guide for the procedures used to import a foreign configuration or change a drive state from unconfigured bad to unconfigured good.
1-18
Overview
1.6.10 Automatic Rebuilds on New Drives
Automatic rebuilds occur when the drive slot status changes. For example, an automatic rebuild occurs when you insert a new drive or when you remove a drive and a hot spare replaces the removed drive.
1.6.11 System (JBOD) Drives
The iMR mode supports drives in pass-through mode, which are identified as "system" drives. These drives are also known as JBOD (Just a Bunch of Disks) drives. When a drive without valid metadata is inserted in a system, if the drive has a drive state of unconfigured good, it is identified as unconfigured good; otherwise, the drive is marked as a system drive. System drives are exposed directly to the operating system. The host system can read data from and write data to the system drives; however, you cannot use system drives in a RAID configuration. You can change system drives into unconfigured good drives (you can also change unconfigured good drives intoto system drives). When a system drive is changed to an unconfigured good drive, the unconfigured good drive state of the drive is maintained after reboot, drive removal, or drive insertion. You can use system drives as bootable drives. iMR supports up to 63 system drives and up to 16 unconfigured good drives.
Benefits of the ServeRAID M5110 SAS/SATA Controller
1-19
1.7
Hardware Specifications
You can install your ServeRAID M5110 controller in a computer with a mainboard that has a PCI Express slot. Table 1.3 describes the hardware configuration features of the controller. Table 1.3
Specification RAID Levels
ServeRAID M5110 SAS/SATA Controller Specifications
ServeRAID M5110 SAS/SATA Controller iMR mode: 0, 1, 5, 10, and 50 MR mode: 0, 1, 5, 6, 10, 50, and 60 Note: To use certain RAID levels with this controller, you need to install a Feature on Demand (FoD) upgrade and/or a transportable memory module (TMM). See Section 1.3.1, “Supported RAID Level Upgrades” for information about these upgrades. Up to 8 SAS devices or 8 SATA devices (such as drives and expanders) Eight internal Up to 6 Gb/s per phy PCI Express 3.0 No1. See the not at the bottom of this table. Yes. Up to 64 virtual disks per controller. Yes. Up to 128 arrays per controller. Yes Yes Yes Yes Yes
Devices Supported per Port Ports Data Transfer Rate Bus Cache Function Multiple Virtual Disks per Controller Multiple Arrays per Controller Online Capacity Expansion Dedicated and Global Hot Spares Hot Swap Devices Supported Non-Disk Devices Supported Mixed Capacity Physical Disks Supported Number of Internal Connectors Hardware Exclusive OR (XOR) Assistance
Two SFF-8087 x4 internal mini SAS connectors Yes
1-20
Overview
Table 1.3
Specification
ServeRAID M5110 SAS/SATA Controller Specifications
ServeRAID M5110 SAS/SATA Controller
Direct I/O Yes Architecture Fusion-MPT 1 In MR mode, the ServeRAID M5110 SAS/SATA controller supports cache policy, which includes write-back, write-through, adaptive read ahead, non-read ahead, read ahead, cache I/O, and direct I/O settings. However, in iMR mode, the controller does not support these cache policy settings. See Section 1.3, “Integrated MegaRAID Mode and MegaRAID Mode” for more information about MR mode and iMR mode.
1.8
Technical Support
For information about the technical support available for this product, see Appendix A, “Getting Help and Technical Assistance”.
Technical Support
1-21
1-22
Overview
Chapter 2 ServeRAID Controller Hardware Installation
This chapter describes the procedures used to install the ServeRAID M5110 SAS/SATA controller. It consists of the following sections:
Section 2.1, “Requirements” Section 2.2, “Quick Installation” Section 2.3, “Detailed Installation” Section 2.4, “Connecting a ServeRAID-M5110 SAS/SATA Controller to a Drive Backplane on an Enclosure” Section 2.5, “After Installing the Controller”
2.1
Requirements
The following items are required for installation:
A ServeRAID M5110 SAS/SATA controller A host system with an available PCI Express expansion slot The ServeRAID M Documentation CD containing the documentation The necessary internal cables SAS physical disks or SATA physical disks (Mechanical or Solid State Devices, SSDs) Note: For optimal performance, use an uninterruptible power supply.
ServeRAID M5110 SAS/SATA Controller for IBM System x User’s Guide
2-1
2.2
Quick Installation
The following steps are for quick installation of your controller. These steps are for experienced computer users/installers. Section 2.3, “Detailed Installation,” contains the steps for all others to follow. Step 1. Review all safety information provided with the server; then, turn off the power to the server and all of the attached devices, and unplug the server and the device power cords. Open the cabinet of the host system by following the instructions in the host system technical documentation. Install the controller in the server and connect the SAS devices or the SATA devices to it. Make sure that the cables you use conform to all specifications. Perform a safety check. a. Make sure that all cables are properly attached b. Make sure that the controller is installed correctly c. Step 5. Step 6. Close the cabinet of the host system Reconnect the power cords to the system and to all attached devices. Turn on the power to the system after you complete the safety check.
Step 2. Step 3.
Step 4.
2.3
Detailed Installation
This section provides detailed instructions for installing a ServeRAID M5110 controller. Step 1. Unpack the Controller Unpack and remove the controller. Inspect it for damage. If it appears damaged, or if any of the following items are missing, contact your place of purchase. The controller is shipped with the following items: – A CD containing an electronic version of this User’s Guide and other related documentation
2-2
ServeRAID Controller Hardware Installation
– Step 2.
Warranty information
Turn off the Power to the System Review all safety information provided with the computer; then, turn off the power to the computer, unplug the power cords from the power supplies, disconnect the computer from the network, and remove the computer cover. See the documentation provided with the computer for instructions. Before you install the controller, make sure that the computer is disconnected from the power and from any networks.
Step 3.
Review the Controller Connectors Refer to Chapter 3, “ServeRAID M5110 SAS/SATA Controller Characteristics” for a diagram of the ServeRAID M5110 controller with its connectors.
Step 4.
Review the Controller Limitations Review Section 1.2.1, “Controller Limitations” before you install the controller in the system.
Step 5.
Install the Controller Select a PCI Express slot and align the controller’s PCI Express bus connector to the slot. Press down gently but firmly to ensure that the card is properly seated in the slot. Secure the bracket to the computer chassis. Figure 2.1 shows the installation of the ServeRAID M5110 controller in a PCI Express slot.
Note:
Some PCI Express slots support PCI Express graphics cards only. If a RAID controller is installed one of those slots, the controller does not function. To avoid damage to the computer, always remove the controller from the PCI Express slot before you relocate or ship the computer.
Attention:
Detailed Installation
2-3
Figure 2.1
ServeRAID M5110 Controller Installation in a PCI Express Slot
Bracket Screw
Press Here
Press Here
PCI Express Edge of Motherboard
3_00793-00
Step 6.
Connect the Controller to the Drive Backplane on an Enclosure Use cables to connect the controller to the drive backplane of an enclosure that contains SAS devices, SATA devices, or both. Refer to Section 2.4, “Connecting a ServeRAID-M5110 SAS/SATA Controller to a Drive Backplane on an Enclosure” for details about connecting the controller to the enclosure.
Step 7.
Turn on the Power to the System Reinstall the computer cover and reconnect the AC power cords; then, turn on the power to the computer. Make sure that the power is turned on to the SAS devices and the SATA III devices before or at the same time as the host
2-4
ServeRAID Controller Hardware Installation
computer. If the power is turned on to the computer before it is turned on to the devices, the computer might not recognize the devices. For the United Extensible Firmware Interface (UEFI), no BIOS message displays. Press F1 to enter System Setup. Refer to your system user’s guide for specific configuration information. Under other interfaces or operating systems, a BIOS message appears during boot. The firmware takes several seconds to initialize. The configuration utility prompt times out after several seconds. The second portion of the BIOS message displays the controller number, firmware version, and cache SDRAM size. The numbering of the controller follows the PCI slot scanning order used by the host mainboard. Step 8. Run the WebBIOS Configuration Utility Run the WebBIOS Configuration Utility to configure the physical arrays and the logical drives. When the message Press
for WebBIOS appears on the screen, press CTRL+H immediately to run the utility. Step 9. Install the Operating System Driver The controller can operate under various operating systems. To operate under these operating systems, you must install the software drivers. You can find and download the latest drivers at http://www.ibm.com/support/. For updates, click Downloads and drivers. Device driver updates are made available periodically. To ensure that you have the current version of the driver, download the latest driver at http://www.ibm.com/support/. See the readme file that accompanies the driver for any updated information. For details on installing the driver, refer to the ServeRAID-M Device Driver Installation User’s Guide on the ServeRAID M Documentation CD. Be sure to use the latest Service Packs provided by the operating system manufacturer and to review the readme file that accompanies the driver.
Detailed Installation
2-5
2.4
Connecting a ServeRAID-M5110 SAS/SATA Controller to a Drive Backplane on an Enclosure
This section describes how to connect the ServeRAID M5110 SAS/SATA controller by cable to the drive backplane on an enclosure. The enclosure can contain SAS drives and SATA drives. Both the SAS protocols and the SATA protocols use a thin, 7-wire connector instead of the 68-wire SCSI cable or 26-wire ATA cable. An iPass™ cable with an internal x4 mini-SAS 4i (SFF-8087) connector at each end is used to connect the controller to the drive backplane of an enclosure containing SAS drives and/or SATA drives. Note: Use only straight SAS cables, not cross-over SAS cables.
Follow these steps to connect the internal x4 mini-SAS 4i (SFF-8087) connector on the cable to the controller and the drive backplane. Step 1. Step 2. Step 3. Step 4. Read the safety information that comes with the controller Turn off the server and peripheral devices and disconnect the power cords. Remove the server cover. Plug the internal x4 mini-SAS 4i (SFF-8087) connector on one end of the cable into the x4 SAS port 0-3 connector on the controller, as shown in the following figure. Plug the internal x4 mini-SAS 4i (SFF-8087) connector on the other end of the cable into the port connector on the drive backplane. You can use another cable to connect the other internal x4 mini-SAS 4i (SFF-8087) connector on the controller to the other port connector on the drive backplane.
Step 5.
2-6
ServeRAID Controller Hardware Installation
Figure 2.2
Connecting a ServeRAID M5110 Controller Internal Connector to a Drive Backplane
3_01278-00
Step 6. Step 7. Step 8. Step 9.
Replace the server cover. Slide the server into the rack. Reconnect the power cords and any cables that you removed. Turn on the peripheral devices and the server.
2.5
After Installing the Controller
After the you install the controller, you must configure it and install the operating system driver. The ServeRAID-M Software User’s Guide instructs you on the configuration options and how to set them on your controller. The ServeRAID-M Device Driver Installation User’s Guide provides detailed installation instructions for operating system drivers.
After Installing the Controller
2-7
2-8
ServeRAID Controller Hardware Installation
Chapter 3 ServeRAID M5110 SAS/SATA Controller Characteristics
This chapter describes the characteristics of the ServeRAID M5110 SAS/SATA controller. It consists of the following sections:
Section 3.1, “ServeRAID M5110 SAS/SATA Controller Descriptions” Section 3.2, “Characteristics of the ServeRAID M5110 SAS/SATA Controller” Section 3.3, “Technical Specifications”
3.1
ServeRAID M5110 SAS/SATA Controller Descriptions
The ServeRAID M5110 SAS/SATA controller is dual PHY, SAS PCI Express controllers and is used in systems with a PCI Express slot. PCI Express goes beyond the PCI specification in that it is intended as a unifying I/O architecture for various systems: desktops, workstations, mobile, server, communications, and embedded devices. The ServeRAID M5110 controller has one LSISAS2208 ROC (RAID-onchip) processor that controls eight internal SAS/SATA ports through two SFF-8087 x4 internal mini SAS connectors.
3.1.1
Board Layout and Connector Information
This subsection provides the board layout and connector information for the controller. The following subsections provide graphics and connector information for the controller. The controller has eight internal SAS/SATA connectors. The followoing figure displays the connectors on the controller, which are described on Table 3.1.
ServeRAID M5110 SAS/SATA Controller for IBM System x User’s Guide
3-1
Figure 3.1
Card Layout for the ServeRAID M5110 SAS/SATA Controller
J1A1 J1A2 J1A3
J5A1 J6A1
J1A4 J1A5 J1A8 J1A7
J2B1
J2B2
J5B1 J1B1
J2B4
WILL REPLACE WITH UPDATED GRAPHIC Table 3.1 ServeRAID M5110 SAS/SATA Controller Connectors
Connector Description J1A1 Global drive fault LED header
Type 2-pin connector
Comments Connects to an LED that indicates whether a drive is in a fault condition.
J1A1
J1A2
Write pending LED header
+ve a
-ve k
2-pin connector
J1A2
Connects to an LED that indicates when the data in the cache has yet to be written to the storage devices. Used when the write-back feature is enabled.
J1A3
Test header
+ve a
-ve k
2-pin connector
Reserved for internal use.
3-2
ServeRAID M5110 SAS/SATA Controller Characteristics
Table 3.1
ServeRAID M5110 SAS/SATA Controller Connectors (Cont.)
Type Comments Connects to an LED that indicates activity on the drives connected to the controller.
Connector Description J1A4
Activity LED header 2-pin connector
J1A4
+ve a
-ve k
J1A5
Individual PHY and Drive Fault Indication header Ports 3-0 Ports 7-4
2x8-pin header
-ve k
+ve a
Connects to an LED that indicates whether a drive is in a fault condition. There is one LED per port. When lit, each LED indicates the corresponding drive has failed or is in the Unconfigured-Bad state. The LEDs function in a directattach configuration (there are no SAS expanders). Direct attach is defined as a maximum of one drive connected directly to each port.
J1A5
J1A7 Enclosure Management connector I2C 3-pin connector Supports SES (SCSI enclosure services) over I2C through an internal I2C backplane cable.
1 2 3
J1A7
ServeRAID M5110 SAS/SATA Controller Descriptions
3-3
Table 3.1
ServeRAID M5110 SAS/SATA Controller Connectors (Cont.)
Type Comments Installing this jumper causes the RAID controller to run in I2O Mode. The default mode of operation is without the shunt. Note: The MegaRAID firmware does not require this connector to be installed in order to function. Provides controller information, such as the serial number, revision, and manufacturing date. The default is no shunt installed.
Connector Description J1A8
I2O Mode Selection 2-pin header
J1B1
Serial EEPROM (SBR)
2-pin connector
J2B1
x4 SAS Ports 4-7 internal connector
SFF-8087 Connects the controller by cable mini-SAS 4i to SAS drives or SATA III drives. internal connector SFF-8087 Connects the controller by cable mini-SAS 4i to SAS drives or SATA III drives. internal connector This interface provides power to the board and an I2C interface connected to the I2C bus for IPMI.
J2B2
x4 SAS Ports 0-3 internal connector
J2B4
PCI Express® The RAID Standard edge card controller connector interfaces with the host system through a standard edge card.
3-4
ServeRAID M5110 SAS/SATA Controller Characteristics
Table 3.1
ServeRAID M5110 SAS/SATA Controller Connectors (Cont.)
Type Comments Reserved for internal use.
Connector Description J5A1
4-pin Serial Universal connector Asynchronous Receiver/Transmitter (UART) connector for the Expander CVFM03 DDR3 connector 240-pin connector
J5B1
Connects the controller to the CVFM03 CacheVault Flash Module. The CVFM03 module connects to a remote CVPM02 CacheVault Power Module. Reserved for internal use.
J6A1
4-pin Serial Universal connector Asynchronous Receiver/Transmitter (UART) connector for the Expander
3.2
Characteristics of the ServeRAID M5110 SAS/SATA Controller
Table 3.2 shows the general characteristics of the ServeRAID M5110 SAS/SATA controller. Table 3.2 ServeRAID M5110 SAS/SATA Controller Characteristics
SCSI Termination Active
Flash Serial ROM1 EEPROM2 Yes Yes
SAS Data Transfers Up to 6 Gb/s per port
SCSI Features Plug and Play Scatter/Gather Activity LED
1. 2.
For boot code and firmware. For BIOS configuration storage.
The controller ensures data integrity by intelligently validating the compatibility of the SAS domain. The controller uses Fusion-MPT architecture, which allows for thinner drivers and better performance.
Characteristics of the ServeRAID M5110 SAS/SATA Controller
3-5
3.3
Technical Specifications
The design and implementation of the ServeRAID M5110 SAS/SATA controller minimize electromagnetic emissions, susceptibility to radio frequency energy, and the effects of electrostatic discharge. The controller carries the following marks and certifications:
CE mark C-Tick mark FCC Self-Certification logo Canadian Compliance Statement Korean MIC Taiwan BSMI Japan VCCI
In addition, the controller meets the requirements of CISPR Class B. The ServeRAID M5110 SAS/SATA controller is CSA C22.2 No. 60950-1, UL 60950-1 First Edition listed Accessory, UL file number E257743.
3.3.1
Controller Specifications
Table 3.3 lists the specifications for the ServeRAID M5110 SAS/SATA controller. Table 3.3
Specification Processor (PCI Express Host Controller to PCI Secondary I/O Controller) Operating Voltage Card Size Array Interface to Host
ServeRAID M5110 SAS/SATA Controller Specifications
ServeRAID M5110 SAS/SATA Controller LSISAS2208 ROC device with Integrated PowerPC processor
+3.3 V, +12 V Low profile PCI Express controller card size (2.713" x 6.6") PCI Express Rev 3.0
3-6
ServeRAID M5110 SAS/SATA Controller Characteristics
Table 3.3
Specification
ServeRAID M5110 SAS/SATA Controller Specifications (Cont.)
ServeRAID M5110 SAS/SATA Controller Serial Attached SCSI (SAS) and Serial ATA (SATA) Up to 8 GT/s (1 GB/s) per lane x8 lane width Up to 2 GB/s per direction for SAS x4 cards (4 GB/s total) 3-pin RS232-compatible connector (for manufacturing use only) One LSISAS2208 Single SAS controller 6 Gb/s Two SAS connectors with four SAS ports each 8 Mbytes
Type of Drives Supported PCI Express Bus Data Transfer Rate
Serial Port SAS Controller(s) SAS Bus Speed SAS Ports Size of Flash ROM for Firmware
Nonvolatile Random 32 Kbytes for storing RAID configuration Access Memory (NVRAM)
3.3.2
Array Performance Features
Table 3.4 shows the array performance features for the ServeRAID M5110 SAS/SATA controller. Table 3.4
Specification PCI Express Host Data Transfer Rate Drive Data Transfer Rate Maximum Scatter/Gathers Maximum Size of I/O Requests Maximum Queue Tags per Drive Stripe Sizes Maximum Number of Concurrent Commands
Array Performance Features
ServeRAID M5110 SAS/SATA Controller 8 GT/s (1 GB/s) per lane 6.0 Gb/s per lane 26 elements 6.4 Mbytes in 64 Kbyte stripes As many as the drive can accept 8, 16, 32, or 64 Kbyte 255
Technical Specifications
3-7
3.3.3
Fault Tolerance
Table 3.5 shows the fault tolerance features of the ServeRAID M5110 SAS/SATA controller. Table 3.5
Specification Support for SMART1 Drive Failure Detection
Fault Tolerance Features
ServeRAID M5110 SAS/SATA Controller Yes Automatic
Drive Rebuild Using Hot Spares Automatic Parity Generation and Checking Yes 1. The Self Monitoring Analysis and Reporting Technology (SMART) detects up to 70 percent of all predictable drive failures. In addition, SMART monitors the internal performance of all motors, heads, and drive electronics.
3.3.4
Power Supply Requirements for the ServeRAID M5110 SAS/SATA Controller
All power is supplied to the controller through the PCI Express 3.3V rails and the 12V rail. Onboard switching regulator circuitry operating from the 3.3V rails and the 12V rail provide the necessary voltages. The following states determine the typical current consumption of the controller:
State 1: During a hard reset State 2: During a disk stress test State 3: While sitting idle at the DOS prompt
The supply voltages are 12V ± 8 percent (from PCI edge connector only) and 3.3V ± - 9 percent (from PCI edge connector only). Table 3.6 lists the power supply for the controller for each of the three states at the different voltages.
3-8
ServeRAID M5110 SAS/SATA Controller Characteristics
Table 3.6
Power Supply for the ServeRAID M5110 SAS/SATA Controller
State 1 0.1A 0.84A 0.76A State 2 0.94762905A 0.53350067A State 3 0.94232971A 0.53209699A
PCI Edge Connector 3.3V supply +12V supply 3.3V auxiliary supply
0.007135698A 0.0035464705A
3.3.5
Operating and Non-operating Conditions
The operating (thermal and atmospheric) conditions for the ServeRAID M5110 SAS/SATA controller are:
Relative humidity range is 20 percent to 80 percent noncondensing Airflow must be at least 200 linear feet per minute (LFPM) to avoid operating the Intel IOP333 processor above the maximum ambient temperature Temperature range: +0 C to +60 C
The parameters for the non-operating (such as storage and transit) environment for the controller are:
Relative humidity range is 5 percent to 90 percent noncondensing Temperature range: 30C to +80 C
3.3.6
Safety Characteristics
The ServeRAID M5110 SAS/SATA controller meets or exceeds the requirements of UL flammability rating 94 V0. Each bare board is also marked with the supplier name or trademark, type, and UL flammability rating. The board is installed in a PCI Express bus slot, so all voltages are lower than the SELV 42.4 V limit.
Technical Specifications
3-9
3-10
ServeRAID M5110 SAS/SATA Controller Characteristics
Appendix A Getting Help and Technical Assistance
If you need help , serv ice, or technical assistance o r just want more in formation about IBM produ cts, you will find a wide variety of sources available from IBM to assist you. Use this information to obtain ad ditional information about IBM and IBM products, determine what to do if you experience a problem with your IBM system or optional device, and determine whom to call for service, if it is necessary.
ServeRAID M5110 SAS/SATA Controller for IBM System x User’s Guide
A-1
A.1
Before you call
Before you call, make sure that you have taken these steps to try to solve the problem yourself:
Ch eck all cables to make sure that they are conn ected. Ch eck the power switches to make sure th at the s ystem and any optional devices are turned on. Ch eck for updated firmware and operating-system device drivers for your IBM product. The IBM Warranty terms and conditions state that you, the owner of the IBM product, are resp onsible for maintaining and updating all software and firmware for the pro duct (unless it is cov ered by an additional maintenance contract). Your IBM service tech nician will request that yo u up grad e your software and firmware if the problem has a documented solution within a software upg rade. If you have installed new hardware or software in your environment, ch eck http ://www.ibm.com/systems/info/x86servers/serverproven/compat/us/ to make sure that the hardware and software is supported by your IBM product. Go to http://www.ibm.com/supportportal/ to check for information to help yo u solve the problem. Gather the following info rmation to provide to IBM Support. This data will h elp IBM Support quickly provide a solution to your problem and ensure that you receiv e the level of service for which you might have contracted. o Hard ware an d Software Maintenance agreement co ntract numb ers, if applicable o Machine type n umber (IBM 4 -digit machine identifier) o Model number o Serial number o Current system UEFI and firmware levels o Oth er pertinent information such as error messages and logs Go to http://www.ibm.com/support/entry/portal/Open_service_request/ to su bmit an Electronic Service Request. Submitting an Electronic Service Request will start the process of determining a solution to your problem by making the pertinent information availab le to IBM Su pport quickly and efficiently. IBM serv ice technicians can start working on your solution as so on as you have completed and submitted an Electronic Service Request.
You can solve man y problems without o utside assistance by following the troub leshooting procedures that IBM p rovides in the online help or in the documentation that is provided with your IBM product. The documentation that comes with IBM systems also describes the diagnostic tests th at yo u can perform. Most s ystems, operating systems, and programs come with documentation that contains troublesh ooting procedures and explanations of error messages and error codes. If you suspect a software problem, see th e documentation for the op erating s ystem or program.
A-2
Getting Help and Technical Assistance
A.2
Using the documentation
Informatio n about your IBM s ystem and preinstalled software, if any, or optional device is available in the documentation that comes with th e product. That documentation can include printed documents, online d ocuments, readme files, and help files. See the troub leshooting information in your system documentation fo r instructions for using the diagn ostic programs. The troubleshooting information or the diagno stic programs might tell you that you need ad ditional or up dated device drivers or other software. IBM maintains pages on the World Wide Web where you can get the latest technical information and down load device drivers and updates. To access these pages, go to http://www.ibm.com/supportportal/. Also, some documents are available through the IBM Publications Center at h ttp://www.ibm.com/shop /p ublications/order/.
A.3
Getting help and information from the World Wide Web
On the World Wide Web, up-to-date information abo ut IBM systems, optional devices, services, and support is available at http://www.ibm.com/supportportal/. The address for IBM System x® information is http://www.ibm.com/systems/x/. The address for IBM BladeCenter® information is h ttp://www.ibm.com/systems/bladecen ter/. The address for IBM IntelliStation® information is http://www.ibm.co m/systems/intellistation/.
A.4
How to send Dynamic System Analysis data to IBM
Use the IBM Enhanced Customer Data Repository to send diagnostic data to IBM. Before you send diagnostic data to IBM, read the terms of use at http://www.ibm.com/de/support/ecurep/terms.html. You can use any of the following methods to send diagnostic data to IBM:
Standard upload: http://www.ibm.com/de/support/ecurep/send_http.html Standard upload with the system serial number: http://www.ecurep.ibm.com/app/upload_hw Secure upload: http://www.ibm.com/de/support/ecurep/send_http.html#secure Secure upload with the system serial number: https://www.ecurep.ibm.com/app/upload_hw
Using the documentation
A-3
A.5
Creating a personalized support web page
At http://www.ibm.com/support/mynotifications/, you can create a personalized support web p age b y identifying IBM products that are of interest to you. From this personalized page, you can subscribe to weekly email notifications about n ew technical d ocuments, search for information and downloads, and access various administrative services.
A.6
Software service and support
Through IBM Support Lin e, you can get telephone assistance, for a fee, with usage, co nfiguration, an d software prob lems with your IBM products. For information about which p roducts are supported by Support Line in your country or region, s ee http://www.ibm.com/services/supline/products/. For more information about Support Line and oth er IBM services, see http://www.ibm.com/services/, or see http://www.ibm.com/planetwide/ for support telephone numbers. In the U.S. and Canad a, call 1-800-IBM-SERV (1-800-426-7378 ).
A.7
Hardware service and support
A-4
Getting Help and Technical Assistance
A.8
IBM Taiwan product service
IBM Taiwan product service
A-5
A-6
Getting Help and Technical Assistance
Appendix B Notices
ServeRAID M5110 SAS/SATA Controller for IBM System x User’s Guide
B-1
B.1
Trademarks
IBM, the IBM logo, and ibm.com are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at "Copyright and trademark information" at http://www.ibm.com/legal/copytrade.shtml Adobe and PostScript are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States and/or other countries. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc., in the United States, other countries, or both and is used under license therefrom. Intel, Intel Xeon, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, and Windows NT are trademarks of Microsoft Corporation in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries.
B-2
Notices
B.2
Important Notes
Processor speed indicates the intern al clock speed of the microprocessor; other factors also affect application performance. CD or DVD drive speed is the variable read rate. Actual speeds v ary and are o ften less than the possible maximu m. When referring to processor storage, real and virtual storage, or channel volume, KB stand s fo r 1024 b ytes, MB stands for 1,048,576 b ytes, an d GB stand s fo r 1,073 ,741,824 bytes. When referring to hard disk drive capacity or co mmunications volume, MB stan ds for 1,000,000 b ytes, an d GB stands for 1,000,000,000 bytes. Total user-accessible capacity can vary depending on operatin g environments. Maximum internal hard d isk drive capacities assume the replacement of any standard hard disk drives and populatio n of all hard disk drive bays with the largest currently supported drives that are available from IBM. Maximum memory migh t require replacement of the standard memory with an o ptional memory module. IBM makes n o representation or warranties regarding non-IBM produ cts and services that are Serv erProven®, including but not limited to the implied warranties of merchantability and fitness fo r a particular purpose. These products are offered and warranted solely by third parties. IBM makes n o representations or warranties with respect to non-IBM produ cts. Support (if any) for the non -IBM prod ucts is provid ed by the third party, not IBM. Some software might differ from its retail version (if av ailable) and might no t include user manuals or all program fun ctionality.
Important Notes
B-3
B.3
Particulate contamination
Attention: Airborne particulates (includin g metal flakes or particles) and reactive gases acting alone or in combination with other environmental factors such as humidity or temperature might po se a risk to the device that is described in this document. Risks that are posed by the presence of excessive particulate levels or concentrations of harmful gases include damage that might cause the device to malfunction or cease functioning altogether. This specification sets forth limits for particulates and gases that are intended to avoid such damage. The limits must not be viewed or used as definitive limits, because numerous other factors, such as temperature or moisture content of the air, can influence the impact of particulates or env ironmental corrosives and gaseous contaminant transfer. In the absence of specific limits that are set forth in this docu ment, you must implement practices that maintain particulate and gas levels that are consistent with the protection of human health and safety. If IBM determines that the levels of particulates or gases in your environment have caused damage to the device, IBM may condition provision of repair or replacement of devices or parts on implementation of appropriate remedial measures to mitigate such environmental contamin ation. Implementation of such remedial measures is a customer responsibility. Table 5. Limits for particulates and gases Contaminant Limits
Particulate
The room air must be continuously filtered with 40% atmospheric dust spot efficiency (MERV 9) according to ASHRAE Stand ard 52.21. Air that enters a data center must be filtered to 99.97% efficiency or greater, using high-efficiency particulate air (HEPA) filters that meet M IL-STD-282. The deliquescent relative humidity of the particulate 2 contamination must be more than 60% . The room must be free of conductive contamination such as zinc whiskers. Copper: Class G1 as per ANSI/ISA 71.04-1985 Silver: Corrosion rate of less than 300 Å in 30 days
3
Gaseous
1
ASHRAE 52.2-2008 - Method of Testing General Ventilation Air-Cleaning Devices for Removal Efficiency by Particle Size. Atlanta: American Society of Heating, Refrigerating and Air-Conditionin g Engineers, Inc. The deliquescent relative humidity of particulate contamination is the relative humidity at which the dust absorbs enough water to b ecome wet and promote ionic conduction.
3 2
ANSI/ISA-71.04-1985. Environmental conditions for process measurement and control systems: Airborne contaminants. Instrument Society of America, Research Triangle Park, North Carolina, U.S.A.
B-4
Notices
B.4
Documentation format
The publications for this product are in Adobe Portable Document Format (PDF) and should be co mpliant with accessibility standards. If you exp erience difficulties when you use the PDF files and want to request a web-based format or accessible PDF document for a p ublication, d irect yo ur mail to the following address:
Information Development IBM Corporation 205/A015 3039 E. Cornwallis Road P.O. Box 12195 Research Triangle Park, North Carolina 27709-2195 U.S.A.
In the request, be sure to include the pu blication part number and title. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the info rmation in any way it believes appropriate without incu rring any obligation to you.
B.5
Telecommunication regulatory statement
This product is not intended to be connected directly or indirectly by any means whatsoever to interfaces of public telecommunications networks, nor is it intended to be used in a public services network.
B.6
Electronic emission notices
When you attach a monitor to the equipment, you must use th e designated monitor cable an d any interference suppression devices th at are su pplied with the mon itor.
Documentation format
B-5
B-6
Notices
Electronic emission notices
B-7
B-8
Notices
Deutschland: Einhaltung des Gesetzes über die elektromagnetische Verträglichkeit von Geräten Dieses Produkt entspricht d em "Ges etz über die elektromagnetische Verträglichkeit von Geräten (EMVG)". Dies ist d ie Umsetzung d er EU-Richtlinie 2004/108/EG in der Bundesrep ublik Deutschland. Zulassungsbescheinigung laut dem Deutschen Gesetz über die elektromagnetische Verträglichkeit von Geräten (EMVG) (bzw. der EMC EG Richtlinie 200 4/108/EG) für Geräte der Klasse A Dieses Gerät ist berechtigt, in Übereinstimmung mit dem Deutschen EMVG das EGKon formitätszeichen - CE - zu führen. Verantwortlich für die Einhaltung der EMV Vorschriften ist der Hersteller:
International Business Machines Corp. New Orchard Road Armonk, New York 10504 914-499-1900
Der verantwortliche Ansprechpartner des Herstellers in der EU ist:
IBM Deutschland Technical Regulations, Department M456 IBM-Allee 1, 71137 Ehningen, Germany Telephone: +49 7 032 15-2937 Email: [email protected]
Generelle Informa tionen: Das Gerät erfüllt die Schutzanforderungen nach EN 55024 und EN 5502 2 Klasse A.
VCCI Class A statement
Electronic emission notices
B-9
This is a Class A product based on the standard of the Voluntary Control Council for Interference (VCCI). If this equipment is used in a domestic environment, radio interference may occur, in which case the user may be required to take corrective actions.
This is electromagnetic wave compatibility equipment for business (Type A). Sellers and users need to pay attention to it. This is for any areas other than home.
B-10
Notices
Appendix C Glossary of Terms and Abbreviations
active termination array The electrical connection required at each end of the SCSI bus, composed of active voltage regulation and a set of termination resistors. An array of drives combines the storage space on the drives into a single segment of storage space. A hot spare drive does not actively participate in an array. Acronym for Basic Input/Output System. Software that provides basic read/write capability. Usually kept as firmware (ROM-based). The system BIOS on the mainboard of a computer boots and controls the system. The BIOS on your host controller acts as an extension of the system BIOS. Refers to the way a computer is set up, the combined hardware components (computer, monitor, keyboard, and peripheral devices) that make up a computer system, or the software settings that allow the hardware components to communicate with each other. A program that allows a microprocessor (through the operating system) to direct the operation of a peripheral device. Domain Validation is a software procedure in which a host queries a device to determine its ability to communicate at the negotiated data rate. Acronym for Electronically Erasable Programmable Read-Only Memory. It is a memory chip that typically stores configuration information, as it provides stable storage for long periods without electricity and can be reprogrammed. Refer to NVRAM. A SAS device installed outside the computer cabinet. These devices are connected using specific types of shielded cables. Fusion-MPT (Message Passing Technology) architecture consists of several main elements: Fusion-MPT firmware, the Fibre Channel and
BIOS
configuration
device driver domain validation EEPROM
external SAS device Fusion-MPT architecture
ServeRAID M5110 SAS/SATA Controller User’s Guide
C-1
SCSI hardware, and the operating system level drivers that support these architectures. Fusion-MPT architecture offers a single binary, operating system driver that supports both Fibre Channel and SCSI devices. host The computer system in which a storage controller is installed. It uses the storage controller to transfer information to and from devices attached to the SCSI bus. A circuit board or integrated circuit that provides a device connection to the computer system. An idle, powered on, standby drive ready for immediate use in case of disk failure. It does not contain any user data. A hot spare can be dedicated to a single redundant array or it can be part of the global hot-spare pool for all arrays managed by the controller. When a disk fails, the controller firmware automatically replaces and rebuilds the data from the failed drive to the hot spare. Data can be rebuilt only from virtual disks with redundancy (RAID levels 1, 5, 6, 10, 50, and 60; not RAID level 0), and the hot spare must have sufficient capacity. internal SAS device main memory NVRAM A SAS device installed inside the computer cabinet. These devices are connected by using a shielded cable. The part of a computer’s memory which is directly accessible by the CPU (usually synonymous with RAM). Acronym for Nonvolatile Random Access Memory. An EEPROM (Electronically Erasable Read-Only Memory chip) that stores configuration information. Refer to EEPROM. Acronym for Peripheral Component Interconnect. A high-performance, local bus specification that allows the connection of devices directly to computer memory. The PCI Local Bus allows transparent upgrades from 32-bit data path at 33 MHz to 64-bit data path at 33 MHz, and from 32-bit data path at 66 MHz to 64-bit data path at 66 MHz. Acronym for Peripheral Component Interconnect Express. A high-performance, local bus specification that allows the connection of devices directly to computer memory. PCI Express is a two-way, serial connection that transfers data on two pairs of point-to-point data lines.
host controller board hot spare
PCI
PCI Express
C-2
Glossary of Terms and Abbreviations
PCI Express goes beyond the PCI specification in that it is intended as a unifying I/O architecture for various systems: desktops, workstations, mobile, server, communications, and embedded devices. peripheral devices A piece of hardware (such as a video monitor, drive, printer, or CD-ROM) used with a computer and under the control of the computer. SCSI peripherals are controlled through a ServeRAID SAS/SATA controller (host controller). The interface required to transmit and receive data packets transferred across the serial bus. Each PHY can form one side of the physical link in a connection with a PHY on a different SATA device. The physical link contains four wires that form two differential signal pairs. One differential pair transmits signals, while the other differential pair receives signals. Both differential pairs operate simultaneously and allow concurrent data transmission in both the receive and the transmit directions. RAID Acronym for Redundant Array of Independent Disks (originally Redundant Array of Inexpensive Disks). An array of multiple independent physical disks managed together to yield higher reliability and/or performance exceeding that of a single physical disk. The RAID array appears to the controller as a single storage unit. I/O is expedited because several disks can be accessed simultaneously. Redundant RAID levels (RAID levels 1, 5, 6, 10, 50, and 60) provide data protection. A set of techniques applied to disk groups to deliver higher data availability, and/or performance characteristics to host environments. Each virtual disk must have a RAID level assigned to it. Acronym for Serial Attached SCSI. A serial, point-to-point, enterprise-level device interface that leverages the proven SCSI protocol set. The SAS interface provides improved performance, simplified cabling, smaller connections, lower pin count, and lower power requirements when compared to parallel SCSI. The SAS controller leverages a common electrical and physical connection interface that is compatible with Serial ATA. The ServeRAID SAS/SATA controller supports the SAS protocol as described in the Serial Attached SCSI Standard, version 2.0. The controller also supports the Serial ATA III (SATA III) protocol defined by the Serial ATA Revision 3.0. SATA III is an extension to SATA 2.0.
PHY
RAID levels
SAS
C-3
The ServeRAID M5110 SAS/SATA controller is a versatile controller that provides the backbone of both server and high-end workstation environments. Each port on the RAID controller supports SAS devices and/or SATA III devices. SAS device Any device that conforms to the SAS standard and is attached to the SAS bus by a SAS cable. This includes SAS storage controllers (host controllers) and SAS peripherals. Acronym for Serial Advanced Technology Attachment. A physical storage interface standard, SATA is a serial link that provides point-topoint connections between devices. The thinner serial cables allow for better airflow within the system and permit smaller chassis designs. Acronym for Serial Management Protocol. SMP enables communicates topology management information directly with an attached SAS expander device. Each PHY on the controller can function as an SMP initiator. Acronym for Solid State Devices. A Solid State Device uses solid-state memory to store data. They have no moving parts and are faster and more reliable than hard disk drives (HDDs). Acronym for Serial SCSI Protocol. SSP enables communication with other SAS devices. Each PHY on the SAS controller can function as an SSP initiator or SSP target. Acronym for Serial Tunneling Protocol. STP enables communication with a SATA III device through an attached expander. Each PHY on the SAS controller can function as an STP initiator. The total disk space consumed by a stripe not including a parity disk. For example, consider a stripe that contains 64 Kbytes of disk space and has 16 Kbytes of data residing on each disk in the stripe. In this case, the stripe size is 64 Kbytes and the stripe element size is 16 Kbytes. The stripe depth is four (four physical disks in the stripe). You can specify stripe sizes of 8 Kbytes, 16 Kbytes, 32 Kbytes, or 64 Kbytes for each virtual disk. A larger stripe size produces improved read performance, especially if most of the reads are sequential. For mostly random reads, select a smaller stripe size. Disk striping writes data across two or more disks. Each stripe spans two or more disks but consumes only a portion of each disk. Each disk,
SATA
SMP
SSD
SSP
STP
stripe size
striping
C-4
Glossary of Terms and Abbreviations
therefore, may have several stripes. The amount of space consumed by a stripe is the same on each disk included in the stripe. The portion of a stripe that resides on a single disk is a stripe element. Striping by itself does not provide data redundancy; striping in combination with parity provides data redundancy.
C-5
C-6
Glossary of Terms and Abbreviations
®
IBM P/N: 81Y1007
