Sun Microsystems StorEdge3000 Series Manuel utilisateur

Sun Microsystems, Inc.

www.sun.com

Submit comments about this document at: http://www.sun.com/hwdocs/feedback

Sun StorEdge™3000 Family

Best Practices Manual

Sun StorEdge 3510 FC Array

Sun StorEdge 3511 FC Array with SATA

Part No. 816-7325-15

June 2004, Revision A

Please

Recycle

Sun Microsystems, Inc. and Dot Hill Systems Corporation may have intellectual property rights relating to technology embodied in this product

or document. In particular, and without limitation, these intellectual property rights may include one or more of the U.S. patents listed at

http://www.sun.com/patents and one or more additional patents or pending patent applications in the U.S. and other countries.

This product or document is distributed under licenses restricting its use, copying distribution, and decompilation. No part of this product or

document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any.

Third-party software is copyrighted and licensed from Sun suppliers.

Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in

the U.S. and in other countries, exclusively licensed through X/Open Company, Ltd.

Sun, Sun Microsystems, the Sun logo, Sun StorEdge, AnswerBook2, docs.sun.com, and Solaris are trademarks or registered trademarks of Sun

Microsystems, Inc. in the U.S. and in other countries.

U.S. Government Rights—Commercial use. Government users are subject to the Sun Microsystems, Inc. standard license agreement and

applicable provisions of the FAR and its supplements.

DOCUMENTATION IS PROVIDED “AS IS” AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,

INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NONINFRINGEMENT,

ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.

Sun Microsystems, Inc. et Dot Hill Systems Corporation peuvent avoir les droits de propriété intellectuels relatants à la technologie incorporée

dans le produit qui est décrit dans ce document. En particulier, et sans la limitation, ces droits de propriété intellectuels peuvent inclure un ou

plus des brevets américains énumérés à http://www.sun.com/patents et un ou les brevets plus supplémentaires ou les applications de brevet

en attente dans les Etats-Unis et dans les autres pays.

Ce produit ou document est protégé par un copyright et distribué avec des licences qui en restreignent l’utilisation, la copie, la distribution, et la

décompilation. Aucune partie de ce produit ou document ne peut être reproduite sous aucune forme, par quelque moyen que ce soit, sans

l'autorisation préalable et écrite de Sun et de ses bailleurs de licence, s’il y ena.

Le logiciel détenu par des tiers, et qui comprend la technologie relative aux polices de caractères, est protégé par un copyright et licencié par des

fournisseurs de Sun.

Des parties de ce produit pourront être dérivées des systèmes Berkeley BSD licenciés par l’Université de Californie. UNIX est une marque

déposée aux Etats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company, Ltd.

Sun, Sun Microsystems, le logo Sun, Sun StorEdge, AnswerBook2, docs.sun.com, et Solaris sont des marques de fabrique ou des marques

déposées de Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays.

LA DOCUMENTATION EST FOURNIE “EN L’ÉTAT” ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES

OU TACITES SONT FORMELLEMENT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE, Y COMPRIS NOTAMMENT

TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L'APTITUDE A UNE UTILISATION PARTICULIERE OU A

L’ABSENCE DE CONTREFAÇON.

iii

Contents

Overview 1

Comparison of the Sun StorEdge 3510 FC Array and the Sun StorEdge 3511

SATA Array 3

Sun StorEdge 3500 Series Architecture 4

DAS and SAN Storage Architectures 5

Fibre Channel Protocols 6

Supported RAID Levels 7

Logical Drives 7

Cache Optimization 9

Array Management Tools 11

Saving and Restoring Configuration Information 12

Direct-Attached Storage 12

Storage Area Networking 13

Scaling Capacity 14

First Steps 16

General Configuration Considerations 17

Configuring an Array’s RCCOM Channel 18

Cautions 20

iv Sun StorEdge 3000 Family Best Practices Manual • June 2004

Non-Redundant DAS Configurations 21

Non-Redundant DAS Tips and Techniques 22

Non-Redundant DAS Setup Details 23

High-Availability DAS Configurations 26

High-Availability DAS Tips and Techniques 27

Standard High-Availability DAS Setup Details 28

Six Node High-Availability DAS Setup Details 31

Full-Fabric SAN Configurations 33

Full-Fabric SAN Tips and Techniques 34

Full-Fabric SAN Setup Details 35

High-Performance SAN Configurations 38

High-Performance SAN Tips and Techniques 39

High-Performance SAN Setup Details 40

Scaling Arrays Into High Capacity Configurations 43

Limitations 43

Sun StorEdge 3510 FC Array High Capacity Configurations 44

Sun StorEdge 3511 SATA Array High Capacity Configurations 53

Summary 59

Best Practices for the Sun StorEdge

3510 and 3511 FC Arrays

This Best Practices Manual describes both the Sun StorEdge™3510 FC Array and

Sun StorEdge 3511 FC Array with SATA, and complements the Sun StorEdge 3000

Family Installation, Operation, and Service Manual for these products.

The Sun StorEdge 3511 FC Array with SATA is also known as the Sun StorEdge 3511

SATA array which will be the term used throughout most of this document.

Procedures for configuration of the Sun StorEdge 3500 series arrays are identical

except where specifically noted in this manual.

Note – The primary use of the two arrays is very different due to different disk

technologies. Be sure to read the following Overview section and the “Comparison

of the Sun StorEdge 3510 FC Array and the Sun StorEdge 3511 SATA Array” on

page 3 for optimum use of each array.

Overview

Today’s business, educational and consumer environments continue to create a

seemingly inexhaustible amount of information. In addition, there is a constant

strain on the trade-offs between performance and cost when architecting and

deploying a storage solution. Storage technology has provided a multitude of

options to appropriately store information based upon retrieval characteristics such

as: frequency, random/sequential type of access, criticality, time-sensitivity and cost

basis.

2Sun StorEdge 3000 Family Best Practices Manual • June 2004

Both the Sun StorEdge 3500 series arrays feature full 2Gb host Fibre Channel (FC)

connections and are next-generation storage systems designed to provide direct

attached storage (DAS) to entry-level, mid-range, and enterprise servers, or to serve

as the disk storage within a storage area network (SAN).

Modern businesses employ servers of all sizes requiring storage to match the type of

data storage and processing being used by the applications involved, as well as

consider the cost of the server. The Sun StorEdge 3500 product family is designed to

address network application priorities and cost considerations by applying the

appropriate disk technology as follows:

■Applications demanding transaction-based random access patterns with high

duty cycles are better suited by the FC-disk solution of the StorEdge 3510 FC

array.

The StorEdge 3510 FC array is designed for business-critical applications and

their high-value data. These critical applications require higher availability (not a

trait of SATA-disk based solutions).

■Applications requiring streaming or sequentially accessed data or those with cost-

sensitive duty cycles such as backup and archival are better served by the Serial

ATA-disk solution of the StorEdge 3511 SATA array.

The StorEdge 3511 SATA array is designed for applications requiring lower-cost

bulk storage (not a trait of FC-disk based solutions), where application or data

availability is not a primary concern.

The StorEdge 3511 SATA array is only used for archival, backup, or static storage;

it is not used to store single instances of data, and cannot serve as a boot device.

Designed for smaller direct-attached storage (DAS) needs or for consolidated storage

applications using a Storage Area Network (SAN), matching the array reliability and

disk performance to the application availability requirements has never been easier.

This document gives a high level overview of the Sun StorEdge 3500 series arrays

and outlines five sample storage solutions for entry-level, mid-range, and enterprise

servers. Use these solutions as-is or tailor them to fit your exact needs. Examples of

customization opportunities include adding disks, enclosures and software or even

combining configurations. Choosing the solution that best matches your particular

environment will provide the best results.

The benefits and purpose of each array varies according to network requirements:

■The Sun StorEdge 3510 FC array uses Fibre Channel (FC) disk technology and is

ideal for performance-sensitive, intense I/O applications.

■The Sun StorEdge 3511 SATA array uses Serial ATA (SATA) disk technology, and

is ideal for cost-sensitive archival, static storage, and backup applications.

Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays 3

Comparison of the Sun StorEdge 3510 FC Array

and the Sun StorEdge 3511 SATA Array

Before installing and configuring your array, please review the key differences

between the Sun StorEdge 3510 FC array and the Sun StorEdge 3511 SATA array. The

following list provides a comparison of the Sun StorEdge 3510 FC array and the Sun

StorEdge 3511 SATA array features.

Caution – Although the two products are very similar in appearance and setup, the

configurations have very important differences. While the StorEdge 3510 FC Array

can be used for all applications, its higher cost makes it a poor choice for certain

applications. The StorEdge 3511 SATA array should only be used where indicated

below. Its features are a subset of the StorEdge 3510 FC array’s and therefore may

not be used everywhere the StorEdge 3510 FC array can be used. Using the StorEdge

3511 SATA array where a FC disk-based solution should be used may result in the

loss of data access or even, in extreme cases, data corruption.

TABLE 1 Comparison of Sun StorEdge 3510 FC Array and the Sun StorEdge 3511 SATA Array Features

Sun StorEdge 3510 FC Array Sun StorEdge 3511 SATA Array

Applications Best suited for production

applications where the superior

features of FC technical

characteristics and performance

is a requirement. This includes

the below online applications:

• Database

• Decision Support

• Data warehousing

• Electronic commerce

• Enterprise resource planning

• Messaging, file and print

Best suited for an inexpensive secondary

storage application where higher capacity

drives are needed which are not mission-

critical, and where lower performance and

less than 7/24 availability is an option.

This includes the below near-line

applications:

• Information lifecycle management

• Content addressable storage

• Backup and restore

• Secondary SAN storage

• Near-line DAS storage

• Static reference data storage

Disks Fibre Channel disks:

36, 73, or 146 GB at 10k rpm

36 or 73 GB at 15k rpm

SATA disks:

250 GB at 7200 rpm

Maximum FC Host Ports per

I/O Controller Module

(one SFP port each for channels

0, 1, 4, and 5)

(two SFP ports each for channels 1 and 0;

one SFP port each for channels 4 and 5)

Maximum Number of

Expansion Units Connected

to a RAID Array

4Sun StorEdge 3000 Family Best Practices Manual • June 2004

Sun StorEdge 3500 Series Architecture

All members of the StorEdge 3500 series arrays share the same architecture elements.

This section discusses those elements, making note of the few differences in how the

architecture was implemented differently in the StorEdge 3510 FC and 3511 SATA

products.

The Sun StorEdge 3500 series RAID controllers have six FC channels. RAID

controller channels 0, 1, 4, and 5 are normally designated for connection to hosts or

Fibre Channel switches. RAID controller channels 2 and 3 are dedicated drive

channels that connect to disks. Each channel has a single port connection except the

Sun StorEdge 3511 SATA array which has two extra ports (two connections for

channels 0 and 1).

In a dual RAID controller configuration, the architecture of the loops within the

chassis provides both RAID controllers the same host channel designators. Each host

channel of the top RAID controller shares a loop with the matching host channel on

the bottom RAID controller. For example, channel 0 of the top RAID controller

shares the same loop as channel 0 of the bottom RAID controller. This provides four

distinct loops for connectivity. The individual loops provide LUN failover without

causing HBA path failover in the event of a controller failure.

A single RAID controller configuration is slightly different. The lower I/O board has

drive channels but does not have host channels. Overall, the same number of loops

are available, but with only half as many host channel ports.

Sun StorEdge 3510 FC Array. RAID controller channels 0, 1, 4, and 5 are normally

designated host channels. Any of the host channels can be configured as a drive

channel. In a dual controller configuration, each host loop includes two ports per

loop, one port on the top controller and one port on the bottom controller.

Maximum Number of Disks

per Configuration

108 (1 RAID array + 8 expansion

units)

72 (1 RAID array + 5 expansion units)

Maximum Number of

Logical Drives

8 logical drives 8 logical drives

Maximum Total Storage

Capacity

15.75 TB 18.0 TB

Maximum Usable Storage

Capacity

14.0 TB RAID 5

15.1 TB RAID 0

14.0 TB RAID 5

16.0 TB Raid 0

JBOD Array Support One JBOD per server Not supported

TABLE 1 Comparison of Sun StorEdge 3510 FC Array and the Sun StorEdge 3511 SATA Array Features

Sun StorEdge 3510 FC Array Sun StorEdge 3511 SATA Array

Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays 5

All six fibre channels in an I/O controller module support 1-Gbit or 2-Gbit data

transfer speeds.

RAID controller channels 2 and 3 are dedicated drive channels that connect to

expansion units. Each I/O board has two ports designated as disk drive loops. These

ports connect to the internal dual-ported FC disk drives and are used to add

expansion units to the configuration. The two drive loop ports on the upper I/O

board form FC loop 2 (channel 2) while the two drive ports on the lower I/O board

form FC loop 3 (channel 3). FC loop 2 provides a data path from both RAID

controllers to the A loop of the internal disk drives, while FC loop 3 provides a data

path from both RAID controllers to the B loop of the internal disk drives.

Sun StorEdge 3511 SATA Array. RAID controller channels 0 and 1 are dedicated

host channels. Channels 4 and 5 are normally designated host channels but can be

configured as drive channels. RAID controller channels 2 and 3 are dedicated drive

channels that connect to expansion units.

How the channels are exposed on the StorEdge 3511 RAID controller is one of the

key differences between the StorEdge 3510 and 3511. Host channels 0 and 1 include

four ports per loop (two ports on the upper controller, and two ports on the lower

controller). Channels 0 and 1 support 1 Gbit or 2 Gbit data transfer speed.

Channels 4 and 5 provide two ports per loop (one port on each controller). Channels

4 and 5 only support 2 Gbit data transfer speed.

Each RAID controller has two ports designated as disk drive loops. The drive ports

support only 2 Gbit data transfer speed. These ports connect to the internal Serial

ATA disk drives using internal FC-SATA routing technology. Drive ports are used to

add expansion chassis to the configuration. Like the host channels, each drive

channel of the top RAID controller shares a loop with the matching drive channel on

the bottom RAID controller. For example, drive channel 2 of the top RAID controller

shares the same loop as channel 2 of the bottom RAID controller.

DAS and SAN Storage Architectures

There are two popular methods for connecting storage to servers.

■Direct attached storage (DAS) uses a direct connection between a server and its

storage system. The DAS solution of connecting each server to its own dedicated

storage system is straight-forward, and the absence of storage switches can

minimize costs in some instances.

■A storage area network (SAN) places a Fibre Channel (FC) storage switch

between network servers and storage systems. A SAN solution shares a storage

system among multiple servers using FC storage switches, and reduces the total

number of storage systems required for a particular environment at the cost of

additional element management (FC switches) and FC path complexity.

6Sun StorEdge 3000 Family Best Practices Manual • June 2004

FIGURE 1 DAS and SAN Storage Architectures

Selecting the best storage architecture for a particular environment can be a

confusing exercise. In general, some environments are well-suited for DAS while

others will benefit greatly from SAN.

The challenge of selecting between DAS and SAN is often further complicated by the

need to choose between different storage systems, one designed for DAS or another

intended for SAN. Fortunately, Sun StorEdge 3500 series arrays inherently supports

both DAS and SAN.

Fibre Channel Protocols

The Sun StorEdge 3500 series arrays support point-to-point and Fibre Channel–

Arbitrated Loops (FC–AL) protocols. Using the point-to-point protocol with the Sun

StorEdge 3500 series arrays requires a switched fabric network (SAN), whereas

selecting FC-AL mode enables the arrays to be used in either DAS or SAN

environments. Using point-to-point protocol enables full-duplex use of the available

channel bandwidth, whereas selecting FC-AL mode limits host channels to half-

duplex communication.

In a point-to-point configuration, only one ID can be assigned to each host channel.

If more than one ID is assigned, the point-to-point protocol rules are violated. Any

host channel with more than one ID will not be able to log in to an FC switch in

fabric mode. This “one-ID-per-channel” requirement is true in both single-controller

and dual-controller configurations. Thus, in dual-controller configurations, either the

primary or the secondary controller can have an ID assigned, but not both. This

yields:

Direct-Attached Storage (DAS)

Storage Area Network (SAN)

Ce manuel convient aux modèles suivants

Table des matières

Autres manuels Sun Microsystems Stockage

Sun Microsystems

Sun Microsystems StorageTek T10000 Manuel

Sun Microsystems

Sun Microsystems Sun Fire E25K Manuel utilisateur

Sun Microsystems

Sun Microsystems Sun StorEdge T3 Manuel utilisateur

Sun Microsystems

Sun Microsystems StorEdge N8600 Filer Manuel d'installation et d'exploitation

Sun Microsystems

Sun Microsystems StorEdge 3510 Manuel utilisateur

Sun Microsystems

Sun Microsystems SPARCstorage Library Manuel utilisateur

Sun Microsystems

Sun Microsystems StorEdge 3900 Series Manuel utilisateur

Sun Microsystems

Sun Microsystems Sun Storage J4400 Manuel de la liste des pièces

Sun Microsystems

Sun Microsystems SPARCstorage Library Manuel utilisateur

Sun Microsystems

Sun Microsystems Sun StorEdge 5310 NAS Instructions d'utilisation

Sun Microsystems

Sun Microsystems SPARCstorage Manuel utilisateur

Sun Microsystems

Sun Microsystems SPARCstation 4 Manuel utilisateur

Sun Microsystems

Sun Microsystems StorEdge 5210 Manuel utilisateur

Sun Microsystems

Sun Microsystems Fire 6800 Manuel de service

Sun Microsystems

Sun Microsystems StorEdge 6120 Mode d'emploi

Sun Microsystems

Sun Microsystems StorEdge T3+ Manuel utilisateur

Sun Microsystems

Sun Microsystems Sun StorEdge A1000 Guide de configuration

Sun Microsystems

Sun Microsystems StorEdge L280 Manuel utilisateur

Sun Microsystems

Sun Microsystems 7120 Manuel utilisateur

Sun Microsystems

Sun Microsystems StorEdge 3900 Series Manuel utilisateur

Sun Microsystems

Sun Microsystems StorEdge L1800 Manuel utilisateur

Sun Microsystems

Sun Microsystems STOREDGE A5000 Manuel utilisateur

Sun Microsystems

Sun Microsystems StorEdge 6920 System Instructions originales

Sun Microsystems

Sun Microsystems Sun StorEdge 5210 NAS Manuel

Manuels Stockage populaires d'autres marques

QNAP

QNAP TS 32PXU Series Manuel utilisateur

LaCie

LaCie RUGGED RAID Manuel utilisateur

Freecom

Freecom CLS DOCK Manuel utilisateur

PNY

PNY Attache P-FD64MBATT3 Manuel utilisateur

HP StorageWorks MSL2024 Manuel utilisateur

OLT

OLT 6x6 Maximizer Manuel utilisateur

Transcend

Transcend JetFlash 160 Manuel utilisateur

LaCie

LaCie RUGGED MINI Manuel utilisateur

Thunderbolt

Thunderbolt 600 Manuel utilisateur

Panasonic

Panasonic LB-DH8 series Manuel

Intel

Intel RAID High Availability Manuel utilisateur

LaCie

LaCie 12big Thunderbolt 3 Manuel utilisateur

Spectra Logic

Spectra Logic T-Series Spectra T50e Manuel utilisateur

Panasonic

Panasonic LKM-F931-1 Manuel utilisateur

Tabernus

Tabernus Enterprise Erase E2400 Manuel utilisateur

Rocstor

Rocstor COMMANDER 3F series Manuel utilisateur

HP P9000 Manuel utilisateur

Western Digital

Western Digital Ultrastar Data60 Manuel utilisateur