NEC Express5800/A2040d Manuel utilisateur

Express5800/A2040d, A2020d, A2010d, A1040d

necmemras User's Guide for Linux

(Release 1.0)

May 2016

NEC Corporation

GZS-000149-001-00

Notes on Using This Manual

No part of this manual may be reproduced in any form without the prior written permission of

NEC Corporation.

The contents of this manual may be revised without prior notice.

The contents of this manual shall not be copied or altered without the prior written permission

of NEC Corporation.

Trademarks

Linux is a trademark or registered trademark of Linux Torvalds in Japan and other countries.

Red Hat and Red Hat Enterprise Linux are trademarks or registered trademarks of Red Hat,

Inc. in the United States and other countries.

Oracle is a registered trademark of Oracle Corporation or its subsidiaries, and/or its affiliates

in the United States and other countries.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation in the United

States and other countries.

All other product, brand, or trade names used in this publication are the trademarks or

registered trademarks of their respective trademark owners.

Related Documents

Express5800/A1040d, A2040d, A2020d, A2010d User’s Guide

Express5800/A1040d, A2040d, A2020d, A2010d Maintenance Guide

Express5800/A1040d, A2040d, A2020d, A2010d Installation Guide (Linux)

Contents

1. Introduction.............................................................................................................................. 1

1.1 What is necmemras?.........................................................................................................1

1.2 What is address based memory mirroring.........................................................................1

1.3 Operating Environment......................................................................................................1

1.4 Terminology .......................................................................................................................2

1.5 Access Limitation...............................................................................................................2

2. Setting memory mirroring and address based memory mirroring ....................................3

2.1 How to setup memory mirroring ........................................................................................3

2.2 How to setup address based memory mirroring................................................................5

2.3 Application consideration of memory mirroring and address based memory mirroring....7

3. Installing necmemras..............................................................................................................8

3.1 Installing necmemras.........................................................................................................8

3.2 Uninstalling necmemras....................................................................................................8

3.3 Upgrading necmemras......................................................................................................9

3.4 Configuration by necmemras............................................................................................. 9

3.5 Backup Configuration Information...................................................................................10

4. Necmemras Command Reference....................................................................................... 11

4.1 necmemras command line format................................................................................... 11

4.2 --show option................................................................................................................... 11

4.3 --mode option...................................................................................................................12

4.4 --mirrornode option..........................................................................................................14

4.5 --version option................................................................................................................16

1. Introduction

1.1 What is necmemras?

Necmemras tool allows specifying memory RAS mode on Linux OS. With using this tool, you can easily

enable memory mirroring of each NUMA node and enable address based memory mirroring. Refer to

"Express5800/A1040d, A2040d, A2020d, A2010d User’s Guide" for memory RAS.

1.2 What is address based memory mirroring

Address based memory mirroring is one of the Memory RAS features. The feature is supported only for

Linux OS in this tool.

The feature replicates the memory region where the contents of Linux Kernel is placed. This region is

hereinafter referred to as the base memory. Base memory is the range of the system address 0-2GB in

the supported server. When enabling this feature, even if an uncorrectable memory error occurs in the

base memory, the OS will be running without Kernel Panic by correcting the uncorrectable memory

error using the mirrored Kernel.

When enabling this feature, OS memory capacity is decreased only 2GB from total memory capacity.

Address based memory mirroring is enabled by using necmemras. See “2.2 How to setup address

based memory mirroring”for details.

1.3 Operating Environment

necmemras operating environment as shown below:

Table 1-1 Operating Environment

Hardware (Server)

Express5800/A2040d

Express5800/A2020d

Express5800/A2010d

Express5800/A1040d

Note: Express5800/A1040d is unsupported model forAddress Based

Memory Mirroring.

Red Hat Enterprise Linux 6.8

Important

Address Based Memory Mirroring is unsupported for

Express5800/A1040d.

1.4 Terminology

Terms used in necmemras as shown below:

Table 1-1 Terminology

Term

Description

CPU Socket

Means a single Intel Xeon processor. One CPU socket can have several cores.

CPU core

Core portion of CPU that performs arithmetic processing and others. One or more

cores can exist in CPU socket.

Logical processor

Means the processor where OS actually executes task and threads. When

Hyper-Threading feature is enabled, two logical processors exist in one CPU core.

When Hyper-Threading feature is disabled, only one logical processor exists in one

CPU core.

NUMA node

Indicates a group consisting of a set of processors that can perform memory access

to a specific memory area by the same method (cost) and of that memory area. With

Express5800/A2040d, A2020d, A2010d, and A1040d, all the logical processors in

CPU socket and memory connected under CPU socket build one NUMAnode.

Web console

A tool used to view or configure the server via web browser provided by

EXPRESSSCOPE Engine SP3.

BIOS SETUP utility

Utility embedded in server and used to configure BIOS. Refer to

“Express5800/A1040d, A2040d, A2020d, A2010d User’s Guide”for how to user this

utility.

necmemras

Command used for configuring memory RAS.

1.5 Access Limitation

Operation related to Mission Critical I/O Failover feature is allowed for the user having administrative

right (Administrator account).

2. Setting memory mirroring and address based memory mirroring

This section describes how to set memory mirroring and address based memory mirroring with

necmemras.

2.1 How to setup memory mirroring

necmemras allows enabling memory mirroring of each NUMA node the OS recognizes.

Setting memory mirroring as follows:

1. Installing necmemras

Install necmemras according to "3.1 Installing necmemras”.

2. Check NUMA node.

Execute necmemras with “--show”option, and confirm the numbers of memory riser

corresponding to mirrored NUMA nodes. See "4 Necmemras Command Reference " for

details of command line of necmemras command.

Execution resultEx

# ./necmemras --show

Memory RAS Mode: Lockstep

Node:0 MR#1-2 (Base Memory)

Node:1 MR#3-4

Node:2 MR#5-6

Node:3 MR#7-8

3. Confirm the memory components.

In case of setup of memory mirroring, the mirrored memory riser must be under the

following rule. Before setup of memory mirroring, check the mirrored memory riser

confirmed by step2 satisfies the rule.

The populating rule for memory mirroring:

•The DIMMs used for Mirroring Pair between SMI channel must be of the same model.

In the supported system, if the capacities of each DIMM are same, the DIMMs are of the

same model. You can confirm the capacities of each DIMM by [System] tab -> [component]

-> [Memory] on Web console. Refer to "Express5800/A1040d, A2040d, A2020d, A2010d

User’s Guide" for detailed information.

4. Confirm the memory size the OS recognized before setup of memory mirroring.

You can get the memory size of each NUMA node by using the following numactl -H.

Execution resultEx

# numactl -H

available: 4 nodes (0-3)

node 0 cpus: 0 4

node 0 size: 16208 MB

node 0 free: 15600 MB

node 1 cpus: 1 5

node 1 size: 16384 MB

node 1 free: 15936 MB

node 2 cpus: 2 6

node 2 size: 16384 MB

node 2 free: 15991 MB

node 3 cpus: 3 7

node 3 size: 16384 MB

node 3 free: 15957 MB

node distances:

node 0 1 2 3

0: 10 15 15 15

1: 15 10 15 15

2: 15 15 10 15

3: 15 15 15 10

5. Enable memory mirroring.

Execute necmemras with “--mode”and “--mirrornode”options for enabling memory mirroring,

and reboot the OS to apply the settings.

Execution resultEx ( The mirrored NUMA nodes are 0 and 2.)

# ./necmemras --mode=independent-mirror --mirrornode=0,2

Memory RAS Mode: Independent + Mirroring

Node:0 MR#1-2 Mirrored (Base Memory)

Node:1 MR#3-4 Not-Mirrored

Node:2 MR#5-6 Mirrored

Node:3 MR#7-8 Not-Mirrored

The configuration changes have not been applied yet.

You must reboot the system to apply them.

6. Check to verify that the memory configuration actually applied.

The memory size of the mirrored NUMA node is reduced to about to half size. After system

reboot, check that the memory size of the mirrored NUMA node confirmed by step 4.

If the memory size is not reduced, the memory component of the NUMA node may not satisfy

the populating rule for memory mirroring. In this case, check the activity log to see the reason.

You can check the activity log by [Maintenance] -> [Hardware Log] -> [Display Activity Log] on

Web console. Refer to "Express5800/A1040d, A2040d, A2020d, A2010d User’s Guide" for

detailed information.

Execution resultEx

# numactl -H

available: 4 nodes (0-3)

node 0 cpus: 0 4

node 0 size: 8016 MB

node 0 free: 7536 MB

node 1 cpus: 1 5

node 1 size: 16384 MB

node 1 free: 15993 MB

node 2 cpus: 2 6

node 2 size: 8192 MB

node 2 free: 7912 MB

node 3 cpus: 3 7

node 3 size: 16384 MB

node 3 free: 15946 MB

node distances:

node 0 1 2 3

0: 10 15 15 15

1: 15 10 15 15

2: 15 15 10 15

3: 15 15 15 10

2.2 How to setup address based memory mirroring

Setting address based memory mirroring as follows:

1. Installing necmemras

Install necmemras according to "3.1 Installing necmemras”.

2. Check NUMA node.

Execute necmemras with “--show”option, and confirm the NUMA node number and

memory riser number in the line marked with ”Base Memory". See "4 Necmemras Command

Reference " for details of command line of necmemras command.

Execution resultEx

# ./necmemras --show

Memory RAS Mode: Lockstep

Node:0 MR#1-2 (Base Memory)

Node:1 MR#3-4

Node:2 MR#5-6

Node:3 MR#7-8

3. Confirm the memory components.

In case of setup of address based memory mirroring, the mirrored memory riser must be

under the following rule. Before setup of address based memory mirroring, check the

mirrored memory riser confirmed by step2 satisfies the rule.

The populating rule for address based memory mirroring:

•The DIMMs used for Mirroring Pair between SMI channel must be of the same model.

In the supported system, if the capacities of each DIMM are same, the DIMMs are of the

same model. You can confirm the capacities of each DIMM by [System] tab -> [component]

-> [Memory] on Web console. Refer to "Express5800/A1040d, A2040d, A2020d, A2010d

User’s Guide" for detailed information.

4. Confirm the memory size the OS recognized before setup of address based memory

mirroring.

You can get the memory size of mirrored NUMA node by using the following numactl -H.

Execution resultEx

# numactl -H

available: 4 nodes (0-3)

node 0 cpus: 0 4

node 0 size: 16208 MB

node 0 free: 15600 MB

node 1 cpus: 1 5

node 1 size: 16384 MB

node 1 free: 15936 MB

node 2 cpus: 2 6

node 2 size: 16384 MB

node 2 free: 15991 MB

node 3 cpus: 3 7

node 3 size: 16384 MB

node 3 free: 15957 MB

node distances:

node 0 1 2 3

0: 10 15 15 15

1: 15 10 15 15

2: 15 15 10 15

3: 15 15 15 10

5. Enable address based memory mirroring.

Execute necmemras with “--mode”options for enabling address based memory mirroring, and

reboot the OS to apply the settings.

Execution resultEx

# ./necmemras --mode=independent-addrmirror

Memory RAS Mode: Independent + Addr Mirroring

Node:0 MR#1-2 (Base Memory)

Node:1 MR#3-4

Node:2 MR#5-6

Node:3 MR#7-8

The configuration changes have not been applied yet.

You must reboot the system to apply them.

6. Check to verify that the memory configuration actually applied.

The memory size of the mirrored NUMA node is decreased 2GB. After system reboot, check

that the memory size of the mirrored NUMA node confirmed by step 4.

If the memory size is not decreased, the memory component of the NUMA node may not

satisfy the populating rule for address based memory mirroring. In this case, check the

activity log to see the reason. You can check the activity log by [Maintenance] -> [Hardware

Log] -> [Display Activity Log] on Web console. Refer to "Express5800/A1040d, A2040d,

A2020d, A2010d User’s Guide" for detailed information.

Execution resultEx

# numactl -H

available: 4 nodes (0-3)

node 0 cpus: 0 4

node 0 size: 14160 MB

node 0 free: 13549 MB

node 1 cpus: 1 5

node 1 size: 16384 MB

node 1 free: 15962 MB

node 2 cpus: 2 6

node 2 size: 16384 MB

node 2 free: 15988 MB

node 3 cpus: 3 7

node 3 size: 16384 MB

node 3 free: 15963 MB

node distances:

node 0 1 2 3

0: 10 15 15 15

1: 15 10 15 15

2: 15 15 10 15

3: 15 15 15 10

2.3 Application consideration of memory mirroring and address based

memory mirroring

In the case of enabling memory mirroring or address based memory mirroring, memory access

performance of the mirrored NUMA node may be lowered. You should do performance tuning fully.

Autres manuels pour Express5800/A2040d

Ce manuel convient aux modèles suivants

Table des matières

Autres manuels NEC Serveur

NEC

NEC Express5800/320Lb FT Linux Manuel utilisateur

NEC

NEC SX-Aurora TSUBASA A300-4 Manuel utilisateur

NEC

NEC Express5800/120Li N8100-1298F Manuel utilisateur

NEC

NEC NEC Express5800 Series Manuel utilisateur

NEC

NEC PROSERVA PH133 Instructions d'utilisation et d'installation

NEC

NEC Express5800 320La Manuel utilisateur

NEC

NEC EXPRESS5800/120MF Manuel utilisateur

NEC

NEC NEC Express5800 Series Manuel utilisateur

NEC

NEC Express5800/R120d-1M Manuel utilisateur

NEC

NEC Express5800/T110f-SEXP285A Manuel utilisateur

NEC

NEC Express5800/R120e-2M Manuel utilisateur

NEC

NEC DX2000 Manuel d'utilisation

NEC

NEC SV8300 Instructions d'installation

NEC

NEC Express5800/120Rh-2 Mode d’emploi

NEC

NEC Express5800/R120h-2E Manuel utilisateur

NEC

NEC Express5800/AD106c Manuel utilisateur

NEC

NEC EXPRESS5800/120Re-2 Manuel utilisateur

NEC

NEC N8100- 1241F Manuel utilisateur

NEC

NEC NEC Express5800 Series Guide de référence

NEC

NEC Express5800/T110g-S Manuel utilisateur

NEC

NEC Express5800/320Ma Manuel utilisateur

NEC

NEC N8140-801 Manuel utilisateur

NEC

NEC Express5800/320Ma Manuel utilisateur

NEC

NEC NECCare Platinum Express5800/A1160 Manuel utilisateur

Manuels Serveur populaires d'autres marques

HP AlphaServer ES47 Manuel utilisateur

Dell

Dell PowerEdge R410 Manuel utilisateur

PowerNAS

PowerNAS CMA Manuel utilisateur

Supero

Supero FatTwin F617R3-FT Manuel utilisateur

MSI

MSI P1-109N-L70 Manuel utilisateur

Dell

Dell PowerEdge XE9640 Manuel

Dell

Dell PS4100 Instructions de montage

EtroVISION

EtroVISION EV3151 Manuel utilisateur

HP ProLiant Gen9 Manuel utilisateur

Compaq

Compaq ProLiant 3000 Manuel

Dell

Dell PowerEdge 3YPMN Manuel utilisateur

iRobo

iRobo IPC2U Manuel utilisateur

Nortel

Nortel 1000 Con?guration guide Manuel utilisateur

Asus

Asus AP7500 Manuel d'utilisation et d'entretien

Avid Technology

Avid Technology AirSpeed 5000 Manuel utilisateur

HP Integrity rx2600 Guide d'installation

Milestone

Milestone Husky IVO 350T Manuel utilisateur

Planet

Planet NAS-7410 Manuel utilisateur