Document Type | Technical Information
Category | Installation
Applicable Product Versions | Tibero6/Tibero7
Document Number | TINTI044
Overview
This document is a guide on how to configure TAS (Tibero Active Storage) using Multipath technology.
Method
1. Overview of TAS and DiskSpace Components
Overview of TAS
TAS (Tibero Active Storage) is a logical volume manager and file system that manages disk devices directly without requiring separate external solutions,
storing data files, log files, and more necessary for Tibero operation.
It also provides clustering features to enable the Tibero Active Cluster (TAC) function when using shared disks.
Tibero Configuration Using TAS
2. TAS Configuration Plan
MultiPath - Character Device Configuration
Reasons for recommending TAS configuration through Character Device configuration
* When using DM (device-mapper), the OS reboot order cannot be guaranteed.
Example) /dev/dm-0, /dev/dm-1 โฆ
* Using Block Device causes OS cache and buffer use, leading to consistency issues between TAC nodes.
* Reference
The RAW_DRIVER was officially removed in Linux kernel 5.14.
https://kernelnewbies.org/Linux_5.14 - Remove the raw driver (obsoleted by Direct-IO)
Using Multipath
* Create Virtual Drives (LUNs) using RAID on the storage (Storage team responsibility)
* Assign or map LUNs so that the server can access them through the controller (Storage team responsibility)
* Configure two or more PATHs as Multipath to use the same device (OS team responsibility)
Example) Check with multipath โll or lsblk
DiskSpace Partition Areas
Partition Area |
Count |
Required Capacity |
Volume Sharing |
Device Example |
Size Example |
|
| CFILE | 1G Device / 3 units | 3G | O | /dev/raw/raw1 | 1G | |
| /dev/raw/raw2 | 1G | |||||
| /dev/raw/raw3 | 1G | |||||
| REDO | 200G per NODE (instance) |
NODE * 200G |
O |
3 NODE Instance Reference |
/dev/raw/raw4 | 200G |
| /dev/raw/raw5 | 200G | |||||
| /dev/raw/raw6 | 200G | |||||
| ARCHIVE | 500GB per NODE (instance) |
NODE * 500G |
O |
3 NODE Instance Reference |
/dev/raw/raw7 | 500G |
| /dev/raw/raw8 | 500G | |||||
| /dev/raw/raw9 | 500G | |||||
| DATA | Allocate remaining DATA |
Available storage 100TB or more Allocate in 4TB partitions |
O | 100 TB or more |
/dev/raw/raw21 /dev/raw/rawN ... |
4TB |
|
Available storage less than 100TB Allocate in 2TB partitions |
O | Less than 100 TB |
/dev/raw/raw22 /dev/raw/rawN ... |
2TB | ||
|
Available storage less than 10TB Allocate in 400G partitions |
O | Less than 10 TB |
/dev/raw/raw23 /dev/raw/rawN ... |
400G | ||
|
Available storage less than 1TB Allocate in 200G partitions |
O | Less than 1 TB |
/dev/raw/raw24 /dev/raw/rawN ... |
200G | ||
Device Mapping Configuration Using Character Device
Permissions Must Be Retained After Reboot
### File Location for Creation
/etc/udev/rules.d/60-raw.rules
-- When using Multipath (ACTION=="[device option]", ENV{DM_NAME}=="[multipath name]", RUN+="/usr/bin/raw /dev/raw/rawX %N")
ACTION=="add|change", ENV{DM_NAME}=="mpathd", RUN+="/usr/bin/raw /dev/raw/raw1 %N"
ACTION=="add|change", ENV{DM_NAME}=="mpathe", RUN+="/usr/bin/raw /dev/raw/raw2 %N"
ACTION=="add|change", ENV{DM_NAME}=="mpathf", RUN+="/usr/bin/raw /dev/raw/raw3 %N"
โฆ
-- Permission settings (KERNEL=="[target device name]", OWNER="[owner username]", GROUP="[owner group]", MODE="[permission setting]")
KERNEL=="raw*", OWNER="tibero", GROUP="dba", MODE="660"
### Reload udev rules or reboot OS
udevadm control --reload-rules
shutdown -r now
### Refresh udev rules
udevadm trigger --action=add
### Check devices
[root@tac1:/etc/udev/rules.d]# raw -qa
### Location
/dev/raw/raw1
crwxrwxrwx 1 tibero dba 162, 1 Aug 11 13:39 raw1
crwxrwxrwx 1 tibero dba 172, 2 Aug 11 13:40 raw2
crwxrwxrwx 1 tibero dba 182, 3 Aug 11 13:41 raw3
TAS Creation Example
### DiskSpace Creation Example
DATA area
CREATE DISKSPACE TBDATA_DS01 EXTERNAL REDUNDANCY
FAILGROUP DFG1 DISK '/dev/raw/raw21' name disk01 attribute 'AU_SIZE'='4M';
REDO area
CREATE DISKSPACE TBARCH_DS01 EXTERNAL REDUNDANCY
FAILGROUP DFG1 DISK '/dev/raw/raw4' name disk02 attribute 'AU_SIZE'='4M';
ARCHIVE area
CREATE DISKSPACE TBREDO_DS01 EXTERNAL REDUNDANCY
FAILGROUP DFG1 DISK '/dev/raw/raw7' name disk03 attribute 'AU_SIZE'='4M';
Cluster Device Creation Example
### CFILE Creation Example
Register cluster
cmrctl add cluster --incnet inter1 --pubnet pub1 --cfile "/dev/raw/raw1, /dev/raw/raw2, /dev/raw/raw3" --name cls1