본문 바로가기

Oracle/11g Rac Install

Oracle11g RAC R2 Install - 1 Step : Cluster Install ( ASM )

11g, rac, grid, asm, install, grid infrastructure, r2,
11g R2 RAC 는 R1과 많이 다르다.

R1까지는 CRS를 개별적으로 설치를 하지만.
R2는 CRS가 grid Infrastrusture에 포함이 되어서
말그대로 grid 관리가 된다.

R2부터는 불편하지 않게 효율적으로 통합관리된다라고 보면 된다라고 생각하면 될까?...

R2 11g는 1.5GB이상의 메모리가 필요하기때문에
편하게 2GB의 메모리를 잡아준다.

메모리가 1.5GB면 당연히 swap 은 3GB 로 늘어날테니
swap도 그에 맞게 잡아준다.

기존 R1까지는 그냥 ocfs로 ocr을 저장했지만
R2에서는 오라클에서 밀고있는 ASM을 사용하기로 한다.

11g OCM을 본적은 없지만  아마도 ASM위에 올리지 않을까 생각이 된다.
그렇겠지... 자기네 물건잘난거도 홍보할겸 ㅡ_ㅡ;;;;

Grid는 대량 3기가가 넘는 양이 필요하니. 적당하게 잘 잡아주고 시작해보자.
본인은.

[root@node11g1 u01]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda1             7.0G  3.5G  3.2G  53% /
/dev/sda2             9.5G  3.3G  5.8G  37% /u01
/dev/sdh1             9.9G  151M  9.2G   2% /u02
tmpfs                    1006M  168M  839M  17% /dev/shm
.host:/                   233G  163G   71G  70% /mnt/hgfs
[root@node11g1 u01]#

/u01 에는 grid . /u02 에는 DB를 설치하기로했다.
나머지 데이터는 전부 ASM을 활용할것이다.

아래는 Vmware에 추가한 하드웨어.



하드디스크를 보면 순서대로 sda 부터 h까지 있다.
20GB : OS 와 grid software 영역
5GB * 3개 : ASM 데이터 영역
3GB * 2개 : ASM 플래시백복구 영역
10GB : database software 영역

database software가 왜 내렸냐하면 .... 용량이 저리 크리라 생각을 안해서이다. 그래서 개별적으로 추가.

10g부터 설치할 소프트웨어및 설정등이 편하게 OUI에 출력되기때문에
그부분은 생략하고 넘어간다.

참고할것은 : OEL5를 설치하고나서 개별적으로 oracleasmlib 를 oracle사이트에서 받아서 설치를 했었다.
- 이상하게 DVD이미지 안에는 없었다. -
다른형태로 제공해서 그런건지... ㅡ_ㅡㅋ;;; 아니면 정말 없는건지...


1. Cluster 선택.


2. 일반선택을 하고 넘어간다.
(Advanced 를 선택하면 vip를 자동으로 잡는다. 헌데 보통 아이피는 설정하고 하는데 이상하게 더 상세하게 설정을 해야할
Adv installation 이 그 것을 auto로 잡는다 ㅡ_ㅡ;;; 이해할수없다. )


3. SCAN 설정


4. second Node 추가.


5. 설치 경로 설정및 OCR 설치 위치 설정 ocfs 아니면 ASM을 선택한다. - 본인은 ASM


6. ASM 관리 패스워드 oracle1로 했더니 어찌나 평이한 패스워드인지 이런메세지도.


7. ASM 디스크그룹설정.


8. 인벤토리 설정.


9. OS설정및 패키지 체크.( NTP는 무시하고 넘어가기로 했다. 단 vmware-tools를 설치하면 제공되는 toolbox를 이용해서 HOST컴퓨터와 동일한 시간을 갖도록 체크만 한다. )


10. 설치 요약 정보


11. 설치를 진행하고 나면 root가 실행해줘야할 부분을 역시 10g RAC처럼 진행한다. 
그러면 최종 NTP설정을 하지 않아서 끝에 오류만 확인된다. 


12. 오류 메세지 창.


=========================================================================================================================

root 로 실행해줘야하는 부분에서 실행하면 생성및 백업작업을 하는것이 보인다

[root@node11g1 ~]# /u01/app/11.2.0/grid/root.sh
Running Oracle 11g root.sh script...

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2010-11-07 09:46:55: Parsing the host name
2010-11-07 09:46:55: Checking for super user privileges
2010-11-07 09:46:55: User has super user privileges
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
  root wallet
  root wallet cert
  root cert export
  peer wallet
  profile reader wallet
  pa wallet
  peer wallet keys
  pa wallet keys
  peer cert request
  pa cert request
  peer cert
  pa cert
  peer root cert TP
  profile reader root cert TP
  pa root cert TP
  peer pa cert TP
  pa peer cert TP
  profile reader pa cert TP
  profile reader peer cert TP
  peer user cert
  pa user cert
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-2672: Attempting to start 'ora.gipcd' on 'node11g1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'node11g1'
CRS-2676: Start of 'ora.gipcd' on 'node11g1' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'node11g1'
CRS-2676: Start of 'ora.gpnpd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'node11g1'
CRS-2676: Start of 'ora.cssdmonitor' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'node11g1'
CRS-2672: Attempting to start 'ora.diskmon' on 'node11g1'
CRS-2676: Start of 'ora.diskmon' on 'node11g1' succeeded
CRS-2676: Start of 'ora.cssd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'node11g1'
CRS-2676: Start of 'ora.ctssd' on 'node11g1' succeeded

ASM created and started successfully.

DiskGroup OCRDATA created successfully.

clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-2672: Attempting to start 'ora.crsd' on 'node11g1'
CRS-2676: Start of 'ora.crsd' on 'node11g1' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk 44d85156264b4fbebffc122b5b0712b4.
Successfully replaced voting disk group with +OCRDATA.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   44d85156264b4fbebffc122b5b0712b4 (ORCL:OCR) [OCRDATA]
Located 1 voting disk(s).
CRS-2673: Attempting to stop 'ora.crsd' on 'node11g1'
CRS-2677: Stop of 'ora.crsd' on 'node11g1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'node11g1'
CRS-2677: Stop of 'ora.asm' on 'node11g1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'node11g1'
CRS-2677: Stop of 'ora.ctssd' on 'node11g1' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'node11g1'
CRS-2677: Stop of 'ora.cssdmonitor' on 'node11g1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'node11g1'
CRS-2677: Stop of 'ora.cssd' on 'node11g1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'node11g1'
CRS-2677: Stop of 'ora.gpnpd' on 'node11g1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'node11g1'
CRS-2677: Stop of 'ora.gipcd' on 'node11g1' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'node11g1'
CRS-2677: Stop of 'ora.mdnsd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.mdnsd' on 'node11g1'
CRS-2676: Start of 'ora.mdnsd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'node11g1'
CRS-2676: Start of 'ora.gipcd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'node11g1'
CRS-2676: Start of 'ora.gpnpd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'node11g1'
CRS-2676: Start of 'ora.cssdmonitor' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'node11g1'
CRS-2672: Attempting to start 'ora.diskmon' on 'node11g1'
CRS-2676: Start of 'ora.diskmon' on 'node11g1' succeeded
CRS-2676: Start of 'ora.cssd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'node11g1'
CRS-2676: Start of 'ora.ctssd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'node11g1'
CRS-2676: Start of 'ora.asm' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'node11g1'
CRS-2676: Start of 'ora.crsd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.evmd' on 'node11g1'
CRS-2676: Start of 'ora.evmd' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'node11g1'
CRS-2676: Start of 'ora.asm' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.OCRDATA.dg' on 'node11g1'
CRS-2676: Start of 'ora.OCRDATA.dg' on 'node11g1' succeeded
CRS-2672: Attempting to start 'ora.registry.acfs' on 'node11g1'
CRS-2676: Start of 'ora.registry.acfs' on 'node11g1' succeeded

node11g1     2010/11/07 09:51:30     /u01/app/11.2.0/grid/cdata/node11g1/backup_20101107_095130.olr
Preparing packages for installation...
cvuqdisk-1.0.7-1
Configure Oracle Grid Infrastructure for a Cluster ... succeeded
Updating inventory properties for clusterware
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 3074 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /u01/app/oraInventory
'UpdateNodeList' was successful.
[root@node11g1 ~]#

===================================================================================================================

설치후 상태를 보면 아래처럼 보인다.
OFFLINE이 보이는데 난 이게 정말 문제 인줄 알고 몇번을 설치했다.
헌데 구글링을 해보니 오류가 아니란다 ㅡ_ㅡ;;;;

아래링크는 gsd 서비스 오류가 문제가 있는것이 아니라는 내용.
http://oraclehandson.wordpress.com/2010/05/24/oracle-11gr2-offline-gsd-resources/

9i RAC까지는 관련이 있었으나 11g는 의미가 없다고 하니.
패스하고 넘어가기로 한다.

Meta Link[ID 429966.1]에 나왔단다.


[root@node11g1 u01]# /u01/app/11.2.0/grid/bin/crs_stat -t
Name           Type           Target    State     Host       
------------------------------------------------------------
ora....ER.lsnr ora....er.type ONLINE    ONLINE    node11g1   
ora....N1.lsnr ora....er.type ONLINE    ONLINE    node11g1   
ora.OCRDATA.dg ora....up.type ONLINE    ONLINE    node11g1   
ora.asm        ora.asm.type   ONLINE    ONLINE    node11g1   
ora.eons       ora.eons.type  ONLINE    ONLINE    node11g1   
ora.gsd        ora.gsd.type   OFFLINE   OFFLINE              
ora....network ora....rk.type ONLINE    ONLINE    node11g1   
ora....SM1.asm application    ONLINE    ONLINE    node11g1   
ora....G1.lsnr application    ONLINE    ONLINE    node11g1   
ora....1g1.gsd application    OFFLINE   OFFLINE              
ora....1g1.ons application    ONLINE    ONLINE    node11g1   
ora....1g1.vip ora....t1.type ONLINE    ONLINE    node11g1   
ora....SM2.asm application    ONLINE    ONLINE    node11g2   
ora....G2.lsnr application    ONLINE    ONLINE    node11g2   
ora....1g2.gsd application    OFFLINE   OFFLINE              
ora....1g2.ons application    ONLINE    ONLINE    node11g2   
ora....1g2.vip ora....t1.type ONLINE    ONLINE    node11g2   
ora.oc4j       ora.oc4j.type  OFFLINE   OFFLINE              
ora.ons        ora.ons.type   ONLINE    ONLINE    node11g1   
ora....ry.acfs ora....fs.type ONLINE    ONLINE    node11g1   
ora.scan1.vip  ora....ip.type ONLINE    ONLINE    node11g1   

뭐 offline이 찜찜하지만 그래도
[root@node11g1 /]# ping node11g1-vip.oracle.com
PING node11g1-vip.oracle.com (192.168.0.211) 56(84) bytes of data.
64 bytes from node11g1-vip.oracle.com (192.168.0.211): icmp_seq=1 ttl=64 time=0.028 ms
64 bytes from node11g1-vip.oracle.com (192.168.0.211): icmp_seq=2 ttl=64 time=0.020 ms

--- node11g1-vip.oracle.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1023ms
rtt min/avg/max/mdev = 0.020/0.024/0.028/0.004 ms
[root@node11g1 /]# ping node11g2-vip.oracle.com
PING node11g2-vip.oracle.com (192.168.0.212) 56(84) bytes of data.
64 bytes from node11g2-vip.oracle.com (192.168.0.212): icmp_seq=1 ttl=64 time=14.4 ms
64 bytes from node11g2-vip.oracle.com (192.168.0.212): icmp_seq=2 ttl=64 time=0.213 ms
64 bytes from node11g2-vip.oracle.com (192.168.0.212): icmp_seq=3 ttl=64 time=0.369 ms

vip로 핑 잘나간다.~

2010/11/07 - [Oracle 11g/1. RAC INSTALL] - Oracle11g RAC R2 Install - 2 Step : DB install