Slide 1: Oracle: Software Powers the Internet
ORACLE SOFTWARE POWERS THE INTERNET
Slide 2: Oracle 9i Real Application Clusters
Oracle 9i Real Application Clusters Oracle Partner Technical Services Workshop
Slide 3: Agenda
Agenda •Overview •Architecture •Machine configuration •How to install and gotchas •Creation of the RAC instances •Monitoring and Administration with OEM •Tuning Recommendations
Slide 4: Seminar Objectives
Seminar Objectives Explain the Architecture of Oracle Real Application Clusters Show Technical People how to quickly set up and use Oracle9i Real Application Clusters
Slide 5: What is Oracle 9i RAC?
What is Oracle 9i RAC? The 9i Oracle Parallel Server database! Application clustering Major changes in Oracle9i: – Scalability with full Cache Fusion architecture – Improved availability – Improved manageability
Slide 6: Agenda
Agenda •Overview •Architecture •Machine configuration •How to install and gotchas •Creation of the RAC instances •Monitoring and Administration with OEM •Tuning Recommendations
Slide 7: Real Application Clusters Architecture
Real Application Clusters Architecture Centralized Network Management Console Users Low Latency Interconnect No Single High Speed VIA or Proprietary Switch or Point Of Failure Interconnect Clustered Database Servers Hub or Switch Fabric Storage Area Network Mirrored Disk Subsystem
Slide 8: Out-of-the-Box Transparent Application Scalability
Out-of-the-Box Transparent Application Scalability In the past clustered databases scaled well for specific types of applications – Data Warehouse – Parallel-enabled OLTP Oracle Real Application Clusters with Cache Fusion can deliver transparent scalability to all types of applications
Slide 9: NEW in Oracle9i: Scalability Features
NEW in Oracle9i :- Scalability Features Full Cache Fusion Enhanced coordination of cache management and Distributed Lock Manager (DLM) through new Global Cache Service (GCS) & Global Enqueue Service (GES) Enhanced IPC Lock simplification and automation
Slide 10: Cache Fusion Architecture
Cache Fusion Architecture Full Cache Fusion Users – Cache-to-cache data shipping – Shared cache Cache Fusion eliminates slow I/O – Enhanced IPC he Allows flexible Shared Cac and transparent deployment
Slide 11: Full Cache Fusion
Full Cache Fusion Oracle9i Cache Fusion increases performance and scalability – Data is shipped directly over high speed interconnect – Minimize disk I/O Node A Node B Data Transfer Request Database Database buffers buffers Database
Slide 12: Benefits of Cache Fusion
Benefits of Cache Fusion Without Cache Fusion 100 Block access time (milli- With seconds) Cache Fusion 20 1 0.01 Block in Block in Block local cache remote cache on disk
Slide 13: Cache Fusion Manages Inter Instance Block Requests
Cache Fusion Manages Inter Instance Block Requests Readers and writers accessing instance Request Lock Status A gain access to for Block Block in blocks in instance Cache A Cache B B’s buffer cache Read Read All types of block contention and Read Write access Write Read Coordination by Write W
Slide 14: RAC Architecture Changes
RAC Architecture Changes The background process BSP is no longer used The following background processes have changed in function and description in release Oracle9i – LMS – LMON – LMD
Slide 15: Cache Coherency Model
Cache Coherency Model Data transfer between instances uses the IPC transport Block resource and the GCS record – Resource modes – Resource roles – Past image history Cache fusion requires fewer messages and steps to convert lock status Traditional hash locking can coexist with cache coherenc
Slide 16: Enhanced IPC
Enhanced IPC Global IPC service layer – Each requesting server process handles asynchronous IPC – Efficient I/O implementation Remote memory operations for direct DMA – Exploit modern low latency interfaces – Reduced CPU usage Intelligent batching of messages New V$ tables for IPC statistics
Slide 17: Lock Simplification and Automation
Lock Simplification and Automation Automatic GCS/GES configuration – Automatic derivation of GCS configuration – No INIT.ORA lock parameters required – Improved lock efficiency and memory management Dynamic lock affinity – GCS locks dynamically remastered reducing locking overhead – Cache layer
Slide 18: Agenda
Agenda •Overview •Architecture •Machine configuration •How to install and gotchas •Creation of the RAC instances •Monitoring and Administration with OEM •Tuning Recommendations
Slide 19: Machine Configuration
Machine Configuration Hardware - Supported on most vendor-clustered and non-vendor clustered platforms Operating System - Supported on clustered and non-clustered O/S’s (‘ClusterWare’ supplied by Oracle)
Slide 20: Machine Configuration
Machine Configuration You will need a Shared Disk Subsystem - Can be anything that supports a raw device - Must be addressable from all nodes - The higher the speed the better (FDDI, GigaBit) You will need a 2nd NIC for the Inter Instance Network - Can be ‘any’ network connection - The higher th
Slide 21: Operating System
Operating System Supported on all major cluster vendors O/S’s - Sun Clusterware - IBM HA - Compaq Tru64 CFS ‘ClusterWare’ supplied for Linux and Win2k - Supported on Linux (Kernel 2.4.x) and Win2k (SP2) - Certified on SuSE 7.2, Red Hat Advanced Server 2.1 and Win2k (certain vendors only)
Slide 22: Agenda
Agenda •Overview •Architecture •Machine configuration •How to install and gotchas •Creation of the RAC instances •Monitoring and Administration with OEM •Tuning Recommendations
Slide 23: Installation
Installation Install Windows 2000. No special requirements, just ensure TCPIP networking is installed. Take care at the NIC configuration screen, and hardcode %WINNT%\system32\drivers\etc\hosts with the IP address of each other node. Note the ftp service isn’t default – PITA! From the Disk 1 of
Slide 24: Partitioning the disks
Partitioning the disks 2 computer Management Action view || 42 Tree | ‘Computer Management (Local) =) i, System Tools (3) o me Syst Is 4.00 GB NTFS 12.95 GB NTFS Healthy (System) Healthy i (fa) Event viewer ce- QJ System Information is). &@] Performance Logs and Alerts {#1 Shared Folders New Yolume
Slide 25: Disk Partitioning
Disk Partitioning Right click against the free space you want to partition and choose ‘Create Logical Drive’
Slide 26: Disk Partitioning
Disk Partitioning You will be presented with the Partition Wizard, click Next
Slide 27: Disk Partitioning
Disk Partitioning Select Logical Drive, click Next
Slide 28: Disk Partitioning
Disk Partitioning Choose the size of partition according to the size of data file required, the “Oracle Recommended’s” are as follows:- SYSTEM tablespace, 400M SRVCFG parameter file, 10M USERS tablespace, 120M TEMP tablespace, 100M UNDOTBS 1 tablespace, 312M UNDOTBS 2 tablespace, 312M EXAMPLE tables
Slide 29: A word about the SRVCFG partition
A word about the SRVCFG partition… This partition (sometimes known as the ‘voting’ or ‘quorum’ disk) is required for the administration and management of the whole RAC cluster. It is therefore required for installation regardless of all your other partitions. Even if you don’t cut any tablespace par
Slide 30: Disk Partitioning
Disk Partitioning Choose ‘Do not assign a drive letter…’ and click Next
Slide 31: Disk Partitioning
Disk Partitioning Choose ‘Do not format partition’ and click Next, then click Finish
Slide 32: Attaching 'Objects' to partitions
Attaching ‘Objects’ to partitions Once you have partitioned the disks, navigate to C:\ temp\preinstall_rac\olm directory and run the OracleOBJService at the command line as below:- OracleOBJService /install This will install the service to manage the object links in the ‘Services’ panel. Once done,
Slide 33: Attaching 'Objects' to partitions
Attaching ‘Objects’ to partitions Right click against the Link Name, and name the partitions according to the following table, but only if you wish to use pre-configured database types in DBCA. The exceptions to this are the undo and redo files, which must end accordingly.
Slide 34: Attaching 'Objects' to partitions
Attaching ‘Objects’ to partitions Symbolic Link Name... Used for... db_name_system1 SYSTEM tablespace db_name_spfile1 Server parameter file db_name_users1 USERS tablespace db_name_temp1 TEMP tablespace db_name_undotbs1 First UNDO tablespace db_name_undotbs2 Second UNDO tablespace db_name_example1 EX
Slide 35: Setting up the cluster
Setting up the cluster • Once all links are named, click Options – Commit, and close the GuiOracleObjManager • From \temp\preinstall_rac\clustersetup run clustersetup.exe. You will be presented with the following screen, click next:-
Slide 36: Setting up the cluster
Setting up the cluster Select ‘Create a cluster’, click next
Slide 37: Setting up the cluster
Setting up the cluster Select the srvcfg partition, click next
Slide 38: Setting up the cluster
Setting up the cluster If VIA (Virtual Interface Architecture) is detected it can be utilised, otherwise click Next
Slide 39: Setting up the cluster
Setting up the cluster Choose Private Network, click next
Slide 40: Setting up the cluster
Setting up the cluster Enter the network details, click next
Slide 41: Setting up the cluster
Setting up the cluster Unless you have other plans, click finish
Slide 42: Setting up the Cluster
Setting up the Cluster Monitor the install to completion
Slide 43: Oracle RAC Installation
Oracle RAC Installation We are now ready for the Oracle Installation itself. Insert the CD and run setup / autorun.
Slide 44: Oracle RAC Installation
Oracle RAC Installation Choose all other nodes in the cluster, click Next
Slide 45: Oracle RAC Installation
Oracle RAC Installation Choose your ORACLE_HOME, this will be the case for ALL nodes
Slide 46: Oracle RAC Installation
Oracle RAC Installation Choose Oracle 9i Database, click Next
Slide 47: Oracle RAC Installation
Oracle RAC Installation Choose Custom, click Next
Slide 48: Oracle RAC Installation
Oracle RAC Installation Then (and only then) will you be presented with the Real Application Clusters option. Tick the box along with any other products you require, and click next
Slide 49: Oracle RAC Installation
Oracle RAC Installation Choose alternate locations if required, click Next
Slide 50: Oracle RAC Installation
Oracle RAC Installation Choose yes if you want to use the DBCA, click next
Slide 51: Oracle RAC Installation
Oracle RAC Installation Check the summary, and click install
Slide 52: Oracle Installation
Oracle Installation After install you will be presented with the ‘Configuration Tools’ screen….
Slide 53: Oracle RAC Installation
Oracle RAC Installation If you wish to use utilise an LDAP server choose yes, otherwise choose No and click Next.
Slide 54: Oracle RAC Installation
Oracle RAC Installation Change the name of the listener if required, click Next
Slide 55: Oracle RAC Installation
Oracle RAC Installation Choose TCP, click Next
Slide 56: Oracle RAC Installation
Oracle RAC Installation Change the port if required, click ‘Next’
Slide 57: Oracle RAC Installation
Oracle RAC Installation Choose Yes if you would like to configure another Listener, otherwise choose No, click next.
Slide 58: Oracle RAC Installation
Oracle RAC Installation You can leave naming methods as they are, or configure other methods at this stage.
Slide 59: Oracle RAC Installation
Oracle RAC Installation …finally you are presented with the ‘Oracle Net Configuration Complete’ screen.
Slide 60: Agenda
Agenda •Overview •Architecture •Machine configuration •How to install and gotchas •Creation of the RAC instances •Monitoring and Administration with OEM •Tuning Recommendations
Slide 61: Creating the database
Creating the database The Configuration Assistant will then present the Database Configuration Assistant Screen, choose Create a database, click Next.
Slide 62: Creating the database
Creating the database Choose all nodes other than the the one you are installing on, click Next
Slide 63: Ooops!
Ooops! If at this point you receive an exception referring to the GSD or Global Services Daemon, check the Services panel for 2 Oracle Services, namely the OracleCMService and the OracleGSDService. Both of these should have been installed, and started by the Oracle RAC install. Stop and restart them
Slide 64: Creating the database
Creating the database Choose the database you wish to create, click Next
Slide 65: Creating the database
Creating the database Choose the database name, click Next
Slide 66: Creating the database
Creating the database Choose any of the features you require, click Next
Slide 67: Creating the database
Creating the database Choose either dedicated or multithreaded (shared) server, click Next
Slide 68: Creating the database
Creating the database Change initialisation parameters, character sets, sizing and archive options if required, then click on File locations
Slide 69: Creating the database
Creating the database Ensure the SPFILE points to a raw partition if you intend to use one, then click Next
Slide 70: Creating the database
Creating the database Navigate to the Datafiles tree
Slide 71: Creating the database
Creating the database All the raw partitions should show as named and linked ‘objects’
Slide 72: Creating the database
Creating the database Redo should show up as 1_1, 2_1 etc, click Next
Slide 73: Creating the database
Creating the database Choose your creation options, and click Finish
Slide 74: Creating the database
Creating the database Monitor to completion.
Slide 75: Transparent Application Failover (TAF)
Transparent Application Failover (TAF) Transparent Application Failover compliments all levels of availability hierarchy – Applications and users are automatically and transparently reconnected to another system – Applications and queries continue uninterrupted – Login context maintained Node A in
Slide 76: Transparent Application Failover
Transparent Application Failover It’s provided by Oracle Net – Since 8.0.6 – Does not depend on RAC Single instance HA Cluster Replicated Database Standby Database (Data Guard) OPS or RAC Maintains session as long as service is available
Slide 77: Transparent Application Failover
Transparent Application Failover Automatically reconnects Detects broken connection upon SQL call 2 methods – Basic : try to re-establish the connection – Preconnect : simultaneously open a connection to the secondary server (RAC, Data Guard or replicated database) 2 types of failovers – SES
Slide 78: Transparent Application Failover
Transparent Application Failover What TAF does / does not do – If you are (example) mid-transaction (the UPDATE has been done but the COMMIT has not) and you failover with TAF, your application will need to issue a ROLLBACK before continuing (exception handling for ORA-254xx errors) – If you are (
Slide 79: Transparent Application Failover
Transparent Application Failover oow=(DESCRIPTION = (failover=on) (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 129.157.220.100)(PORT = 1521)) (ADDRESS = (PROTOCOL = TCP)(HOST = 129.157.220.101)(PORT = 1521)) ) (CONNECT_DATA = (SERVICE_NAME = RAC) (failover_mode = (type = select)(method=basic)
Slide 80: Agenda
Agenda •Overview •Architecture •Machine configuration •How to install and gotchas •Creation of the RAC instances •Monitoring and Administration with OEM •Tuning Recommendations
Slide 81: Real Application Clusters Manageability
Real Application Clusters Manageability Single system Image – Single Oracle Database – One virtual system to configure and manage – Single management console Cluster-wide monitoring and diagnostics
Slide 82: Real Application Clusters Manageability
Real Application Clusters Manageability Improved cluster-aware tools infrastructure for management – Oracle Universal Installer (OUI) – Enterprise Manager (OEM) – Database Configuration Assistant (DBCA) – Net8 Assistant (NETMGR) – Recovery Manager (RMAN) – Command line interface (SRVCTL)
Slide 83: Improved Configuration
Improved Configuration Centralized, persistent configuration storage – Eliminates consistency problems with the per node text file-based Parallel Server configuration in prior versions – Utilities to migrate previous Parallel Server configurations Enhanced DBCA and NETCA / NETMGR functionality –
Slide 84: Real Application Cluster Configuration
Real Application Cluster Configuration Windows Windows cluster Registry or UNIX cluster UNIX Text cluster file Raw device Pre-Oracle9i Oracle9i
Slide 85: Improved Administration
Improved Administration Dynamic cluster node addition and deletion (DBCA) – Add/delete a node in both the system and the database Better integration with Oracle Enterprise Manager – View and update server side initialization parameter file (SPFILE) – Assign UNDO segments to database instances
Slide 86: Shared Initialization Parameter File
Shared Initialization Parameter File Node 1 Raw device Node 2 ORACLE_HOME= ORACLE_HOME= /hdisk1 /hdisk1 ORACLE_SID=orac1 ORACLE_SID=orac2 Local Local disk disk /hdisk1/dbs/initorac1.ora /hdisk1/dbs/initorac2.ora SPFILE=/dev/rdisk1/spfile SPFILE=/dev/rdisk1/spfile /dev/rdisk1/spfile orac1.instance_na
Slide 87: Improved Administration
Improved Administration Better integration with OEM (Contd.) – Enhanced monitoring capability and events available with OEM and performance packs Cache Fusion statistics Statistics for interconnect block traffic Statistics for the entire database or per instance New OEM events associated w
Slide 88: New and Modified (opsctl) srvctl Commands
New and Modified (opsctl) srvctl Commands Start all instances in the cluster srvctl start db -d PTSRAC Stop all instances in the cluster srvctl stop db -d PTSRAC Stop all instances with the immediate option srvctl stop db –d PTSRAC –o immediate Start all instances but do not open them srvct
Slide 89: Agenda
Agenda •Overview •Architecture •Machine configuration •How to install and gotchas •Creation of the RAC instances •Monitoring and Administration with OEM •Tuning Recommendations
Slide 90: Tuning Recommendations
Tuning Recommendations New tuning guide for RAC Consider a certain level of Data Partitioning (also use Oracle Partitions for tables and indexes whenever relevant) Assigning 1:N locks to data files with the GC_FILES_TO_LOCKS parameter turns off Cache Fusion
Slide 91: Tuning Recommendations (2)
Tuning Recommendations (2) Automatic Segment Management CREATE TABLESPACE tbs_1 DATAFILE ’tbs1.dbf’ EXTENT MANAGEMENT LOCAL SEGMENT SPACE MANAGEMENT AUTO; Possible to have a separate sequence cache per instance
Slide 92: Oracle9i Performance and Scalability
Oracle9i Performance and Scalability The business environment today: – Internet users and transaction volumes grow extremely rapidly – Data warehouse systems must support very large data volumes – Server consolidation drives the need for large scale systems Oracle9i provides the ability to deplo
Slide 93: ORACLE
ORACLE SOFTWARE POWERS THE INTERNET