You are on page 1of 4

Anar Godjaev

https://anargodjaev.wordpress.com/
How to enable Exadata writeback Flashcache on cell storage ?
(WriteThrough to WriteBack)
Use the Write-Back Flash Cache feature to leverage the Exadata Flash hardware and make Exadata
Database Machine a faster system for Oracle Database Deployments.
There are two key features of the Exadata Storage Server Software that leverage the
Exadata Flash hardware and make the Exadata Database Machine such a fast system on
which to deploy the Oracle Database. First is Exadata Smart Flash Cache which provides the
capability to stage active database objects in flash. Second is the Exadata Smart Flash
Logging which speeds the critical function of database logging. Lastly, the deployment of the
Oracle Database requires mission critical resilience and the Exadata Storage Server Software
in conjunction with the Oracle Database provides that.
Write-Back Flash Cache Benefits:
o
o
o
o
o
o
o

It improves the write intensive operations because writing to flash cache is much
faster than writing to Hard disks.
Exadata X4-2 Database Machines write performance can be improved up to 20X IOPS
than Hard disk.
Exadata X4-2 / V2 Database Machines write performance can be improved up to 10X
IOPS than Hard disk.
Write-Back Flash Cache transparently accelerates reads and writes for all workloads
for OLTP (faster random reads and writes) and DW (faster sequential smart scans).
Write-Back Flash Cache reduce latency of redo log writes when it shares disks with
data.
Data recoverable from Flash cache on cellsrv restart
If you find significant waits for "free buffer waits" or high IO times to check for write
bottleneck in AWR reports, then you should consider using the write back flash cache
feature.

Enable Write-Back Flash Cache: Methods are available:


o
o

Rolling Method
Non-Rolling Method

Non-Rolling Method:
First check flashcache mode with below command on all cell servers with the use of dcli
utility on DB node. It can be check on cell each server also with cellcli utility.
[root@bakuexa1celadm01 ~]dcli -l root -g cellgroup "cellcli -e list cell detail" | grep
"flashCacheMode"
bakuexa1celadm01: WriteThrough
bakuexa1celadm02: WriteThrough
bakuexa1celadm03: WriteThrough
Step 1. Drop the flash cache on that cell
CellCLI> drop flashcache
Flash cache bakuexa1celadm01_FLASHCACHE successfully dropped
Step 2. Shut down cellsrv service

Anar Godjaev
https://anargodjaev.wordpress.com/
CellCLI> alter cell shutdown services cellsrv
Stopping CELLSRV services...
The SHUTDOWN of CELLSRV services was successful.
Step 3. Set the cell flashcache mode to writeback
CellCLI> alter cell flashCacheMode = WriteBack
Cell bakuexa1celadm01 successfully altered
Step 4. Restart the cellsrv service
CellCLI> alter cell startup services cellsrv
Starting CELLSRV services...
The STARTUP of CELLSRV services was successful.
Step 5. Create the flash cache all
CellCLI> alter cell startup services cellsrv
Starting CELLSRV services...
The STARTUP of CELLSRV services was successful.
Rolling Method:
Step 1. Drop the flash cache on that cell
CellCLI> drop flashcache
Flash cache bakuexa1celadm01_FLASHCACHE successfully dropped
Step 2. Check the status of ASM if the grid disks go OFFLINE. The following command should
return 'Yes' for the grid disks being listed:
CellCLI> cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
DATAC1_CD_00_bakuexa1celadm01 OFFLINE Yes
DATAC1_CD_01_bakuexa1celadm01 OFFLINE Yes
DATAC1_CD_02_bakuexa1celadm01 OFFLINE Yes
DATAC1_CD_03_bakuexa1celadm01 OFFLINE Yes
DATAC1_CD_04_bakuexa1celadm01 OFFLINE Yes
DATAC1_CD_05_bakuexa1celadm01 OFFLINE Yes
DBFS_DG_CD_02_bakuexa1celadm01 OFFLINE Yes
DBFS_DG_CD_03_bakuexa1celadm01 OFFLINE Yes
DBFS_DG_CD_04_bakuexa1celadm01 OFFLINE Yes
DBFS_DG_CD_05_bakuexa1celadm01 OFFLINE Yes
RECOC1_CD_00_bakuexa1celadm01 OFFLINE Yes
RECOC1_CD_01_bakuexa1celadm01 OFFLINE Yes
RECOC1_CD_02_bakuexa1celadm01 OFFLINE Yes
RECOC1_CD_03_bakuexa1celadm01 OFFLINE Yes
RECOC1_CD_04_bakuexa1celadm01 OFFLINE Yes
RECOC1_CD_05_bakuexa1celadm01 OFFLINE Yes

Anar Godjaev
https://anargodjaev.wordpress.com/
Step 3. Inactivate the griddisk on the cell
CellCLI> cellcli e alter griddisk all inactive
Step 4. Shut down cellsrv service
CellCLI> alter cell shutdown services cellsrv
Stopping CELLSRV services...
The SHUTDOWN of CELLSRV services was successful.
Step 5. Set the cell flashcache mode to writeback
CellCLI> alter cell flashCacheMode = WriteBack
Cell bakuexa1celadm01 successfully altered
Step 6. Restart the cellsrv service
CellCLI> alter cell startup services cellsrv
Starting CELLSRV services...
The STARTUP of CELLSRV services was successful.
Step 7. Reactivate the griddisks on the cell
CellCLI> cellcli e alter griddisk all active
CellCLI>
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk
GridDisk

ALTER GRIDDISK ALL ACTIVE


DATAC1_CD_00_bakuexa1celadm03 successfully altered
DATAC1_CD_01_bakuexa1celadm03 successfully altered
DATAC1_CD_02_bakuexa1celadm03 successfully altered
DATAC1_CD_03_bakuexa1celadm03 successfully altered
DATAC1_CD_04_bakuexa1celadm03 successfully altered
DATAC1_CD_05_bakuexa1celadm03 successfully altered
DBFS_DG_CD_02_bakuexa1celadm03 successfully altered
DBFS_DG_CD_03_bakuexa1celadm03 successfully altered
DBFS_DG_CD_04_bakuexa1celadm03 successfully altered
DBFS_DG_CD_05_bakuexa1celadm03 successfully altered
RECOC1_CD_00_bakuexa1celadm03 successfully altered
RECOC1_CD_01_bakuexa1celadm03 successfully altered
RECOC1_CD_02_bakuexa1celadm03 successfully altered
RECOC1_CD_03_bakuexa1celadm03 successfully altered
RECOC1_CD_04_bakuexa1celadm03 successfully altered
RECOC1_CD_05_bakuexa1celadm03 successfully altered

Step 8. Verify all grid disks have been successfully put online using the following command:
CellCLI> list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
DATAC1_CD_00_bakuexa1celadm02 ONLINE
Yes
DATAC1_CD_01_bakuexa1celadm02 ONLINE
Yes
DATAC1_CD_02_bakuexa1celadm02 ONLINE
Yes
DATAC1_CD_03_bakuexa1celadm02 ONLINE
Yes
DATAC1_CD_04_bakuexa1celadm02 ONLINE
Yes
DATAC1_CD_05_bakuexa1celadm02 ONLINE
Yes
DBFS_DG_CD_02_bakuexa1celadm02 ONLINE
Yes

Anar Godjaev
https://anargodjaev.wordpress.com/
DBFS_DG_CD_03_bakuexa1celadm02
DBFS_DG_CD_04_bakuexa1celadm02
DBFS_DG_CD_05_bakuexa1celadm02
RECOC1_CD_00_bakuexa1celadm02
RECOC1_CD_01_bakuexa1celadm02
RECOC1_CD_02_bakuexa1celadm02
RECOC1_CD_03_bakuexa1celadm02
RECOC1_CD_04_bakuexa1celadm02
RECOC1_CD_05_bakuexa1celadm02

ONLINE
ONLINE
ONLINE
ONLINE
ONLINE
ONLINE
ONLINE
ONLINE
ONLINE

Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes

Step 9. Recreate the flash cache


CellCLI> create flashcache all
Flash cache bakuexa1celadm01_FLASHCACHE successfully created
Step 10. Check the status of the cell to confirm that it's now in WriteBack mode:
CellCLI> cellcli -e list cell detail | grep flashCacheMode
flashCacheMode:

WriteBack

Step 11. Repeat these same steps again on the next cell to the FINAL cell. However, before
taking another storage server offline, execute the following making sure
'asmdeactivationoutcome' displays YES:
CellCLI> cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
DATAC1_CD_00_bakuexa1celadm01 ONLINE Yes
DATAC1_CD_01_bakuexa1celadm01 ONLINE Yes
DATAC1_CD_02_bakuexa1celadm01 ONLINE Yes
DATAC1_CD_03_bakuexa1celadm01 ONLINE Yes
DATAC1_CD_04_bakuexa1celadm01 ONLINE Yes
DATAC1_CD_05_bakuexa1celadm01 ONLINE Yes
DBFS_DG_CD_02_bakuexa1celadm01 ONLINE Yes
DBFS_DG_CD_03_bakuexa1celadm01 ONLINE Yes
DBFS_DG_CD_04_bakuexa1celadm01 ONLINE Yes
DBFS_DG_CD_05_bakuexa1celadm01 ONLINE Yes
RECOC1_CD_00_bakuexa1celadm01 ONLINE Yes
RECOC1_CD_01_bakuexa1celadm01 ONLINE Yes
RECOC1_CD_02_bakuexa1celadm01 ONLINE Yes
RECOC1_CD_03_bakuexa1celadm01 ONLINE Yes
RECOC1_CD_04_bakuexa1celadm01 ONLINE Yes
RECOC1_CD_05_bakuexa1celadm01 ONLINE Yes
FINALLY
After changing the flashcache modes on all cells, check if flashcache modes are changed to
write-back for all cells.
CellCLI> dcli -g ~/cell_group -l root cellcli -e "list cell attributes flashcachemode"
bakuexa1celadm01: WriteBack
bakuexa1celadm02: WriteBack
bakuexa1celadm03: WriteBack

You might also like