Recently I made an Exadata stack upgrade\/update to the last 19.2 version (19.2.7.0.0.191012) released in October of 2019, and update the GI to the last 19c version (19.5.0.0.191015) and after that, I hade some issues to create 11G databases.<\/p>\n
So, when I try to create an 11G RAC database, the error \u201cFile -oracka.ko- was not found<\/em><\/strong>\u201d appears and creation fails. Here I want to share with you the workaround (since there is no solution yet) that I discovered and used to bypass the error.<\/p>\n The actual environment is:<\/p>\n So, calling dbca:<\/p>\n <\/p>\n And at the log:<\/p>\n If you check for the trace of database creation:<\/p>\n So, as you can see in the trace the process for database creation when detecting that ACFS is in place, tries to unzip some files (.ko, kernel objects) related to ACFS access but receive the error or that cannot delete old oracka.ko<\/strong> and for uncompressing file oracka.zip<\/strong>.<\/p>\n Checking for the problem, we can see that access denied occurs for folder $GI_HOME\/usm\/install\/Oracle\/EL7UEK\/x86_64\/4.1.12-112.16.4\/4.1.12-112.16.4-x86_64\/bin\/<\/em> inside of GI home. And as you can see is the same family of our domU kernel version. Inside os MOS there is no reference for this error, and after open the SR for Oracle was sent do dev team without ETA (as usual).<\/p>\n Because of that I continue to check and checked the folder:<\/p>\n As you can see, the GI Home came with some ko <\/em>files already uncompressed and the permission for a group just as read. So, the delete and uncompressing by dbca will not work properly, and as a workaround to solve the issue, I changed the permission for folder bin and ko<\/em> files to allow change for oinstall – made in all nodes of the cluster:<\/strong><\/p>\n After executing this in both nodes, the dbca finish:<\/p>\n Just to check, the ko<\/em> files and bin folder already came with wrong permissions in the original 19c packages:<\/p>\n This error for oracka.zip<\/em> and oracka.ko<\/em> occurs because there is a sum of little details. The release of GI 19c version already came with bad folder permission. The release update 19.5.0.0.191015 does not solve the issue too (and even the installation or rootupgrade<\/em> script). This bin folder was checked by dbca because the kernel image for Exadata 19.2.7.0.0 (19.2.7.0.0.191012) comes with kernel 4.1.12-124.30.1.el7uek.x86_64 and the ACFS modules for this family are there. And to finish the sum of all problems, the ACFS was used and for that reason, it tries to use that kernel modules to check access.<\/p>\n So, since there is no solution at MOS (today while I am publishing this post), and there is no official workaround, was needed to find own solution. So, the workaround described here it is just temporary to allow 11g RAC database creation for this specific sun of Exadata Version + GI Home 19c + ACFS in use<\/strong>.<\/p>\n <\/p>\n Disclaimer<\/strong>: \u201cThe postings on this site are my own and don\u2019t necessarily represent my actual employer positions, strategies or opinions. The information here was edited to be useful for general purpose, specific data and identifications were removed to allow reach the generic audience and to be useful for the community. Post protected by copyright.\u201d<\/em><\/p>\n","protected":false},"excerpt":{"rendered":" Recently I made an Exadata stack upgrade\/update to the last 19.2 version (19.2.7.0.0.191012) released in October of 2019, and update the GI to the last 19c version (19.5.0.0.191015) and after that, I hade some issues to create 11G databases. So, when I try to create an 11G RAC database, the error \u201cFile -oracka.ko- was not […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[71,29,77,6,56,5],"tags":[72,100,117,69,81,65,118],"class_list":["post-640","post","type-post","status-publish","format-standard","hentry","category-19c","category-database","category-engineeredsystems","category-exadata","category-grid-infrastructure","category-oracle","tag-19c","tag-engineered-systems","tag-error","tag-exadata","tag-grid","tag-oracle","tag-workaround"],"yoast_head":"\nThe environment<\/h2>\n
\n
oracka.ko<\/h2>\n
[DEV-oracle@exsite1c1-]$ \/u01\/app\/oracle\/product\/11.2.0.4\/dbhome_1\/bin\/dbca -silent -createDatabase -templateName General_Purpose.dbc -gdbName D11TST19 -adminManaged -sid D11TST19 -sysPassword oracle11 -systemPassword oracle11 -characterSet WE8ISO8859P15 -emConfiguration NONE -storageType ASM -diskGroupName DATAC8 -recoveryGroupName RECOC8 -nodelist exsite1c1,exsite1c2 -sampleSchema false\r\nCopying database files\r\n100% complete\r\nLook at the log file \"\/u01\/app\/oracle\/cfgtoollogs\/dbca\/D11TST19\/D11TST19.log\" for further details.\r\n[DEV-oracle@exsite1c1-]$<\/pre>\n
[DEV-oracle@exsite1c1-]$ cat \/u01\/app\/oracle\/cfgtoollogs\/dbca\/D11TST19\/D11TST19.log\r\nCreating and starting Oracle instance\r\nPRCR-1006 : Failed to add resource ora.d11tst19.db for d11tst19\r\nPRCD-1094 : Failed to create start dependency for database d11tst19 on the ASM cluster filesystem where ACFS path \/u01\/app\/oracle\/product\/11.2.0.4\/dbhome_1 resides\r\nPRCT-1129 : Execution of ACFS driver state check failed on local node with result Errors uncompressing file: oracka.zip.\r\nFile -oracka.ko- was not found.\r\nError # 50 - . Output: .\r\nErrors uncompressing file: oracka.zip.\r\nFile -oracka.ko- was not found.\r\nError # 50 - . Output: .\r\nACFS-9200: Supported\r\nDBCA_PROGRESS : 100%\r\n[DEV-oracle@exsite1c1-]$<\/pre>\n
[DEV-oracle@exsite1c1-]$ vi \/u01\/app\/oracle\/cfgtoollogs\/dbca\/D11TST19\/trace.log\r\n[Thread-166] [ 2019-11-07 08:30:37.860 CET ] [ASMFactoryImpl.isACFSSupported:954] Entry: oraHome=\/u01\/app\/oracle\/product\/11.2.0.4\/dbhome_1, m_crsHome=\/u01\/app\/19.0.0.0\/grid\r\n[Thread-166] [ 2019-11-07 08:30:37.860 CET ] [ASMFactoryImpl.isACFSSupported:958] Checking if ACFS now...\r\n[Thread-166] [ 2019-11-07 08:30:37.861 CET ] [USMDriverUtil.<init>:117] Checking file exists for: \/u01\/app\/19.0.0.0\/grid\/bin\/acfsdriverstate\r\n[Thread-166] [ 2019-11-07 08:30:37.862 CET ] [NativeSystem.isCmdScv:502] isCmdScv: cmd=[]\r\n[Thread-182] [ 2019-11-07 08:30:37.866 CET ] [StreamReader.run:61] In StreamReader.run\r\n[Thread-181] [ 2019-11-07 08:30:37.868 CET ] [StreamReader.run:61] In StreamReader.run\r\n[Thread-182] [ 2019-11-07 08:30:38.230 CET ] [StreamReader.run:65] ERROR>Argument \"2\/8\" isn't numeric in numeric ne (!=) at \/u01\/app\/19.0.0.0\/grid\/lib\/osds_acfsroot.pm line 2093.\r\n[Thread-182] [ 2019-11-07 08:30:38.230 CET ] [StreamReader.run:65] ERROR>Argument \"2\/8\" isn't numeric in numeric ne (!=) at \/u01\/app\/19.0.0.0\/grid\/lib\/osds_acfsroot.pm line 2093.\r\n[Thread-182] [ 2019-11-07 08:30:38.235 CET ] [StreamReader.run:65] ERROR>error: cannot delete old \/u01\/app\/19.0.0.0\/grid\/usm\/install\/Oracle\/EL7UEK\/x86_64\/4.1.12-112.16.4\/4.1.12-112.16.4-x86_64\/bin\/oracka.ko\r\n[Thread-182] [ 2019-11-07 08:30:38.235 CET ] [StreamReader.run:65] ERROR> Permission denied\r\n[Thread-181] [ 2019-11-07 08:30:38.310 CET ] [StreamReader.run:65] OUTPUT>Errors uncompressing file: oracka.zip.\r\n[Thread-181] [ 2019-11-07 08:30:38.405 CET ] [StreamReader.run:65] OUTPUT>File -oracka.ko- was not found.\r\n[Thread-181] [ 2019-11-07 08:30:38.485 CET ] [StreamReader.run:65] OUTPUT>Error # 50 - . Output: .\r\n[Thread-182] [ 2019-11-07 08:30:38.504 CET ] [StreamReader.run:65] ERROR>error: cannot delete old \/u01\/app\/19.0.0.0\/grid\/usm\/install\/Oracle\/EL7UEK\/x86_64\/4.1.12-112.16.4\/4.1.12-112.16.4-x86_64\/bin\/oracka.ko\r\n[Thread-182] [ 2019-11-07 08:30:38.504 CET ] [StreamReader.run:65] ERROR> Permission denied\r\n[Thread-181] [ 2019-11-07 08:30:38.587 CET ] [StreamReader.run:65] OUTPUT>Errors uncompressing file: oracka.zip.\r\n[Thread-181] [ 2019-11-07 08:30:38.667 CET ] [StreamReader.run:65] OUTPUT>File -oracka.ko- was not found.\r\n[Thread-181] [ 2019-11-07 08:30:38.753 CET ] [StreamReader.run:65] OUTPUT>Error # 50 - . Output: .\r\n[Thread-181] [ 2019-11-07 08:30:40.877 CET ] [StreamReader.run:65] OUTPUT>ACFS-9200: Supported\r\n[Thread-166] [ 2019-11-07 08:30:40.881 CET ] [UnixSystem.dorunRemoteExecCmd:3232] retval = 0\r\n[Thread-166] [ 2019-11-07 08:30:40.881 CET ] [UnixSystem.dorunRemoteExecCmd:3256] exitValue = 0\r\n[Thread-166] [ 2019-11-07 08:30:40.882 CET ] [USMDriverUtil.checkACFSState:267] Printing ACFS output\r\n[Thread-166] [ 2019-11-07 08:30:40.882 CET ] [USMDriverUtil.checkACFSState:268] Errors uncompressing file: oracka.zip.\r\nFile -oracka.ko- was not found.\r\nError # 50 - . Output: .\r\nErrors uncompressing file: oracka.zip.\r\nFile -oracka.ko- was not found.\r\nError # 50 - . Output: .\r\nACFS-9200: Supported\r\n[Thread-166] [ 2019-11-07 08:30:40.882 CET ] [InstanceStepOPS.executeImpl:1014] PRCR-1006 : Failed to add resource ora.d11tst19.db for d11tst19\r\nPRCD-1094 : Failed to create start dependency for database d11tst19 on the ASM cluster filesystem where ACFS path \/u01\/app\/oracle\/product\/11.2.0.4\/dbhome_1 resides\r\nPRCT-1129 : Execution of ACFS driver state check failed on local node with result Errors uncompressing file: oracka.zip.\r\nFile -oracka.ko- was not found.\r\nError # 50 - . Output: .\r\nErrors uncompressing file: oracka.zip.\r\nFile -oracka.ko- was not found.\r\nError # 50 - . Output: .\r\nACFS-9200: Supported\r\n[Thread-166] [ 2019-11-07 08:30:40.883 CET ] [BasicStep.configureSettings:304] messageHandler being set=oracle.sysman.assistants.util.SilentMessageHandler@5a943dc4\r\n[Thread-166] [ 2019-11-07 08:30:40.883 CET ] [BasicStep.configureSettings:304] messageHandler being set=oracle.sysman.assistants.util.SilentMessageHandler@5a943dc4\r\noracle.sysman.assistants.util.step.StepExecutionException: PRCR-1006 : Failed to add resource ora.d11tst19.db for d11tst19\r\nPRCD-1094 : Failed to create start dependency for database d11tst19 on the ASM cluster filesystem where ACFS path \/u01\/app\/oracle\/product\/11.2.0.4\/dbhome_1 resides\r\nPRCT-1129 : Execution of ACFS driver state check failed on local node with result Errors uncompressing file: oracka.zip.\r\nFile -oracka.ko- was not found.\r\nError # 50 - . Output: .\r\nErrors uncompressing file: oracka.zip.\r\nFile -oracka.ko- was not found.\r\nError # 50 - . Output: .\r\nACFS-9200: Supported\r\n at oracle.sysman.assistants.dbca.backend.InstanceStepOPS.executeImpl(InstanceStepOPS.java:1015)\r\n at oracle.sysman.assistants.util.step.BasicStep.execute(BasicStep.java:210)\r\n at oracle.sysman.assistants.util.step.BasicStep.callStep(BasicStep.java:251)\r\n at oracle.sysman.assistants.dbca.backend.DBEntryStep.executeImpl(DBEntryStep.java:229)\r\n at oracle.sysman.assistants.util.step.BasicStep.execute(BasicStep.java:210)\r\n at oracle.sysman.assistants.util.step.Step.execute(Step.java:140)\r\n at oracle.sysman.assistants.util.step.StepContext$ModeRunner.run(StepContext.java:2711)\r\n at java.lang.Thread.run(Thread.java:637)\r\n[Thread-166] [ 2019-11-07 08:30:40.883 CET ] [SQLEngine.done:2189] Done called<\/pre>\n
Source of the problem<\/h2>\n
[root@exsite1c1 ~]# cd \/u01\/app\/19.0.0.0\/grid\/usm\/install\/Oracle\/EL7UEK\/x86_64\/4.1.12-112.16.4\/4.1.12-112.16.4-x86_64\/bin\/\r\n[root@exsite1c1 bin]#\r\n[root@exsite1c1 bin]# ls -l\r\ntotal 151244\r\n-rw-r--r-- 1 root oinstall 3085340 Sep 1 12:40 oracka.ko\r\n-rw-r--r-- 1 root oinstall 2304100 Sep 1 12:44 oracka_mod_kga.ko\r\n-rw-r--r-- 1 grid oinstall 623207 Oct 9 17:13 oracka_mod_kga.zip\r\n-rw-r--r-- 1 grid oinstall 889060 Oct 9 17:14 oracka.zip\r\n-rw-r--r-- 1 root oinstall 64000932 Sep 1 12:04 oracleacfs.ko\r\n-rw-r--r-- 1 grid oinstall 19246647 Oct 9 17:13 oracleacfs.zip\r\n-rw-r--r-- 1 root oinstall 27882452 Sep 1 11:25 oracleadvm.ko\r\n-rw-r--r-- 1 grid oinstall 8777000 Oct 9 17:13 oracleadvm.zip\r\n-rw-r--r-- 1 root oinstall 8776676 Sep 1 12:55 oracleafd.ko\r\n-rw-r--r-- 1 grid oinstall 2879744 Oct 9 17:14 oracleafd.zip\r\n-rw-r--r-- 1 root oinstall 10696156 Sep 1 11:04 oracleoks.ko\r\n-rw-r--r-- 1 grid oinstall 3346594 Oct 9 17:14 oracleoks.zip\r\n-rw-r--r-- 1 root oinstall 1757116 Sep 1 13:02 oracleolfs.ko\r\n-rw-r--r-- 1 grid oinstall 567865 Oct 9 17:14 oracleolfs.zip\r\n[root@exsite1c1 bin]#<\/pre>\n
[root@exsite1c1 4.1.12-112.16.4-x86_64]# pwd\r\n\/u01\/app\/19.0.0.0\/grid\/usm\/install\/Oracle\/EL7UEK\/x86_64\/4.1.12-112.16.4\/4.1.12-112.16.4-x86_64\r\n[root@exsite1c1 4.1.12-112.16.4-x86_64]#\r\n[root@exsite1c1 4.1.12-112.16.4-x86_64]#\r\n[root@exsite1c1 4.1.12-112.16.4-x86_64]# chmod g+w bin\r\n[root@exsite1c1 4.1.12-112.16.4-x86_64]#\r\n[root@exsite1c1 4.1.12-112.16.4-x86_64]#\r\n[root@exsite1c1 4.1.12-112.16.4-x86_64]# ls -l\r\ntotal 4\r\ndrwxrwxr-x 2 grid oinstall 4096 Nov 8 15:08 bin\r\n[root@exsite1c1 4.1.12-112.16.4-x86_64]# cd bin\r\n[root@exsite1c1 bin]# chown grid:oinstall oracka.ko oracka_mod_kga.ko oracleacfs.ko oracleadvm.ko oracleafd.ko oracleoks.ko oracleolfs.ko\r\n[root@exsite1c1 bin]#<\/pre>\n
[DEV-oracle@exsite1c1-]$ \/u01\/app\/oracle\/product\/11.2.0.4\/dbhome_1\/bin\/dbca -silent -createDatabase -templateName General_Purpose.dbc -gdbName D11TST19 -adminManaged -sid D11TST19 -sysPassword oracle11 -systemPassword orcle11 -characterSet WE8ISO8859P15 -emConfiguration NONE -storageType ASM -diskGroupName DATAC8 -recoveryGroupName RECOC8 -nodelist exsite1c1,exsite1c2 -sampleSchema false\r\nCreating and starting Oracle instance\r\n1% complete\r\n\u2026\r\n96% complete\r\n100% complete\r\nLook at the log file \"\/u01\/app\/oracle\/cfgtoollogs\/dbca\/D11TST19\/D11TST19.log\" for further details.\r\n[DEV-oracle@exsite1c1-]$\r\n[DEV-oracle@exsite1c1-]$ $ORACLE_HOME\/bin\/srvctl status database -d D11TST19\r\nInstance D11TST191 is running on node exsite1c1\r\nInstance D11TST192 is running on node exsite1c2\r\n[DEV-oracle@exsite1c1-]$<\/pre>\n
[grid@exsite1c1 +ASM1]$ cd \/u01\/patches\/grid\r\n[grid@exsite1c1 +ASM1]$ unzip -q V982068-01.zip\r\n[grid@exsite1c1 +ASM1]$ cd usm\/install\/Oracle\/EL7UEK\/x86_64\/4.1.12-112.16.4\/4.1.12-112.16.4-x86_64\/bin\r\n[grid@exsite1c1 +ASM1]$ ls -l\r\ntotal 149116\r\n-rw-r--r-- 1 grid oinstall 3085340 Feb 23 2019 oracka.ko\r\n-rw-r--r-- 1 grid oinstall 2304100 Feb 23 2019 oracka_mod_kga.ko\r\n-rw-r--r-- 1 grid oinstall 623214 Feb 23 2019 oracka_mod_kga.zip\r\n-rw-r--r-- 1 grid oinstall 889106 Feb 23 2019 oracka.zip\r\n-rw-r--r-- 1 grid oinstall 62740980 Feb 23 2019 oracleacfs.ko\r\n-rw-r--r-- 1 grid oinstall 18881690 Feb 23 2019 oracleacfs.zip\r\n-rw-r--r-- 1 grid oinstall 27485580 Feb 23 2019 oracleadvm.ko\r\n-rw-r--r-- 1 grid oinstall 8643808 Feb 23 2019 oracleadvm.zip\r\n-rw-r--r-- 1 grid oinstall 8773444 Feb 23 2019 oracleafd.ko\r\n-rw-r--r-- 1 grid oinstall 2878816 Feb 23 2019 oracleafd.zip\r\n-rw-r--r-- 1 grid oinstall 10655524 Feb 23 2019 oracleoks.ko\r\n-rw-r--r-- 1 grid oinstall 3335912 Feb 23 2019 oracleoks.zip\r\n-rw-r--r-- 1 grid oinstall 1757348 Feb 23 2019 oracleolfs.ko\r\n-rw-r--r-- 1 grid oinstall 567876 Feb 23 2019 oracleolfs.zip\r\n[grid@exsite1c1 +ASM1]$ cd ..\r\n[grid@exsite1c1 +ASM1]$ ls -l\r\ntotal 4\r\ndrwxr-xr-x 2 grid oinstall 4096 Apr 18 2019 bin\r\n[grid@exsite1c1 +ASM1]$<\/pre>\n
The sum of all problems<\/h2>\n