ohasd failed to start: Inappropriate ioctl for device

Questions relating to Oracle Real Application Clusters (RAC) and Clusterware.

Moderator: Tim...

ohasd failed to start: Inappropriate ioctl for device

Postby kamblim » Wed Jan 15, 2014 1:18 pm

Hi Tim,

I am using your notes , 11gR2 11.2.0.3 RAC On Oracle Linux 6.3 using VirtualBox, to try and test the creation of a two node RAC.

When running the root.sh script at the Grid Infra install stage it hits the following error:

Adding daemon to inittab
CRS-4124: Oracle High Availability Services startup failed.
CRS-4000: Command Start failed, or completed with errors.
ohasd failed to start: Inappropriate ioctl for device
ohasd failed to start at /u01/app/11.2.0.3/grid/crs/install/rootcrs.pl line 443.

Any ideas on what is causing this?

My host is Windows 7 Home Premium, and I am using VirtualBox 4.8.

The pre crs install runcluvfy check does report the following as missing, but I chose to ignore these (after having checked the Grid Infra Install Guide for Linux - i.e packages listed for x86_64) :

Result: Package existence check failed for "libaio-0.3.105 (i386)"
Result: Package existence check failed for "compat-libstdc++-33-3.2.3 (i386)"
Result: Package existence check failed for "libgcc-3.4.6 (i386)"
Result: Package existence check failed for "libstdc++-3.4.6 (i386)"
Result: Package existence check failed for "unixODBC-2.2.11 (i386)"
Result: Package existence check failed for "unixODBC-devel-2.2.11 (i386)"
Result: Package existence check failed for "pdksh-5.2.14"

My Oracle Support note 1053970.1 suggests checking the crs install log for the node, which shows this:

2014-01-15 11:24:25: Removing "/etc/rc.d/rc6.d/K19ohasd"
2014-01-15 11:24:25: Removing file /etc/rc.d/rc6.d/K19ohasd
2014-01-15 11:24:25: Failure with return code 1 from command rm /etc/rc.d/rc6.d/K19ohasd
2014-01-15 11:24:25: Failed to remove file:
2014-01-15 11:24:25: Creating a link "/etc/rc.d/rc6.d/K19ohasd" pointing to /etc/init.d/ohasd
2014-01-15 11:24:25: The file ohasd has been successfully linked to the RC directories
2014-01-15 11:24:25: Starting ohasd
2014-01-15 11:24:25: itab entries=
2014-01-15 11:24:30: Created backup /etc/inittab.no_crs
2014-01-15 11:24:30: Appending to /etc/inittab.tmp:
2014-01-15 11:24:30: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null

2014-01-15 11:24:30: Done updating /etc/inittab.tmp
2014-01-15 11:24:30: Saved /etc/inittab.crs
2014-01-15 11:24:30: Installed new /etc/inittab
2014-01-15 11:26:30: ohasd failed to start: Inappropriate ioctl for device
2014-01-15 11:26:30: ###### Begin DIE Stack Trace ######
2014-01-15 11:26:30: Package File Line Calling
2014-01-15 11:26:30: --------------- -------------------- ---- ----------
2014-01-15 11:26:30: 1: main rootcrs.pl 300 crsconfig_lib::dietrap
2014-01-15 11:26:30: 2: main rootcrs.pl 443 main::__ANON__
2014-01-15 11:26:30: ####### End DIE Stack Trace #######

I have repeated the install steps twice, and hit the same error on each occassion and am getting frustrated now.
So any help would be welcome. I did make use of the 11gR2 preinstall package.

regards,
Mohan
kamblim
Member
 
Posts: 4
Joined: Wed Jan 15, 2014 12:49 pm

Re: ohasd failed to start: Inappropriate ioctl for device

Postby Tim... » Wed Jan 15, 2014 4:20 pm

Hi.

How did you do the OS prerequisites? Did you do them with the preinstall package?

Code: Select all
yum install oracle-rdbms-server-11gR2-preinstall


There should be no missing prerequisites when you install.

You need sort this out and redo your installation.

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog
Tim...
Site Admin
 
Posts: 17933
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK

Re: ohasd failed to start: Inappropriate ioctl for device

Postby kamblim » Wed Jan 15, 2014 4:55 pm

Hi Tim,

Yes I used exactly the same yum install you stated in your reply.
Anyway, I am just about to try something and if that doesn't work I'll go back to square one.

Thank you for such a prompt response.

regards,
Mohan
kamblim
Member
 
Posts: 4
Joined: Wed Jan 15, 2014 12:49 pm

Re: ohasd failed to start: Inappropriate ioctl for device

Postby Tim... » Wed Jan 15, 2014 7:20 pm

Hi.

That is very strange. The that installation should contain all software dependencies...

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog
Tim...
Site Admin
 
Posts: 17933
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK

Re: ohasd failed to start: Inappropriate ioctl for device

Postby kamblim » Wed Jan 15, 2014 10:14 pm

Hi Tim,

Thank you for responding.
I retried from scratch, and have managed to get beyond the inappropriate ioctl error.

runcluvfy now reports just the following error at the pre crsinst stage:

Check default user file creation mask
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
ol6-112-rac2 0022 0022 passed
ol6-112-rac1 0022 0022 passed
Result: Default user file creation mask check passed
Checking consistency of file "/etc/resolv.conf" across nodes

Checking the file "/etc/resolv.conf" to make sure only one of domain and search entries is defined
File "/etc/resolv.conf" does not have both domain and search entries defined
Checking if domain entry in file "/etc/resolv.conf" is consistent across the nodes...
domain entry in file "/etc/resolv.conf" is consistent across nodes
Checking if search entry in file "/etc/resolv.conf" is consistent across the nodes...
search entry in file "/etc/resolv.conf" is consistent across nodes
Checking file "/etc/resolv.conf" to make sure that only one search entry is defined
All nodes have one search entry defined in file "/etc/resolv.conf"
Checking all nodes to make sure that search entry is "localdomain" as found on node "ol6-112-rac2"
All nodes of the cluster have same value for 'search'
Checking DNS response time for an unreachable node
Node Name Status
------------------------------------ ------------------------
ol6-112-rac2 failed
ol6-112-rac1 failed
PRVF-5637 : DNS response time could not be checked on following nodes: ol6-112-rac2,ol6-112-rac1
File "/etc/resolv.conf" is not consistent across nodes

Check: Time zone consistency
Result: Time zone consistency check passed

So I thought I would follow your steps to create a separate VM Linux guest that would act as a DNS server for my home network.
I am sure I have missed something somewhere, but this is what nslookup reports (similar error on both nodes):

[root@ol6-112-rac2 ~]# nslookup ol6-112-rac2
Server: 192.168.0.131
Address: 192.168.0.131#53

** server can't find ol6-112-rac2: REFUSED

[root@ol6-112-rac2 ~]# nslookup ol6-112-rac1
Server: 192.168.0.131
Address: 192.168.0.131#53

** server can't find ol6-112-rac1: REFUSED

[root@ol6-112-rac2 ~]# nslookup ol6-112-rac1.localdomain
Server: 192.168.0.131
Address: 192.168.0.131#53

** server can't find ol6-112-rac1.localdomain.localdomain: REFUSED

[root@ol6-112-rac2 ~]# nslookup 192.168.0.125
Server: 192.168.0.131
Address: 192.168.0.131#53

** server can't find 125.0.168.192.in-addr.arpa: REFUSED

resolv.conf on all nodes (the two RAC, and the DNS one) have this:

# Generated by NetworkManager
search localdomain
nameserver 192.168.0.131

I will continue tomorrow, but any thoughts appreciated.

regards,
Mohan
kamblim
Member
 
Posts: 4
Joined: Wed Jan 15, 2014 12:49 pm

Re: ohasd failed to start: Inappropriate ioctl for device

Postby Tim... » Wed Jan 15, 2014 11:39 pm

Hi.

Not much I can say really. Either the the networking is screwed, so you can't contact the DNS, or the DNS is not working. Can't be much else. You've handled the firewall on the DNS to handle the requests coming in right?

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog
Tim...
Site Admin
 
Posts: 17933
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK

Re: ohasd failed to start: Inappropriate ioctl for device

Postby kamblim » Thu Jan 16, 2014 3:53 pm

Hi Tim,

This issue seems to be a bug on OEL6 - see MoS "PRVF-5637 : DNS response time could not be checked on following nodes (Doc ID 1480242.1)".

The suggested workaround is to do the checks manually, which I have done.

Just for the record, the original error I was getting ohasd failed to start : I am pretty confident this was of my own making, in that I was NOT installing the 11.2.0.3 Grid Infr software but an earlier version. After downloading the correct one, it went beyond this point.

As for my DNS guest machine, to get nlslookup to work, what I had to also do was the following:
1. On my DNS server,
a) I had to change my named.conf file to say allow-query {any} instead of allow-query {localhost}.
b) Amend ifcfg-eth0 to change the line DNS1=127.0.0.1 (previously this had the IP of the virtual guest itself).
2. I turned the NetworkManager service off on both my RAC nodes, and my Linux DNS guest. It seemed to be replacing my resolv.conf file after each reboot.
3. Pinging a domain from each RAC node was not working, and so I had to enable forwading as you had done in your named.conf.

Thanks for taking the time to share your experiences with the rest of us.
It has been very useful. I have learnt a fair amount over the past couple of days.

regards,
Mohan
kamblim
Member
 
Posts: 4
Joined: Wed Jan 15, 2014 12:49 pm

Re: ohasd failed to start: Inappropriate ioctl for device

Postby Tim... » Thu Jan 16, 2014 5:12 pm

:)
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog
Tim...
Site Admin
 
Posts: 17933
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK


Return to Oracle RAC and Clusterware

Who is online

Users browsing this forum: No registered users and 2 guests