[LRUG] Finding out why server was unresponsive

[Richard Taylor]

Another sneaky one is running out of inodes.  I've had this a couple of times when I haven't been cleaning up rails releases often enough.  It behaves the same way as running out of disk space but your disk space indicator shows there's nothing wrong. 

df -ih is your friend here:

~$ df -ih
Filesystem     Inodes IUsed IFree IUse% Mounted on
/dev/xvda        5.8M  102K  5.7M    2% /


-- 
Richard Taylor


On Tuesday, 16 April 2013 at 10:42, Andrew Stewart wrote:

> Good morning El Rug,
> 
> Yesterday afternoon one of my servers stopped responding to HTTP and SSH. I eventually got it back by executing a hardware reset via the host's (Hetzner) web GUI. I have no idea what the problem was.
> 
> The server runs Ubuntu 12.04 LTS. It's been in production for a couple of months and hadn't had any downtime before yesterday.
> 
> All the following logs were silent during the outage:
> 
> - unicorn.std{out,err}.log
> - production.log
> - /var/log/kern.log
> - /var/log/syslog
> - /var/log/auth.log
> - /var/log/nginx/{access,error}.log
> 
> I was running an mtr traceroute the whole time which showed packets making it into the host's network but failing to reach my server.
> 
> New Relic shows nothing abnormal. Memory use and CPU load were low as usual.
> 
> I would dearly like to establish what happened so I can (try to) prevent it happening again...but I'm stumped.
> 
> Any ideas?
> 
> Many thanks in advance,
> 
> Andy Stewart
> -------
> http://airbladesoftware.com
> 
> _______________________________________________
> Chat mailing list
> Chat at lists.lrug.org (mailto:Chat at lists.lrug.org)
> http://lists.lrug.org/listinfo.cgi/chat-lrug.org
> 
> 


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lrug.org/pipermail/chat-lrug.org/attachments/20130416/366a2aec/attachment-0003.html>