centOS死机
机器死机了。死机前log如下：
Sep 12 22:01:36 web01 kernel: Call Trace:
Sep 12 22:01:49 web01 kernel: [<ffffffff80012f1e>] __do_page_cache_readahead+0x82/0x179
Sep 12 22:01:55 web01 kernel: [<ffffffff80063c4f>] __mutex_lock_slowpath+0x60/0x9b
Sep 12 22:02:06 web01 kernel: [<ffffffff80063c99>] .text.lock.mutex+0xf/0x14
Sep 12 22:02:12 web01 kernel: [<ffffffff8000cfb3>] do_lookup+0x90/0x1e6
Sep 12 22:02:16 web01 kernel: [<ffffffff8000a2c5>] __link_path_walk+0xa2a/0xfb9
Sep 12 22:02:24 web01 kernel: [<ffffffff8000ea74>] link_path_walk+0x42/0xb2
Sep 12 22:02:28 web01 kernel: [<ffffffff8000cda3>] do_path_lookup+0x275/0x2f1
Sep 12 22:02:29 web01 kernel: [<ffffffff80012898>] getname+0x15b/0x1c2
Sep 12 22:02:36 web01 kernel: [<ffffffff800239b0>] __user_walk_fd+0x37/0x4c
Sep 12 22:02:43 web01 kernel: [<ffffffff8003f346>] vfs_lstat_fd+0x18/0x47
Sep 12 22:02:54 web01 kernel: [<ffffffff8002ab57>] sys_newlstat+0x19/0x31
Sep 12 22:03:02 web01 kernel: [<ffffffff8001e0cd>] sys_close+0x88/0xbd
Sep 12 22:03:03 web01 kernel: [<ffffffff8005d116>] system_call+0x7e/0x83
Sep 12 22:03:04 web01 kernel:
Sep 12 22:03:05 web01 kernel: INFO: task httpd:8875 blocked for more than 120 seconds.
Sep 12 22:03:11 web01 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 12 22:03:16 web01 kernel: httpd D ffffffff80153806 0 8875 9073 8876 8874 (NOTLB)
Sep 12 22:03:23 web01 kernel: ffff810136aedc78 0000000000000086 0000000000000296 ffffffff80012f1e
Sep 12 22:03:30 web01 kernel: 0000000000000003 0000000000000009 ffff8100550fa7a0 ffff810108da8080
Sep 12 22:03:38 web01 kernel: 0004fb8fbed9157c 000000000080cd13 ffff8100550fa988 0000000435d35c4f
Sep 12 22:03:40 web01 kernel: Call Trace:
Sep 12 22:03:45 web01 kernel: [<ffffffff80012f1e>] __do_page_cache_readahead+0x82/0x179
Sep 12 22:03:50 web01 kernel: [<ffffffff80063c4f>] __mutex_lock_slowpath+0x60/0x9b
Sep 12 22:03:56 web01 kernel: [<ffffffff80063c99>] .text.lock.mutex+0xf/0x14
Sep 12 22:04:05 web01 kernel: [<ffffffff8000cfb3>] do_lookup+0x90/0x1e6
Sep 12 22:04:15 web01 kernel: [<ffffffff8000a2c5>] __link_path_walk+0xa2a/0xfb9
Sep 12 22:04:25 web01 kernel: [<ffffffff8000ea74>] link_path_walk+0x42/0xb2
Sep 12 22:04:36 web01 kernel: [<ffffffff8000cda3>] do_path_lookup+0x275/0x2f1
Sep 12 22:04:55 web01 kernel: [<ffffffff80012898>] getname+0x15b/0x1c2
Sep 12 22:06:31 web01 kernel: [<ffffffff800239b0>] __user_walk_fd+0x37/0x4c
Sep 12 22:06:49 web01 kernel: [<ffffffff8003f346>] vfs_lstat_fd+0x18/0x47
Sep 12 22:08:32 web01 kernel: [<ffffffff8002ab57>] sys_newlstat+0x19/0x31
Sep 12 22:09:16 web01 kernel: [<ffffffff8001e0cd>] sys_close+0x88/0xbd
Sep 12 22:10:44 web01 kernel: [<ffffffff8005d116>] system_call+0x7e/0x83
Sep 12 22:12:25 web01 kernel:
Sep 13 10:51:22 web01 syslogd 1.4.1: restart.
[解决办法]
Sep 12 22:03:05 web01 kernel: INFO: task httpd:8875 blocked for more than 120 seconds.
Sep 12 22:03:11 web01 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 12 22:03:16 web01 kernel: httpd D ffffffff80153806 0 8875 9073 8876 8874 (NOTLB)
Sep 12 22:03:23 web01 kernel: ffff810136aedc78 0000000000000086 0000000000000296 ffffffff80012f1e
Sep 12 22:03:30 web01 kernel: 0000000000000003 0000000000000009 ffff8100550fa7a0 ffff810108da8080
Sep 12 22:03:38 web01 kernel: 0004fb8fbed9157c 000000000080cd13 ffff8100550fa988 0000000435d35c4f
这里告诉了内核崩溃的原因。
Sep 12 22:03:40 web01 kernel: Call Trace:
Sep 12 22:03:45 web01 kernel: [<ffffffff80012f1e>] __do_page_cache_readahead+0x82/0x179
Sep 12 22:03:50 web01 kernel: [<ffffffff80063c4f>] __mutex_lock_slowpath+0x60/0x9b
Sep 12 22:03:56 web01 kernel: [<ffffffff80063c99>] .text.lock.mutex+0xf/0x14
Sep 12 22:04:05 web01 kernel: [<ffffffff8000cfb3>] do_lookup+0x90/0x1e6
Sep 12 22:04:15 web01 kernel: [<ffffffff8000a2c5>] __link_path_walk+0xa2a/0xfb9
Sep 12 22:04:25 web01 kernel: [<ffffffff8000ea74>] link_path_walk+0x42/0xb2
Sep 12 22:04:36 web01 kernel: [<ffffffff8000cda3>] do_path_lookup+0x275/0x2f1
Sep 12 22:04:55 web01 kernel: [<ffffffff80012898>] getname+0x15b/0x1c2
Sep 12 22:06:31 web01 kernel: [<ffffffff800239b0>] __user_walk_fd+0x37/0x4c
Sep 12 22:06:49 web01 kernel: [<ffffffff8003f346>] vfs_lstat_fd+0x18/0x47
Sep 12 22:08:32 web01 kernel: [<ffffffff8002ab57>] sys_newlstat+0x19/0x31
Sep 12 22:09:16 web01 kernel: [<ffffffff8001e0cd>] sys_close+0x88/0xbd
Sep 12 22:10:44 web01 kernel: [<ffffffff8005d116>] system_call+0x7e/0x83
这个函数调用栈告诉了内核崩溃的时候执行了哪些函数（从下网上看），按照这个函数调用关系应该可以看出什么端倪的！
[解决办法]
看不出来
