1453517697 J * derjohn_mobi ~aj@x590df9ea.dyn.telefonica.de
1453518136 Q * derjohn_mob Ping timeout: 480 seconds
1453521156 N * Bertl_zZ Bertl
1453527808 Q * FireEgl Ping timeout: 480 seconds
1453531045 M * gnarface well, so far so good
1453531050 M * gnarface no crashes on the new kernel
1453531059 M * gnarface or deadlocking 
1453531064 M * gnarface so far
1453531449 M * Bertl great!
1453542408 Q * derjohn_mobi Ping timeout: 480 seconds
1453547008 J * derjohn_mob ~aj@x4db1df0e.dyn.telefonica.de
1453552235 M * Bertl off for now ... bbl
1453552241 N * Bertl Bertl_oO
1453554301 Q * padde Remote host closed the connection
1453554581 M * gnarface well, i spoke too soon
1453554587 M * gnarface  its tapped out again now
1453554593 M * gnarface probably died about 5-10 minutes ago
1453554736 J * padde ~padde@patrick-nagel.net
1453554829 M * gnarface  how exactly should i go about getting a stack trace now?
1453554848 M * gnarface to try to figure out what's deadlocking it?
1453554868 M * gnarface magic sysrq doesn't even work, and the local display is just black
1453555148 M * daniel_hozac_ magic sysrq is what you want.
1453555155 M * daniel_hozac_ is it enabled?
1453555243 M * gnarface its certainly enabled....
1453555339 M * gnarface yes, i double checked, its definitely enabled
1453555352 M * gnarface whatever is happening locks it up too hard for even that to help
1453555365 M * gnarface the timing suggests a software change
1453555381 M * gnarface it was fine for months before this
1453555386 M * gnarface now it lasts 1-2 days 
1453556017 M * gnarface i also compiled without kvm support this time
1453556172 M * gnarface it seems like it must be something i changed, but its hard for me to imagine stuff like adding some more maps to the map rotation on the ioquake3 server running in one of the guests could be deadlocking the host
1453556196 M * gnarface and so very little other than that changed besides installing munin, awstats, and the regular debian security updates
1453556232 M * gnarface so i'm wondering if its that load-related kernel bug
1453556252 M * gnarface where it randomly just chokes when the system has high load with some disk i/o?
1453556265 M * gnarface i guess i assumed that'd be patched in 3.14.58 though
1453556279 M * gnarface but in theory it also could be the very old problem
1453556303 M * gnarface its highly unlikely, but it did deadlock once like this, months and months ago, and i never found the cause
1453556306 M * gnarface but it was fine after that
1453556317 M * gnarface so likewise i assumed some software update dodged whatever glitch it was
1453556361 M * gnarface but it could be just coincidence that it had almost 400 days of uptime then its crashed ... 4 times now in the last week
1453556392 M * gnarface insane but theoretically possible
1453556462 M * gnarface might it have left some evidence in one of the logs? the thing is i don't see anything out of the ordinary.... but i'm not sure i'd know unless the word "error" appears literally 
1453556500 P * undefined 
1453556709 M * gnarface temperatures look normal...
1453558179 J * undefined ~undefined@00011a48.user.oftc.net
1453559041 J * FireEgl ~FireEgl@173-23-76-11.client.mchsi.com
1453560953 M * gnarface hmmm.... actually hard to see any signs of significant load anywhere, right before the most recent deadlock... now that i'm looking at the graphs
1453562257 Q * karasz Server closed connection
1453562261 J * karasz ~karasz@00015555.user.oftc.net
1453564213 J * opuk_ ~kupo@37.123.166.211
1453564321 Q * opuk Ping timeout: 480 seconds
1453565871 J * Ghislain ~aqueos@adsl1.aqueos.com
1453566621 Q * Ghislain Ping timeout: 480 seconds
1453567334 J * nikolayK ~nkichukov@52D9864D.cm-11-1c.dynamic.ziggo.nl
1453567493 Q * Romster Server closed connection
1453567517 J * Romster ~Romster@202.168.100.149.dynamic.rev.eftel.com
1453571910 Q * sannes Remote host closed the connection
1453571953 J * sannes ~ace@2a02:fe0:c131:9070:fdf7:ed83:8e39:74f9
1453575110 Q * FireEgl Read error: Connection reset by peer
1453576092 J * FireEgl ~FireEgl@173-23-76-11.client.mchsi.com
1453583960 M * Bertl_oO off to bed now ... have a good one everyone!
1453583968 N * Bertl_oO Bertl_zZ
1453588995 Q * nikolayK Quit: This computer has gone to sleep
1453590019 Q * zerick Remote host closed the connection
1453590629 J * zerick ~zerick@irc.quassel.zerick.me
1453590753 Q * zerick Read error: Connection reset by peer
1453591309 J * zerick ~zerick@188.166.156.218
1453591778 Q * zerick Remote host closed the connection
1453591905 J * zerick ~zerick@188.166.156.218