1382919668 M * undefined Bertl_zZ: compiled the kernel without LSMs and with the VXC_SECURE_MOUNT patch you provided, but still get EPERM when trying to mount /proc from within a guest
1382921023 Q * treaki Ping timeout: 480 seconds
1382921082 J * treaki 75f537ff74@p4FF4BFA4.dip0.t-ipconnect.de
1382923647 N * undefined undefined_
1382923688 N * undefined_ undefined
1382927635 M * undefined Bertl_zZ: let me rephrase that: but still get EPERM when trying to mount the proc fs (to somewhere other than /proc) from within a guest
1382947924 J * JonB ~NoSuchUse@77.75.164.169
1382948938 J * Ghislain ~aqueos@adsl1.aqueos.com
1382950802 Q * fisted Remote host closed the connection
1382950823 J * fisted ~fisted@xdsl-87-78-181-24.netcologne.de
1382954520 Q * JonB Quit: This computer has gone to sleep
1382957265 M * arekm 3.12rc7, so expect final in next week
1382957387 J * JonB ~NoSuchUse@212-60-115-150.ip.cust.zensystems.net
1382957901 J * JonBen ~NoSuchUse@212-60-115-150.ip.cust.zensystems.net
1382957902 Q * JonB Read error: Connection reset by peer
1382957959 Q * ircuser-1 Ping timeout: 480 seconds
1382958475 J * BenG_ ~bengreen@cpc35-aztw23-2-0-cust207.18-1.cable.virginm.net
1382960248 N * Bertl_zZ Bertl
1382960255 M * Bertl morning folks!
1382960433 M * JonBen hi bertl
1382960442 M * undefined Bertl: morn
1382960468 M * Bertl undefined: hey, got some time for some testing today?
1382960513 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382960525 M * undefined Bertl: yes, sir
1382960557 M * Bertl great, give me a few minutes for breakfast and then I'll prepare another patch
1382960565 Q * ircuser-1 Max SendQ exceeded
1382960588 M * undefined Bertl: "today" being the next few hours (morn) and again in 12 hours (night)
1382960596 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382960618 M * Bertl okay, no problem
1382960666 M * undefined Bertl: but no rush
1382961359 Q * ircuser-1 Max SendQ exceeded
1382961381 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382962059 Q * Guy- Ping timeout: 480 seconds
1382963585 J * Guy- ~korn@elan.rulez.org
1382964062 Q * Guy- Remote host closed the connection
1382964659 Q * Aiken Remote host closed the connection
1382965041 Q * BenG_ Quit: I Leave
1382965059 J * Guy- ~korn@elan.rulez.org
1382965798 Q * Guy- Remote host closed the connection
1382966207 J * Guy- ~korn@elan.rulez.org
1382966914 Q * Guy- Remote host closed the connection
1382967501 J * l0kit ~1oxT@0001b54e.user.oftc.net
1382968357 Q * ircuser-1 Read error: Connection timed out
1382968405 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382968452 Q * ircuser-1 Max SendQ exceeded
1382968496 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382968813 J * Guy- ~korn@elan.rulez.org
1382971917 Q * ircuser-1 Quit: ircuser-1
1382972296 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382972326 Q * ircuser-1 Max SendQ exceeded
1382972350 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382972389 Q * ircuser-1 Max SendQ exceeded
1382972417 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382972464 Q * ircuser-1 Max SendQ exceeded
1382972490 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382972525 Q * ircuser-1 Max SendQ exceeded
1382972551 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382974936 Q * ircuser-1 Read error: Operation timed out
1382974960 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382974981 Q * ircuser-1 Max SendQ exceeded
1382975008 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382975249 Q * ircuser-1 Max SendQ exceeded
1382975281 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382975672 Q * nou Ping timeout: 480 seconds
1382975759 J * nou Chaton@causse.larzac.fr.eu.org
1382976227 Q * ircuser-1 Read error: Connection timed out
1382976251 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382977190 Q * ircuser-1 Read error: Connection timed out
1382977344 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382978323 Q * ircuser-1 Read error: Connection timed out
1382978376 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382979430 Q * ircuser-1 Read error: Connection timed out
1382979468 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382979840 Q * ircuser-1 Read error: Operation timed out
1382979864 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382980255 Q * ircuser-1 Read error: Operation timed out
1382980337 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382981378 Q * ircuser-1 Read error: Connection timed out
1382981420 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382982111 J * bonbons ~bonbons@ppp-105-211.adsl.restena.lu
1382982382 Q * ircuser-1 Read error: Connection timed out
1382982408 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382982762 Q * ircuser-1 Read error: Operation timed out
1382982787 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382983316 J * ntrs ~ntrs@vault08.rosehosting.com
1382983739 Q * ircuser-1 Read error: Connection timed out
1382983807 J * Aiken ~Aiken@2001:44b8:2168:1000:21f:d0ff:fed6:d63f
1382983984 Q * ntrs Ping timeout: 480 seconds
1382984692 Q * JonBen Quit: This computer has gone to sleep
1382986296 J * JonB ~NoSuchUse@77.75.164.169
1382986379 J * SteeleNivenson ~SteeleNiv@cpe-172-248-116-133.socal.res.rr.com
1382991480 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382991514 Q * ircuser-1 Max SendQ exceeded
1382991537 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382991662 Q * ircuser-1 Max SendQ exceeded
1382991686 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382991724 Q * ircuser-1 Max SendQ exceeded
1382991773 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382991812 Q * ircuser-1 Max SendQ exceeded
1382991838 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382991875 Q * ircuser-1 Max SendQ exceeded
1382991900 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382991938 Q * ircuser-1 Max SendQ exceeded
1382991962 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382991998 Q * ircuser-1 Max SendQ exceeded
1382992022 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382992054 Q * ircuser-1 Max SendQ exceeded
1382992078 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382992111 Q * ircuser-1 Max SendQ exceeded
1382992135 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382992168 Q * ircuser-1 Max SendQ exceeded
1382992191 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382992224 Q * ircuser-1 Max SendQ exceeded
1382992247 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382992311 Q * ircuser-1 Max SendQ exceeded
1382992333 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382992365 Q * ircuser-1 Max SendQ exceeded
1382992388 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382992451 Q * ircuser-1 Max SendQ exceeded
1382992473 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382992664 Q * ircuser-1 Max SendQ exceeded
1382992691 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382993938 Q * ircuser-1 Read error: Connection timed out
1382993965 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382994001 Q * fisted Remote host closed the connection
1382994027 J * fisted ~fisted@xdsl-84-44-239-3.netcologne.de
1382994995 Q * ircuser-1 Read error: Connection timed out
1382995028 J * ircuser-1 ~ircuser-1@35.222-62-69.ftth.swbr.surewest.net
1382995558 J * kiorky ~kiorky@cryptelium.net
1382995587 M * kiorky hi guys http://www.hostingpics.net/viewer.php?id=77571585a.png
1382995596 M * kiorky on this pic, you caj see a trace
1382995605 M * kiorky of a recent upgrae to a 3.10 kernel
1382995623 M * kiorky (where my goal is also to have cgroups and aufs enabled)
1382995665 M * kiorky this stack trace arrises when a start a vserver which in turn start a postgresl daemon ... due to the kernel panic
1382995674 M * kiorky i dont really know how to debug it
1382995724 M * kiorky the config of this kernel is here: https://github.com/kiorky/kernels/blob/master/linux/vserver
1382995796 Q * bonbons Quit: Leaving
1382995799 M * kiorky and the gentoo package related to it is here: https://github.com/kiorky/cryptelium-overlay/tree/master/sys-kernel/vserver-aufs-sources
1382995821 M * kiorky if anyone has a clue ...
1382995857 M * Bertl well, that stack trace doesn't contain many clues
1382995884 M * kiorky if my fingers can get you more, i can do whatever you want !=
1382995892 M * Bertl first, what kernel/patch/util-vserver is that?
1382995937 M * kiorky Bertl: 3.10.17 kernel, vserver 3.6.6
1382995948 M * kiorky util vserver 0.30.216
1382995956 M * Bertl that's not released yet
1382996059 M * Bertl maybe pre3038?
1382996069 M * JonB kiorky: did you post the fstab somewhere?
1382996070 M * kiorky Bertl: yep
1382996099 M * Bertl yes, the fstab would probably be quite interesting
1382996132 M * kiorky uhm, no a side effect pollution, i can fix it, non existent dir i think (just moved some dirs in part of a recent upgrade)
1382996161 M * kiorky but well,  yes just one minute for the pastebin stuff as the machine is not wired as usual ...
1382996225 M * Bertl also, is that problem reproduceable?
1382996246 M * Bertl i.e. does it always happen when you start the guest or so?
1382996272 M * kiorky Bertl: JonB http://pastebin.com/7fpXFPFv
1382996308 M * kiorky Bertl: yep, basically at first with all vservers i get randomly the trace from  cron or  postgres
1382996324 M * Bertl okay, that's a good thing
1382996331 M * kiorky so i deactivated all vservers, then just started one of the guests with pgsql, and problem arrise.
1382996356 M * Bertl okay, can you pack up one of those guests for me and upload it somewhere?
1382996369 N * l0kit Guest3692
1382996375 J * l0kit ~1oxT@0001b54e.user.oftc.net
1382996391 M * JonB what is filesystem none?
1382996399 M * kiorky argh this specific vserver is very large and sensitive, it's the backup vserver
1382996399 M * kiorky :S
1382996408 M * Bertl probably a bind mount
1382996419 M * kiorky exact.
1382996431 M * Bertl kiorky: okay, maybe you can create one from scratch and set it up to trigger the issue?
1382996441 M * Bertl i.e. one which doesn't contain sensitive data?
1382996462 M * kiorky yep let me try to initiate a vserver with pgsql to see if it triggers the trace.
1382996481 M * Bertl that would be really helpful
1382996742 Q * Guest3692 Ping timeout: 480 seconds
1382996807 M * kiorky Bertl: so debootstrap running ...
1382996870 M * kiorky Bertl: if you have familliar with gentoo i also have you a little earlier the kernel config, and kernel package i used 
1382996908 M * Bertl yeah I saw the urls, tx
1382996910 M * kiorky Bertl: for the kernel package, i took the one currently in portage to take the last patchset on linux-vserver.org + the aufs bits
1382996953 M * Bertl do you use the aufs?
1382996977 M * kiorky yep, this box need to have also docker support for new vms
1382996982 M * kiorky and docker uses that
1382997007 M * kiorky (well not for a long time as they are switching to a device mapper integration soon)
1382997022 M * kiorky but at this time, i need aufs.
1382997023 M * Bertl hmm, that might be causing the issue, but let's wait for a test case instead of speculate
1382997063 M * kiorky Bertl: uhm, do you want also the kernel blob + /lib/modules ?
1382997088 M * Bertl no, for now, let's try to recreate the issue on your setup with a simple guest
1382997093 M * Bertl (as simple as possible)
1382997117 M * Bertl if we can do that, I'll test the guest on my setup to see if I can recreate the issue
1382997139 M * Bertl if that goes well, I can probably fix it relatively easily
1382997144 M * kiorky uhm i have something really strange
1382997220 M * kiorky Bertl: http://pastebin.com/KPPmcbY1
1382997258 M * Bertl newly booted host?
1382997264 M * kiorky Bertl: i didnt at first tried vserver binaries as the init scripts were launching the vservers ... seems something is really borken on this installation ...
1382997315 M * Bertl most likely the vprocunhide script wasn't executed
1382997321 M * Bertl you can run it manually
1382997345 M * kiorky Bertl: ha yes forgot about that, as i move vserver* initscripts, this one was shadowed ...
1382997351 M * kiorky let me fix that.
1382997424 M * kiorky ok, done.
1382997879 M * kiorky Bertl: postgresql installing
1382997913 M * kiorky Bertl: in the other guest there are postgresql, sshd, crond, and all bacula daemons
1382997918 M * kiorky nothing elsE.
1382997922 Q * l0kit Remote host closed the connection
1382997929 M * kiorky Bertl: ok, reproduced
1382997938 M * kiorky Bertl: as soon as pgsql started -> trace
1382997947 M * kiorky need to reboot the box
1382997957 M * kiorky what do you want as an archive ?
1382997998 J * l0kit ~1oxT@0001b54e.user.oftc.net
1382998037 M * kiorky Bertl: to reproduce i dont think i need to upload you the tarball, you just need to :
1382998057 M * kiorky debootstrap a wheezy guest, apt-get update apt-get install postgresql
1382998080 M * kiorky the machine will trace on the apt-get install as the install process starts pgsql
1382998102 M * kiorky as soon as it is booted, i can give you the exact command i inputed.
1382998256 M * kiorky Bertl: http://pastebin.com/ZcL8M31v
1382998333 M * kiorky Bertl: if you need the kernel blob, the tied initramfs and the modules, and sources, just let me know
1382998523 M * kiorky Bertl: just emerging postgres on the bare metal host to see if it works.
1382998719 M * Bertl okay, great, will test shortly
1382998748 M * kiorky Bertl: i think this is tied to my particular setup...
1382998759 M * kiorky i mean this kernel version + patches
1382998769 M * kiorky Bertl: as i use this setup and those guests for years
1382998787 M * kiorky the only very different thing for this upgrade is the kernel setup
1382998795 M * Bertl okay, understood
1382998809 M * kiorky now, i m pretty stuck on debugging my own crap ...
1382999089 J * BenG_ ~bengreen@cpc35-aztw23-2-0-cust207.18-1.cable.virginm.net
1382999094 M * Bertl hmm, what debootstrap do you use? (version)
1382999131 M * Bertl because the versions I tried fail with strange messages
1382999138 M * kiorky Bertl: portage says 1.0.55
1382999201 M * Bertl strange
1382999285 M * kiorky Bertl: no mean to test inside guest, my intuition was good
1382999290 M * Bertl daniel_hozac: any idea on this? http://paste.linux-vserver.org/25882
1382999297 M * kiorky Bertl: i get also the trace with pgsql on the host
1382999311 M * Bertl okay, that's interesting
1382999503 M * daniel_hozac Bertl: curious. what version of debootstrap are you trying to use? what's the masked URL?
1382999654 M * Bertl sec
1382999663 M * Bertl http://ftp.debian.org/debian/pool/main/d/debootstrap/debootstrap_1.0.55_all.deb...
1382999827 Q * BenG_ Quit: I Leave
1382999843 M * daniel_hozac ah, it now uses xz for compression...
1382999894 M * daniel_hozac i would stick to an earlier version for now, i'll add support for xz.
1382999904 M * Bertl okay, with 53 I got
1382999920 M * Bertl E: Release signed by unknown key (key id 6FB2A1C265FFB764)
1382999935 M * Bertl that's why I updated the debootstrap url in the first place
1383000552 J * undefined_ ~undefined@00011a48.user.oftc.net
1383000605 M * undefined_ Bertl: i can confirm the stack trace that kiorky reports
1383000645 M * undefined_ Bertl: i saw it this weekend
1383000689 M * undefined_ Bertl: but didn't report it because i hadn't had a chance to debug it myself (eg trying 3.10.15)
1383000690 M * Bertl okay, can somebody check if that happens with 3.9.11 as well?
1383000693 Q * JonB Quit: Leaving
1383000723 M * undefined_ Bertl: that and i was trying to focus on one problem at a time (eg secure_mount)
1383000744 M * Bertl okay, no problem
1383000817 M * undefined_ Bertl: and it was triggered by postgresql, too
1383000827 M * kiorky ha !
1383000835 M * kiorky i am not that dummy ! :D
1383000866 M * Bertl it seems that postgresql is good in triggering bugs :)
1383000874 M * undefined_ Bertl: but i don't use aufs
1383000881 M * kiorky if you guys needs whatever for helping you to fix, my hands are open.
1383000895 M * Bertl noted and appreciated!
1383000907 M * undefined_ Bertl: i can help in a few hours
1383000919 M * Bertl it should be easy to recreate here I guess, and I'm sure we can fix it
1383000976 M * kiorky undefined_: do u use a vanilla kernel ?
1383001020 M * kiorky Bertl: to sum up and be 100% clear, the patchset i use are aufs, gentoo ones, & vserver
1383001033 M * kiorky extra modules i have around are nvidia ands .. 
1383001042 M * kiorky uhm that s all on that box.
1383001047 M * Bertl yep, undefined_ should use unpatched (i.e. vanilla and vserver)
1383001079 M * undefined_ Bertl: yes, the only patches i apply are vserver
1383001086 M * kiorky undefined_: which flavor did you use ? 3.10.17 ?
1383001099 M * undefined_ kiorky: 3.10.17
1383001117 M * kiorky ok, so the minimal factor is vanilla3.10.17+vserver
1383001140 M * kiorky time for bisect ? :( ?
1383001152 M * Bertl yeah, it's likely to be a 3.10 change which triggers this
1383001163 M * undefined_ Bertl: does it have to do with the "shm_unlock(shp);" you added to newseg() in shm.c?
1383001200 M * kiorky undefined_: inded, that sounds near the trace we got
1383001215 M * undefined_ Bertl: you added that but it wasn't in previous vserver patches (not saying that's the problem, but somehow related)
1383001267 M * undefined_ that's also the only difference between my 3.10.15-17 vserver patch fixup and your new 3.10.17 patch
1383001294 M * Bertl okay, can you do a diff for me?
1383001306 M * undefined_ (that's the only reason i noticed it; i was curious how off i was in my fixup patch to yoru official patch)
1383001354 M * undefined_ Bertl: i can't do much of anything right now (except irc) :(
1383001373 M * Bertl okay, no problem
1383001418 M * undefined_ Bertl: i'm not at my dev box and won't be for a few more hours
1383001443 M * kiorky i may also land into bed soon, that time change + major harware disasters today just tired me a lot :)
1383001498 M * kiorky but, if you want me to test something , i ll be there as soon as i can. (kiorky@gmail.com as my local domain is down due to a vserver bug ^^ if you do not see me idling there)
1383001511 M * Bertl okay, thanks!
1383001614 M * kiorky Bertl: it s me that have to thank you for offering me vserver :)
1383001628 M * kiorky and all of you vserver guys.
1383001631 M * Bertl you're welcome! :)
1383001653 M * kiorky Bertl: im so affraid i cant push it forward now that there is lxc and so on...
1383001684 M * Bertl ah, we are still hoping that lxc will at some point replace the kernel changes :)
1383001856 M * kiorky Bertl: uhm, from an 'end user' like me i had more the feeling that lxc just got mainstream where vserver just didnt suceeded even if it is more mature and just works.
1383001991 M * Bertl nah, lxc is basically the re-engineered Linux-VServer :)
1383002026 M * Bertl i.e. mainline recreates the Linux-VServer functionality now that they realized that it really is useful
1383002169 Q * Ghislain Quit: Leaving.
1383002286 M * kiorky Bertl: yep but i will never understand that habit to always reinvent the wheel
1383002340 M * Bertl probably a combination of politics and strong personalities :)
1383002390 M * kiorky Bertl: all what i just avoid :)
1383002432 M * kiorky Bertl: and finaly, do you have a personal special work on nowoday so-called cgroups ?
1383002593 M * kiorky Bertl: i mean more on the use that lxc has of the cgroups compared with with the features implemented in vserver.
1383003153 M * Bertl we are using all the cgroup features in Linux-VServer as well
1383003162 M * Bertl i.e. as soon as they become useable 
1383003173 Q * kiorky Read error: Connection reset by peer
1383003429 M * daniel_hozac Bertl: https://github.com/linux-vserver/util-vserver/commit/052847337fb4e7631f01ce86b9e42b622d281ecb
1383003456 M * Bertl great, thanks! can you do a tar package for me?
1383003471 M * daniel_hozac not at the moment, automake is giving me problems...
1383003485 M * Bertl okay, no big deal 
1383003759 M * Bertl seems to work fine, thanks, but I still get the key error with .55 ... any idea on that one?
1383003781 M * Bertl maybe I have to add or remove a key somewhere?
1383003848 M * Bertl http://paste.linux-vserver.org/25883