virtualbox.org

End user forums for VirtualBox
https://forums.virtualbox.org/

Kernel crash ??

https://forums.virtualbox.org/viewtopic.php?t=18167

Page 1 of 1

Kernel crash ??

Posted: 28. May 2009, 23:14
by KeyzerSuze
Hi

I got this whilst running 2 VM on a debian amd64 2.6.29 machine

Code: Select all

[691221.775065] sshd: page allocation failure. order:3, mode:0x20
[691221.775070] Pid: 7690, comm: sshd Tainted: P           2.6.29-2-amd64 #1
[691221.775072] Call Trace:
[691221.775080]  [<ffffffff8029483d>] __alloc_pages_internal+0x3ff/0x422
[691221.775084]  [<ffffffff802b86ea>] kmem_getpages+0x6c/0x12f
[691221.775087]  [<ffffffff802b8f90>] fallback_alloc+0x152/0x1cd
[691221.775090]  [<ffffffff802b8858>] kmem_cache_alloc_node+0xab/0xdf
[691221.775093]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691221.775120]  [<ffffffff803fc31d>] skb_copy+0x30/0x96
[691221.775130]  [<ffffffffa077f4ec>] vboxNetFltLinuxPacketHandler+0x40/0x95 [vboxnetflt]
[691221.775134]  [<ffffffff804024b0>] dev_hard_start_xmit+0x135/0x267
[691221.775137]  [<ffffffff80413b00>] __qdisc_run+0xe4/0x1e8
[691221.775140]  [<ffffffff80402a3a>] dev_queue_xmit+0x357/0x457
[691221.775143]  [<ffffffff80427215>] ip_queue_xmit+0x2cf/0x32a
[691221.775147]  [<ffffffff802ca689>] __pollwait+0x0/0xce
[691221.775151]  [<ffffffff8029e431>] zone_statistics+0x3c/0x5f
[691221.775154]  [<ffffffff80437787>] tcp_transmit_skb+0x624/0x663
[691221.775156]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691221.775159]  [<ffffffff80439c67>] tcp_write_xmit+0x862/0x95a
[691221.775161]  [<ffffffff80439dac>] __tcp_push_pending_frames+0x22/0x53
[691221.775164]  [<ffffffff8042edbd>] tcp_sendmsg+0x77c/0x878
[691221.775167]  [<ffffffff803f445e>] sock_aio_write+0xd8/0xe3
[691221.775170]  [<ffffffff802bd31c>] do_sync_write+0xce/0x113
[691221.775174]  [<ffffffff8020f9be>] __switch_to+0x3bb/0x3cd
[691221.775177]  [<ffffffff80255f4e>] autoremove_wake_function+0x0/0x2e
[691221.775181]  [<ffffffff80227d1d>] __ticket_spin_lock+0x9/0x1b
[691221.775183]  [<ffffffff802bdb8a>] vfs_write+0xbc/0x102
[691221.775186]  [<ffffffff804799d9>] _spin_lock_irq+0xd/0xf
[691221.775189]  [<ffffffff802bdc8c>] sys_write+0x45/0x6e
[691221.775192]  [<ffffffff802110aa>] system_call_fastpath+0x16/0x1b
[691221.775194] Mem-Info:
[691221.775195] Node 0 DMA per-cpu:
[691221.775198] CPU    0: hi:    0, btch:   1 usd:   0
[691221.775199] CPU    1: hi:    0, btch:   1 usd:   0
[691221.775201] CPU    2: hi:    0, btch:   1 usd:   0
[691221.775202] CPU    3: hi:    0, btch:   1 usd:   0
[691221.775204] Node 0 DMA32 per-cpu:
[691221.775206] CPU    0: hi:  186, btch:  31 usd: 155
[691221.775207] CPU    1: hi:  186, btch:  31 usd:  99
[691221.775209] CPU    2: hi:  186, btch:  31 usd: 182
[691221.775210] CPU    3: hi:  186, btch:  31 usd: 174
[691221.775211] Node 0 Normal per-cpu:
[691221.775213] CPU    0: hi:  186, btch:  31 usd: 155
[691221.775215] CPU    1: hi:  186, btch:  31 usd: 173
[691221.775216] CPU    2: hi:  186, btch:  31 usd: 164
[691221.775218] CPU    3: hi:  186, btch:  31 usd: 153
[691221.775221] Active_anon:423701 active_file:249906 inactive_anon:93824
[691221.775222]  inactive_file:229447 unevictable:761527 dirty:5232 writeback:0 unstable:0
[691221.775223]  free:83491 slab:110004 mapped:49010 pagetables:8652 bounce:0
[691221.775225] Node 0 DMA free:10388kB min:12kB low:12kB high:16kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:9252kB pages_scanned:0 all_unreclaimable? yes
[691221.775229] lowmem_reserve[]: 0 2871 7921 7921
[691221.775232] Node 0 DMA32 free:126700kB min:4124kB low:5152kB high:6184kB active_anon:948368kB inactive_anon:250772kB active_file:67016kB inactive_file:107820kB unevictable:1160604kB present:2940064kB pages_scanned:0 all_unreclaimable? no
[691221.775237] lowmem_reserve[]: 0 0 5050 5050
[691221.775240] Node 0 Normal free:197048kB min:7256kB low:9068kB high:10884kB active_anon:746436kB inactive_anon:124524kB active_file:932608kB inactive_file:809968kB unevictable:1885504kB present:5171200kB pages_scanned:0 all_unreclaimable? no
[691221.775244] lowmem_reserve[]: 0 0 0 0
[691221.775247] Node 0 DMA: 3*4kB 5*8kB 2*16kB 4*32kB 3*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 2*4096kB = 10388kB
[691221.775254] Node 0 DMA32: 29810*4kB 883*8kB 7*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 126704kB
[691221.775260] Node 0 Normal: 46377*4kB 1392*8kB 9*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 197396kB
[691221.775267] 514918 total pagecache pages
[691221.775269] 25247 pages in swap cache
[691221.775270] Swap cache stats: add 1612421, delete 1587174, find 9746647/9806621
[691221.775272] Free swap  = 1372956kB
[691221.775273] Total swap = 1959672kB
[691221.792596] 2064384 pages RAM
[691221.792596] 69249 pages reserved
[691221.792596] 1146549 pages shared
[691221.792596] 875660 pages non-shared
[691221.821123] sshd: page allocation failure. order:3, mode:0x20
[691221.821128] Pid: 7690, comm: sshd Tainted: P           2.6.29-2-amd64 #1
[691221.821129] Call Trace:
[691221.821137]  [<ffffffff8029483d>] __alloc_pages_internal+0x3ff/0x422
[691221.821141]  [<ffffffff802b86ea>] kmem_getpages+0x6c/0x12f
[691221.821143]  [<ffffffff802b8f90>] fallback_alloc+0x152/0x1cd
[691221.821146]  [<ffffffff802b8858>] kmem_cache_alloc_node+0xab/0xdf
[691221.821149]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691221.821173]  [<ffffffff803fc31d>] skb_copy+0x30/0x96
[691221.821183]  [<ffffffffa077f4ec>] vboxNetFltLinuxPacketHandler+0x40/0x95 [vboxnetflt]
[691221.821186]  [<ffffffff804024b0>] dev_hard_start_xmit+0x135/0x267
[691221.821190]  [<ffffffff80413b00>] __qdisc_run+0xe4/0x1e8
[691221.821192]  [<ffffffff80402a3a>] dev_queue_xmit+0x357/0x457
[691221.821195]  [<ffffffff80427215>] ip_queue_xmit+0x2cf/0x32a
[691221.821199]  [<ffffffff8029e431>] zone_statistics+0x3c/0x5f
[691221.821202]  [<ffffffff80437787>] tcp_transmit_skb+0x624/0x663
[691221.821204]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691221.821206]  [<ffffffff80439c67>] tcp_write_xmit+0x862/0x95a
[691221.821209]  [<ffffffff80439dac>] __tcp_push_pending_frames+0x22/0x53
[691221.821211]  [<ffffffff8042edbd>] tcp_sendmsg+0x77c/0x878
[691221.821214]  [<ffffffff803f445e>] sock_aio_write+0xd8/0xe3
[691221.821217]  [<ffffffff802bd31c>] do_sync_write+0xce/0x113
[691221.821221]  [<ffffffff8020f9be>] __switch_to+0x3bb/0x3cd
[691221.821224]  [<ffffffff80255f4e>] autoremove_wake_function+0x0/0x2e
[691221.821228]  [<ffffffff80227d1d>] __ticket_spin_lock+0x9/0x1b
[691221.821230]  [<ffffffff802bdb8a>] vfs_write+0xbc/0x102
[691221.821233]  [<ffffffff804799d9>] _spin_lock_irq+0xd/0xf
[691221.821236]  [<ffffffff802bdc8c>] sys_write+0x45/0x6e
[691221.821239]  [<ffffffff802110aa>] system_call_fastpath+0x16/0x1b
[691221.821241] Mem-Info:
[691221.821242] Node 0 DMA per-cpu:
[691221.821244] CPU    0: hi:    0, btch:   1 usd:   0
[691221.821246] CPU    1: hi:    0, btch:   1 usd:   0
[691221.821248] CPU    2: hi:    0, btch:   1 usd:   0
[691221.821249] CPU    3: hi:    0, btch:   1 usd:   0
[691221.821250] Node 0 DMA32 per-cpu:
[691221.821252] CPU    0: hi:  186, btch:  31 usd: 165
[691221.821254] CPU    1: hi:  186, btch:  31 usd:  99
[691221.821255] CPU    2: hi:  186, btch:  31 usd: 155
[691221.821257] CPU    3: hi:  186, btch:  31 usd: 174
[691221.821258] Node 0 Normal per-cpu:
[691221.821260] CPU    0: hi:  186, btch:  31 usd: 156
[691221.821261] CPU    1: hi:  186, btch:  31 usd: 203
[691221.821263] CPU    2: hi:  186, btch:  31 usd: 181
[691221.821264] CPU    3: hi:  186, btch:  31 usd: 170
[691221.821267] Active_anon:423639 active_file:249120 inactive_anon:93817
[691221.821268]  inactive_file:229193 unevictable:761527 dirty:5232 writeback:0 unstable:0
[691221.821269]  free:84631 slab:110093 mapped:49010 pagetables:8652 bounce:0
[691221.821271] Node 0 DMA free:10388kB min:12kB low:12kB high:16kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:9252kB pages_scanned:0 all_unreclaimable? yes
[691221.821275] lowmem_reserve[]: 0 2871 7921 7921
[691221.821278] Node 0 DMA32 free:127132kB min:4124kB low:5152kB high:6184kB active_anon:948368kB inactive_anon:250772kB active_file:67016kB inactive_file:107568kB unevictable:1160604kB present:2940064kB pages_scanned:0 all_unreclaimable? no
[691221.821283] lowmem_reserve[]: 0 0 5050 5050
[691221.821285] Node 0 Normal free:201004kB min:7256kB low:9068kB high:10884kB active_anon:746188kB inactive_anon:124496kB active_file:929464kB inactive_file:809204kB unevictable:1885504kB present:5171200kB pages_scanned:32 all_unreclaimable? no
[691221.821290] lowmem_reserve[]: 0 0 0 0
[691221.821293] Node 0 DMA: 3*4kB 5*8kB 2*16kB 4*32kB 3*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 2*4096kB = 10388kB
[691221.821300] Node 0 DMA32: 29931*4kB 898*8kB 8*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 127196kB
[691221.821306] Node 0 Normal: 47026*4kB 1540*8kB 11*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 201208kB
[691221.821315] 513793 total pagecache pages
[691221.821317] 25189 pages in swap cache
[691221.821318] Swap cache stats: add 1612424, delete 1587235, find 9746647/9806622
[691221.821320] Free swap  = 1372956kB
[691221.821321] Total swap = 1959672kB
[691221.833253] 2064384 pages RAM
[691221.833253] 69249 pages reserved
[691221.833253] 1145473 pages shared
[691221.833253] 875152 pages non-shared
[691221.864739] sshd: page allocation failure. order:3, mode:0x20
[691221.864742] Pid: 7690, comm: sshd Tainted: P           2.6.29-2-amd64 #1
[691221.864744] Call Trace:
[691221.864753]  [<ffffffff8029483d>] __alloc_pages_internal+0x3ff/0x422
[691221.864757]  [<ffffffff802b86ea>] kmem_getpages+0x6c/0x12f
[691221.864759]  [<ffffffff802b8f90>] fallback_alloc+0x152/0x1cd
[691221.864762]  [<ffffffff802b8858>] kmem_cache_alloc_node+0xab/0xdf
[691221.864766]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691221.864796]  [<ffffffff803fc31d>] skb_copy+0x30/0x96
[691221.864806]  [<ffffffffa077f4ec>] vboxNetFltLinuxPacketHandler+0x40/0x95 [vboxnetflt]
[691221.864810]  [<ffffffff804024b0>] dev_hard_start_xmit+0x135/0x267
[691221.864813]  [<ffffffff80413b00>] __qdisc_run+0xe4/0x1e8
[691221.864816]  [<ffffffff80402a3a>] dev_queue_xmit+0x357/0x457
[691221.864820]  [<ffffffff80427215>] ip_queue_xmit+0x2cf/0x32a
[691221.864824]  [<ffffffff802ca689>] __pollwait+0x0/0xce
[691221.864827]  [<ffffffff8029e431>] zone_statistics+0x3c/0x5f
[691221.864831]  [<ffffffff80437787>] tcp_transmit_skb+0x624/0x663
[691221.864834]  [<ffffffff80439c67>] tcp_write_xmit+0x862/0x95a
[691221.864837]  [<ffffffff80439dac>] __tcp_push_pending_frames+0x22/0x53
[691221.864839]  [<ffffffff8042edbd>] tcp_sendmsg+0x77c/0x878
[691221.864843]  [<ffffffff803f445e>] sock_aio_write+0xd8/0xe3
[691221.864846]  [<ffffffff802bd31c>] do_sync_write+0xce/0x113
[691221.864851]  [<ffffffff8020f9be>] __switch_to+0x3bb/0x3cd
[691221.864854]  [<ffffffff80255f4e>] autoremove_wake_function+0x0/0x2e
[691221.864857]  [<ffffffff80227d1d>] __ticket_spin_lock+0x9/0x1b
[691221.864860]  [<ffffffff802bdb8a>] vfs_write+0xbc/0x102
[691221.864863]  [<ffffffff804799d9>] _spin_lock_irq+0xd/0xf
[691221.864865]  [<ffffffff802bdc8c>] sys_write+0x45/0x6e
[691221.864868]  [<ffffffff802110aa>] system_call_fastpath+0x16/0x1b
[691221.864870] Mem-Info:
[691221.864872] Node 0 DMA per-cpu:
[691221.864874] CPU    0: hi:    0, btch:   1 usd:   0
[691221.864875] CPU    1: hi:    0, btch:   1 usd:   0
[691221.864877] CPU    2: hi:    0, btch:   1 usd:   0
[691221.864878] CPU    3: hi:    0, btch:   1 usd:   0
[691221.864880] Node 0 DMA32 per-cpu:
[691221.864882] CPU    0: hi:  186, btch:  31 usd: 165
[691221.864883] CPU    1: hi:  186, btch:  31 usd:  99
[691221.864885] CPU    2: hi:  186, btch:  31 usd: 156
[691221.864886] CPU    3: hi:  186, btch:  31 usd: 174
[691221.864888] Node 0 Normal per-cpu:
[691221.864889] CPU    0: hi:  186, btch:  31 usd: 156
[691221.864891] CPU    1: hi:  186, btch:  31 usd: 175
[691221.864893] CPU    2: hi:  186, btch:  31 usd: 182
[691221.864894] CPU    3: hi:  186, btch:  31 usd: 173
[691221.864897] Active_anon:423639 active_file:248537 inactive_anon:93817
[691221.864898]  inactive_file:229038 unevictable:761527 dirty:5232 writeback:0 unstable:0
[691221.864899]  free:85393 slab:110093 mapped:49010 pagetables:8652 bounce:0
[691221.864901] Node 0 DMA free:10388kB min:12kB low:12kB high:16kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:9252kB pages_scanned:0 all_unreclaimable? yes
[691221.864906] lowmem_reserve[]: 0 2871 7921 7921
[691221.864908] Node 0 DMA32 free:127428kB min:4124kB low:5152kB high:6184kB active_anon:948368kB inactive_anon:250772kB active_file:66756kB inactive_file:107320kB unevictable:1160604kB present:2940064kB pages_scanned:0 all_unreclaimable? no
[691221.864913] lowmem_reserve[]: 0 0 5050 5050
[691221.864916] Node 0 Normal free:203756kB min:7256kB low:9068kB high:10884kB active_anon:746188kB inactive_anon:124496kB active_file:927392kB inactive_file:808832kB unevictable:1885504kB present:5171200kB pages_scanned:32 all_unreclaimable? no
[691221.864920] lowmem_reserve[]: 0 0 0 0
[691221.864923] Node 0 DMA: 3*4kB 5*8kB 2*16kB 4*32kB 3*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 2*4096kB = 10388kB
[691221.864929] Node 0 DMA32: 29981*4kB 904*8kB 8*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 127444kB
[691221.864936] Node 0 Normal: 47428*4kB 1666*8kB 18*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 203936kB
[691221.864943] 513098 total pagecache pages
[691221.864944] 25161 pages in swap cache
[691221.864946] Swap cache stats: add 1612427, delete 1587266, find 9746647/9806623
[691221.864947] Free swap  = 1372960kB
[691221.864949] Total swap = 1959672kB
[691221.871084] 2064384 pages RAM
[691221.871084] 69249 pages reserved
[691221.871084] 1142261 pages shared
[691221.871084] 873012 pages non-shared
[691221.911453] sshd: page allocation failure. order:3, mode:0x20
[691221.911458] Pid: 7690, comm: sshd Tainted: P           2.6.29-2-amd64 #1
[691221.911460] Call Trace:
[691221.911466]  [<ffffffff8029483d>] __alloc_pages_internal+0x3ff/0x422
[691221.911470]  [<ffffffff802b86ea>] kmem_getpages+0x6c/0x12f
[691221.911472]  [<ffffffff802b8f90>] fallback_alloc+0x152/0x1cd
[691221.911475]  [<ffffffff802b8858>] kmem_cache_alloc_node+0xab/0xdf
[691221.911478]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691221.911503]  [<ffffffff803fc31d>] skb_copy+0x30/0x96
[691221.911513]  [<ffffffffa077f4ec>] vboxNetFltLinuxPacketHandler+0x40/0x95 [vboxnetflt]
[691221.911516]  [<ffffffff804024b0>] dev_hard_start_xmit+0x135/0x267
[691221.911519]  [<ffffffff80413b00>] __qdisc_run+0xe4/0x1e8
[691221.911522]  [<ffffffff80402a3a>] dev_queue_xmit+0x357/0x457
[691221.911525]  [<ffffffff80427215>] ip_queue_xmit+0x2cf/0x32a
[691221.911528]  [<ffffffff8029e431>] zone_statistics+0x3c/0x5f
[691221.911531]  [<ffffffff80437787>] tcp_transmit_skb+0x624/0x663
[691221.911533]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691221.911536]  [<ffffffff80439c67>] tcp_write_xmit+0x862/0x95a
[691221.911538]  [<ffffffff80439dac>] __tcp_push_pending_frames+0x22/0x53
[691221.911541]  [<ffffffff8042edbd>] tcp_sendmsg+0x77c/0x878
[691221.911544]  [<ffffffff803f445e>] sock_aio_write+0xd8/0xe3
[691221.911547]  [<ffffffff802bd31c>] do_sync_write+0xce/0x113
[691221.911551]  [<ffffffff8020f9be>] __switch_to+0x3bb/0x3cd
[691221.911554]  [<ffffffff80255f4e>] autoremove_wake_function+0x0/0x2e
[691221.911557]  [<ffffffff80227d1d>] __ticket_spin_lock+0x9/0x1b
[691221.911560]  [<ffffffff802bdb8a>] vfs_write+0xbc/0x102
[691221.911562]  [<ffffffff804799d9>] _spin_lock_irq+0xd/0xf
[691221.911565]  [<ffffffff802bdc8c>] sys_write+0x45/0x6e
[691221.911568]  [<ffffffff802110aa>] system_call_fastpath+0x16/0x1b
[691221.911569] Mem-Info:
[691221.911571] Node 0 DMA per-cpu:
[691221.911573] CPU    0: hi:    0, btch:   1 usd:   0
[691221.911575] CPU    1: hi:    0, btch:   1 usd:   0
[691221.911576] CPU    2: hi:    0, btch:   1 usd:   0
[691221.911578] CPU    3: hi:    0, btch:   1 usd:   0
[691221.911579] Node 0 DMA32 per-cpu:
[691221.911581] CPU    0: hi:  186, btch:  31 usd: 165
[691221.911583] CPU    1: hi:  186, btch:  31 usd:  99
[691221.911584] CPU    2: hi:  186, btch:  31 usd: 166
[691221.911586] CPU    3: hi:  186, btch:  31 usd: 174
[691221.911587] Node 0 Normal per-cpu:
[691221.911589] CPU    0: hi:  186, btch:  31 usd: 156
[691221.911590] CPU    1: hi:  186, btch:  31 usd: 197
[691221.911591] CPU    2: hi:  186, btch:  31 usd: 161
[691221.911593] CPU    3: hi:  186, btch:  31 usd: 194
[691221.911596] Active_anon:423430 active_file:244759 inactive_anon:93625
[691221.911597]  inactive_file:227628 unevictable:761582 dirty:5232 writeback:0 unstable:0
[691221.911598]  free:90789 slab:110143 mapped:49010 pagetables:8652 bounce:0
[691221.911600] Node 0 DMA free:10388kB min:12kB low:12kB high:16kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:9252kB pages_scanned:0 all_unreclaimable? yes
[691221.911604] lowmem_reserve[]: 0 2871 7921 7921
[691221.911607] Node 0 DMA32 free:130092kB min:4124kB low:5152kB high:6184kB active_anon:948588kB inactive_anon:250284kB active_file:65964kB inactive_file:105548kB unevictable:1160824kB present:2940064kB pages_scanned:66 all_unreclaimable? no
[691221.911612] lowmem_reserve[]: 0 0 5050 5050
[691221.911614] Node 0 Normal free:222676kB min:7256kB low:9068kB high:10884kB active_anon:745132kB inactive_anon:124216kB active_file:913072kB inactive_file:804964kB unevictable:1885504kB present:5171200kB pages_scanned:32 all_unreclaimable? no
[691221.911619] lowmem_reserve[]: 0 0 0 0
[691221.911621] Node 0 DMA: 3*4kB 5*8kB 2*16kB 4*32kB 3*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 2*4096kB = 10388kB
[691221.911628] Node 0 DMA32: 30519*4kB 976*8kB 8*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 130172kB
[691221.911635] Node 0 Normal: 50210*4kB 2570*8kB 62*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 222904kB
[691221.911641] 507638 total pagecache pages
[691221.911643] 24869 pages in swap cache
[691221.911644] Swap cache stats: add 1612488, delete 1587619, find 9746649/9806626
[691221.911646] Free swap  = 1372936kB
[691221.911647] Total swap = 1959672kB
[691221.922144] 2064384 pages RAM
[691221.922144] 69249 pages reserved
[691221.922144] 1141902 pages shared
[691221.922144] 873031 pages non-shared
[691221.953486] sshd: page allocation failure. order:3, mode:0x20
[691221.953489] Pid: 7690, comm: sshd Tainted: P           2.6.29-2-amd64 #1
[691221.953491] Call Trace:
[691221.953497]  [<ffffffff8029483d>] __alloc_pages_internal+0x3ff/0x422
[691221.953501]  [<ffffffff802b86ea>] kmem_getpages+0x6c/0x12f
[691221.953503]  [<ffffffff802b8f90>] fallback_alloc+0x152/0x1cd
[691221.953506]  [<ffffffff802b8858>] kmem_cache_alloc_node+0xab/0xdf
[691221.953509]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691221.953528]  [<ffffffff803fc31d>] skb_copy+0x30/0x96
[691221.953537]  [<ffffffffa077f4ec>] vboxNetFltLinuxPacketHandler+0x40/0x95 [vboxnetflt]
[691221.953541]  [<ffffffff804024b0>] dev_hard_start_xmit+0x135/0x267
[691221.953544]  [<ffffffff80413b00>] __qdisc_run+0xe4/0x1e8
[691221.953546]  [<ffffffff80402a3a>] dev_queue_xmit+0x357/0x457
[691221.953550]  [<ffffffff80427215>] ip_queue_xmit+0x2cf/0x32a
[691221.953553]  [<ffffffff802ca689>] __pollwait+0x0/0xce
[691221.953556]  [<ffffffff8029e431>] zone_statistics+0x3c/0x5f
[691221.953559]  [<ffffffff80437787>] tcp_transmit_skb+0x624/0x663
[691221.953562]  [<ffffffff80439c67>] tcp_write_xmit+0x862/0x95a
[691221.953565]  [<ffffffff80439dac>] __tcp_push_pending_frames+0x22/0x53
[691221.953567]  [<ffffffff8042edbd>] tcp_sendmsg+0x77c/0x878
[691221.953570]  [<ffffffff803f445e>] sock_aio_write+0xd8/0xe3
[691221.953573]  [<ffffffff802bd31c>] do_sync_write+0xce/0x113
[691221.953577]  [<ffffffff8020f9be>] __switch_to+0x3bb/0x3cd
[691221.953580]  [<ffffffff80255f4e>] autoremove_wake_function+0x0/0x2e
[691221.953583]  [<ffffffff80227d1d>] __ticket_spin_lock+0x9/0x1b
[691221.953586]  [<ffffffff802bdb8a>] vfs_write+0xbc/0x102
[691221.953589]  [<ffffffff804799d9>] _spin_lock_irq+0xd/0xf
[691221.953591]  [<ffffffff802bdc8c>] sys_write+0x45/0x6e
[691221.953594]  [<ffffffff802110aa>] system_call_fastpath+0x16/0x1b
[691221.953596] Mem-Info:
[691221.953598] Node 0 DMA per-cpu:
[691221.953600] CPU    0: hi:    0, btch:   1 usd:   0
[691221.953601] CPU    1: hi:    0, btch:   1 usd:   0
[691221.953603] CPU    2: hi:    0, btch:   1 usd:   0
[691221.953604] CPU    3: hi:    0, btch:   1 usd:   0
[691221.953605] Node 0 DMA32 per-cpu:
[691221.953607] CPU    0: hi:  186, btch:  31 usd: 165
[691221.953609] CPU    1: hi:  186, btch:  31 usd:  99
[691221.953610] CPU    2: hi:  186, btch:  31 usd: 185
[691221.953612] CPU    3: hi:  186, btch:  31 usd: 174
[691221.953613] Node 0 Normal per-cpu:
[691221.953615] CPU    0: hi:  186, btch:  31 usd: 156
[691221.953616] CPU    1: hi:  186, btch:  31 usd: 167
[691221.953618] CPU    2: hi:  186, btch:  31 usd: 172
[691221.953619] CPU    3: hi:  186, btch:  31 usd: 154
[691221.953622] Active_anon:423430 active_file:244759 inactive_anon:93625
[691221.953623]  inactive_file:227692 unevictable:761582 dirty:5232 writeback:0 unstable:0
[691221.953624]  free:90789 slab:110149 mapped:49010 pagetables:8652 bounce:0
[691221.953626] Node 0 DMA free:10388kB min:12kB low:12kB high:16kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:9252kB pages_scanned:0 all_unreclaimable? yes
[691221.953630] lowmem_reserve[]: 0 2871 7921 7921
[691221.953633] Node 0 DMA32 free:130092kB min:4124kB low:5152kB high:6184kB active_anon:948588kB inactive_anon:250284kB active_file:65964kB inactive_file:105548kB unevictable:1160824kB present:2940064kB pages_scanned:66 all_unreclaimable? no
[691221.953638] lowmem_reserve[]: 0 0 5050 5050
[691221.953640] Node 0 Normal free:222676kB min:7256kB low:9068kB high:10884kB active_anon:745132kB inactive_anon:124216kB active_file:913072kB inactive_file:805220kB unevictable:1885504kB present:5171200kB pages_scanned:0 all_unreclaimable? no
[691221.953645] lowmem_reserve[]: 0 0 0 0
[691221.953647] Node 0 DMA: 3*4kB 5*8kB 2*16kB 4*32kB 3*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 2*4096kB = 10388kB
[691221.953654] Node 0 DMA32: 30519*4kB 976*8kB 8*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 130172kB
[691221.953660] Node 0 Normal: 50154*4kB 2629*8kB 62*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 223152kB
[691221.953667] 507638 total pagecache pages
[691221.953668] 24863 pages in swap cache
[691221.953670] Swap cache stats: add 1612489, delete 1587626, find 9746655/9806633
[691221.953671] Free swap  = 1372964kB
[691221.953673] Total swap = 1959672kB
[691221.967083] 2064384 pages RAM
[691221.967083] 69249 pages reserved
[691221.967083] 1141897 pages shared
[691221.967083] 873011 pages non-shared
[691221.996845] sshd: page allocation failure. order:3, mode:0x20
[691221.996848] Pid: 7690, comm: sshd Tainted: P           2.6.29-2-amd64 #1
[691221.996850] Call Trace:
[691221.996857]  [<ffffffff8029483d>] __alloc_pages_internal+0x3ff/0x422
[691221.996860]  [<ffffffff802b86ea>] kmem_getpages+0x6c/0x12f
[691221.996863]  [<ffffffff802b8f90>] fallback_alloc+0x152/0x1cd
[691221.996866]  [<ffffffff802b8858>] kmem_cache_alloc_node+0xab/0xdf
[691221.996869]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691221.996893]  [<ffffffff803fc31d>] skb_copy+0x30/0x96
[691221.996903]  [<ffffffffa077f4ec>] vboxNetFltLinuxPacketHandler+0x40/0x95 [vboxnetflt]
[691221.996907]  [<ffffffff804024b0>] dev_hard_start_xmit+0x135/0x267
[691221.996910]  [<ffffffff80413b00>] __qdisc_run+0xe4/0x1e8
[691221.996912]  [<ffffffff80402a3a>] dev_queue_xmit+0x357/0x457
[691221.996916]  [<ffffffff80427215>] ip_queue_xmit+0x2cf/0x32a
[691221.996919]  [<ffffffff802ca689>] __pollwait+0x0/0xce
[691221.996922]  [<ffffffff8029e431>] zone_statistics+0x3c/0x5f
[691221.996925]  [<ffffffff80437787>] tcp_transmit_skb+0x624/0x663
[691221.996928]  [<ffffffff80439c67>] tcp_write_xmit+0x862/0x95a
[691221.996931]  [<ffffffff80439dac>] __tcp_push_pending_frames+0x22/0x53
[691221.996933]  [<ffffffff8042edbd>] tcp_sendmsg+0x77c/0x878
[691221.996936]  [<ffffffff803f445e>] sock_aio_write+0xd8/0xe3
[691221.996940]  [<ffffffff802bd31c>] do_sync_write+0xce/0x113
[691221.996943]  [<ffffffff8020f9be>] __switch_to+0x3bb/0x3cd
[691221.996946]  [<ffffffff80255f4e>] autoremove_wake_function+0x0/0x2e
[691221.996950]  [<ffffffff80227d1d>] __ticket_spin_lock+0x9/0x1b
[691221.996952]  [<ffffffff802bdb8a>] vfs_write+0xbc/0x102
[691221.996955]  [<ffffffff804799d9>] _spin_lock_irq+0xd/0xf
[691221.996957]  [<ffffffff802bdc8c>] sys_write+0x45/0x6e
[691221.996961]  [<ffffffff802110aa>] system_call_fastpath+0x16/0x1b
[691221.996962] Mem-Info:
[691221.996964] Node 0 DMA per-cpu:
[691221.996966] CPU    0: hi:    0, btch:   1 usd:   0
[691221.996967] CPU    1: hi:    0, btch:   1 usd:   0
[691221.996969] CPU    2: hi:    0, btch:   1 usd:   0
[691221.996970] CPU    3: hi:    0, btch:   1 usd:   0
[691221.996972] Node 0 DMA32 per-cpu:
[691221.996974] CPU    0: hi:  186, btch:  31 usd: 165
[691221.996975] CPU    1: hi:  186, btch:  31 usd:  99
[691221.996977] CPU    2: hi:  186, btch:  31 usd: 185
[691221.996978] CPU    3: hi:  186, btch:  31 usd: 174
[691221.996979] Node 0 Normal per-cpu:
[691221.996981] CPU    0: hi:  186, btch:  31 usd: 156
[691221.996983] CPU    1: hi:  186, btch:  31 usd: 170
[691221.996984] CPU    2: hi:  186, btch:  31 usd: 185
[691221.996986] CPU    3: hi:  186, btch:  31 usd: 143
[691221.996989] Active_anon:423430 active_file:244547 inactive_anon:93625
[691221.996989]  inactive_file:227645 unevictable:761582 dirty:5232 writeback:0 unstable:0
[691221.996991]  free:91004 slab:110149 mapped:49010 pagetables:8652 bounce:0
[691221.996992] Node 0 DMA free:10388kB min:12kB low:12kB high:16kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:9252kB pages_scanned:0 all_unreclaimable? yes
[691221.996997] lowmem_reserve[]: 0 2871 7921 7921
[691221.997000] Node 0 DMA32 free:130092kB min:4124kB low:5152kB high:6184kB active_anon:948588kB inactive_anon:250284kB active_file:65964kB inactive_file:105548kB unevictable:1160824kB present:2940064kB pages_scanned:66 all_unreclaimable? no
[691221.997005] lowmem_reserve[]: 0 0 5050 5050
[691221.997007] Node 0 Normal free:223536kB min:7256kB low:9068kB high:10884kB active_anon:745132kB inactive_anon:124216kB active_file:912224kB inactive_file:805032kB unevictable:1885504kB present:5171200kB pages_scanned:18 all_unreclaimable? no
[691221.997012] lowmem_reserve[]: 0 0 0 0
[691221.997014] Node 0 DMA: 3*4kB 5*8kB 2*16kB 4*32kB 3*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 2*4096kB = 10388kB
[691221.997021] Node 0 DMA32: 30519*4kB 976*8kB 8*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 130172kB
[691221.997028] Node 0 Normal: 50296*4kB 2678*8kB 64*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 224144kB
[691221.997034] 507382 total pagecache pages
[691221.997036] 24864 pages in swap cache
[691221.997038] Swap cache stats: add 1612498, delete 1587634, find 9746659/9806641
[691221.997039] Free swap  = 1372996kB
[691221.997041] Total swap = 1959672kB
[691222.001563] 2064384 pages RAM
[691222.001563] 69249 pages reserved
[691222.001563] 1140591 pages shared
[691222.001563] 872150 pages non-shared
[691222.040692] sshd: page allocation failure. order:3, mode:0x20
[691222.040696] Pid: 7690, comm: sshd Tainted: P           2.6.29-2-amd64 #1
[691222.040697] Call Trace:
[691222.040703]  [<ffffffff8029483d>] __alloc_pages_internal+0x3ff/0x422
[691222.040707]  [<ffffffff802b86ea>] kmem_getpages+0x6c/0x12f
[691222.040709]  [<ffffffff802b8f90>] fallback_alloc+0x152/0x1cd
[691222.040712]  [<ffffffff802b8858>] kmem_cache_alloc_node+0xab/0xdf
[691222.040715]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691222.040741]  [<ffffffff803fc31d>] skb_copy+0x30/0x96
[691222.040751]  [<ffffffffa077f4ec>] vboxNetFltLinuxPacketHandler+0x40/0x95 [vboxnetflt]
[691222.040754]  [<ffffffff804024b0>] dev_hard_start_xmit+0x135/0x267
[691222.040757]  [<ffffffff80413b00>] __qdisc_run+0xe4/0x1e8
[691222.040760]  [<ffffffff80402a3a>] dev_queue_xmit+0x357/0x457
[691222.040763]  [<ffffffff80427215>] ip_queue_xmit+0x2cf/0x32a
[691222.040767]  [<ffffffff802ca689>] __pollwait+0x0/0xce
[691222.040770]  [<ffffffff8029e431>] zone_statistics+0x3c/0x5f
[691222.040773]  [<ffffffff80437787>] tcp_transmit_skb+0x624/0x663
[691222.040776]  [<ffffffff80439c67>] tcp_write_xmit+0x862/0x95a
[691222.040779]  [<ffffffff80439dac>] __tcp_push_pending_frames+0x22/0x53
[691222.040781]  [<ffffffff8042edbd>] tcp_sendmsg+0x77c/0x878
[691222.040784]  [<ffffffff803f445e>] sock_aio_write+0xd8/0xe3
[691222.040787]  [<ffffffff802bd31c>] do_sync_write+0xce/0x113
[691222.040791]  [<ffffffff8020f9be>] __switch_to+0x3bb/0x3cd
[691222.040794]  [<ffffffff80255f4e>] autoremove_wake_function+0x0/0x2e
[691222.040798]  [<ffffffff80227d1d>] __ticket_spin_lock+0x9/0x1b
[691222.040800]  [<ffffffff802bdb8a>] vfs_write+0xbc/0x102
[691222.040803]  [<ffffffff804799d9>] _spin_lock_irq+0xd/0xf
[691222.040806]  [<ffffffff802bdc8c>] sys_write+0x45/0x6e
[691222.040809]  [<ffffffff802110aa>] system_call_fastpath+0x16/0x1b
[691222.040810] Mem-Info:
[691222.040811] Node 0 DMA per-cpu:
[691222.040814] CPU    0: hi:    0, btch:   1 usd:   0
[691222.040815] CPU    1: hi:    0, btch:   1 usd:   0
[691222.040817] CPU    2: hi:    0, btch:   1 usd:   0
[691222.040818] CPU    3: hi:    0, btch:   1 usd:   0
[691222.040819] Node 0 DMA32 per-cpu:
[691222.040821] CPU    0: hi:  186, btch:  31 usd: 165
[691222.040823] CPU    1: hi:  186, btch:  31 usd:  99
[691222.040824] CPU    2: hi:  186, btch:  31 usd: 175
[691222.040826] CPU    3: hi:  186, btch:  31 usd: 174
[691222.040827] Node 0 Normal per-cpu:
[691222.040829] CPU    0: hi:  186, btch:  31 usd: 156
[691222.040830] CPU    1: hi:  186, btch:  31 usd: 169
[691222.040832] CPU    2: hi:  186, btch:  31 usd: 172
[691222.040833] CPU    3: hi:  186, btch:  31 usd: 131
[691222.040837] Active_anon:423366 active_file:243133 inactive_anon:93548
[691222.040837]  inactive_file:227173 unevictable:761582 dirty:5232 writeback:0 unstable:0
[691222.040839]  free:93321 slab:109977 mapped:49010 pagetables:8652 bounce:0
[691222.040840] Node 0 DMA free:10388kB min:12kB low:12kB high:16kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:9252kB pages_scanned:0 all_unreclaimable? yes
[691222.040845] lowmem_reserve[]: 0 2871 7921 7921
[691222.040848] Node 0 DMA32 free:131276kB min:4124kB low:5152kB high:6184kB active_anon:948588kB inactive_anon:250032kB active_file:65720kB inactive_file:105028kB unevictable:1160824kB present:2940064kB pages_scanned:0 all_unreclaimable? no
[691222.040853] lowmem_reserve[]: 0 0 5050 5050
[691222.040855] Node 0 Normal free:231620kB min:7256kB low:9068kB high:10884kB active_anon:744876kB inactive_anon:124160kB active_file:906812kB inactive_file:803664kB unevictable:1885504kB present:5171200kB pages_scanned:0 all_unreclaimable? no
[691222.040860] lowmem_reserve[]: 0 0 0 0
[691222.040863] Node 0 DMA: 3*4kB 5*8kB 2*16kB 4*32kB 3*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 2*4096kB = 10388kB
[691222.040870] Node 0 DMA32: 30734*4kB 1008*8kB 8*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 131288kB
[691222.040876] Node 0 Normal: 51414*4kB 3045*8kB 95*16kB 1*32kB 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 232080kB
[691222.040883] 505370 total pagecache pages
[691222.040885] 24802 pages in swap cache
[691222.040887] Swap cache stats: add 1612562, delete 1587760, find 9746659/9806645
[691222.040888] Free swap  = 1372876kB
[691222.040889] Total swap = 1959672kB
[691222.049523] 2064384 pages RAM
[691222.049523] 69249 pages reserved
[691222.049523] 1140286 pages shared
[691222.049523] 872040 pages non-shared
[691222.084717] sshd: page allocation failure. order:3, mode:0x20
[691222.084720] Pid: 7690, comm: sshd Tainted: P           2.6.29-2-amd64 #1
[691222.084722] Call Trace:
[691222.084729]  [<ffffffff8029483d>] __alloc_pages_internal+0x3ff/0x422
[691222.084732]  [<ffffffff802b86ea>] kmem_getpages+0x6c/0x12f
[691222.084735]  [<ffffffff802b8f90>] fallback_alloc+0x152/0x1cd
[691222.084738]  [<ffffffff802b8858>] kmem_cache_alloc_node+0xab/0xdf
[691222.084741]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691222.084764]  [<ffffffff803fc31d>] skb_copy+0x30/0x96
[691222.084773]  [<ffffffffa077f4ec>] vboxNetFltLinuxPacketHandler+0x40/0x95 [vboxnetflt]
[691222.084776]  [<ffffffff804024b0>] dev_hard_start_xmit+0x135/0x267
[691222.084780]  [<ffffffff80413b00>] __qdisc_run+0xe4/0x1e8
[691222.084782]  [<ffffffff80402a3a>] dev_queue_xmit+0x357/0x457
[691222.084786]  [<ffffffff80427215>] ip_queue_xmit+0x2cf/0x32a
[691222.084789]  [<ffffffff802ca689>] __pollwait+0x0/0xce
[691222.084793]  [<ffffffff8029e431>] zone_statistics+0x3c/0x5f
[691222.084796]  [<ffffffff80437787>] tcp_transmit_skb+0x624/0x663
[691222.084799]  [<ffffffff80439c67>] tcp_write_xmit+0x862/0x95a
[691222.084802]  [<ffffffff80439dac>] __tcp_push_pending_frames+0x22/0x53
[691222.084804]  [<ffffffff8042edbd>] tcp_sendmsg+0x77c/0x878
[691222.084807]  [<ffffffff803f445e>] sock_aio_write+0xd8/0xe3
[691222.084811]  [<ffffffff802bd31c>] do_sync_write+0xce/0x113
[691222.084814]  [<ffffffff8020f9be>] __switch_to+0x3bb/0x3cd
[691222.084817]  [<ffffffff80255f4e>] autoremove_wake_function+0x0/0x2e
[691222.084821]  [<ffffffff80227d1d>] __ticket_spin_lock+0x9/0x1b
[691222.084823]  [<ffffffff802bdb8a>] vfs_write+0xbc/0x102
[691222.084826]  [<ffffffff804799d9>] _spin_lock_irq+0xd/0xf
[691222.084829]  [<ffffffff802bdc8c>] sys_write+0x45/0x6e
[691222.084832]  [<ffffffff802110aa>] system_call_fastpath+0x16/0x1b
[691222.084834] Mem-Info:
[691222.084835] Node 0 DMA per-cpu:
[691222.084837] CPU    0: hi:    0, btch:   1 usd:   0
[691222.084839] CPU    1: hi:    0, btch:   1 usd:   0
[691222.084841] CPU    2: hi:    0, btch:   1 usd:   0
[691222.084842] CPU    3: hi:    0, btch:   1 usd:   0
[691222.084844] Node 0 DMA32 per-cpu:
[691222.084846] CPU    0: hi:  186, btch:  31 usd: 165
[691222.084847] CPU    1: hi:  186, btch:  31 usd:  99
[691222.084849] CPU    2: hi:  186, btch:  31 usd: 177
[691222.084850] CPU    3: hi:  186, btch:  31 usd: 174
[691222.084852] Node 0 Normal per-cpu:
[691222.084854] CPU    0: hi:  186, btch:  31 usd: 156
[691222.084855] CPU    1: hi:  186, btch:  31 usd: 169
[691222.084857] CPU    2: hi:  186, btch:  31 usd: 175
[691222.084858] CPU    3: hi:  186, btch:  31 usd: 124
[691222.084861] Active_anon:423366 active_file:242864 inactive_anon:93548
[691222.084862]  inactive_file:227060 unevictable:761637 dirty:5232 writeback:0 unstable:0
[691222.084864]  free:93653 slab:109977 mapped:49010 pagetables:8652 bounce:0
[691222.084866] Node 0 DMA free:10388kB min:12kB low:12kB high:16kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:9252kB pages_scanned:0 all_unreclaimable? yes
[691222.084870] lowmem_reserve[]: 0 2871 7921 7921
[691222.084873] Node 0 DMA32 free:131572kB min:4124kB low:5152kB high:6184kB active_anon:948588kB inactive_anon:250032kB active_file:65464kB inactive_file:104772kB unevictable:1161044kB present:2940064kB pages_scanned:1 all_unreclaimable? no
[691222.084879] lowmem_reserve[]: 0 0 5050 5050
[691222.084881] Node 0 Normal free:232824kB min:7256kB low:9068kB high:10884kB active_anon:744876kB inactive_anon:124160kB active_file:905992kB inactive_file:803468kB unevictable:1885504kB present:5171200kB pages_scanned:0 all_unreclaimable? no
[691222.084886] lowmem_reserve[]: 0 0 0 0
[691222.084889] Node 0 DMA: 3*4kB 5*8kB 2*16kB 4*32kB 3*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 2*4096kB = 10388kB
[691222.084896] Node 0 DMA32: 30786*4kB 1013*8kB 8*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 131536kB
[691222.084903] Node 0 Normal: 51581*4kB 3097*8kB 97*16kB 1*32kB 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 233196kB
[691222.084909] 505004 total pagecache pages
[691222.084911] 24805 pages in swap cache
[691222.084913] Swap cache stats: add 1612596, delete 1587791, find 9746659/9806649
[691222.084915] Free swap  = 1372880kB
[691222.084916] Total swap = 1959672kB
[691222.089355] 2064384 pages RAM
[691222.089355] 69249 pages reserved
[691222.089355] 1139719 pages shared
[691222.089355] 871490 pages non-shared
[691222.128294] sshd: page allocation failure. order:3, mode:0x20
[691222.128297] Pid: 7690, comm: sshd Tainted: P           2.6.29-2-amd64 #1
[691222.128299] Call Trace:
[691222.128305]  [<ffffffff8029483d>] __alloc_pages_internal+0x3ff/0x422
[691222.128309]  [<ffffffff802b86ea>] kmem_getpages+0x6c/0x12f
[691222.128312]  [<ffffffff802b8f90>] fallback_alloc+0x152/0x1cd
[691222.128315]  [<ffffffff802b8858>] kmem_cache_alloc_node+0xab/0xdf
[691222.128318]  [<ffffffff803fbaa3>] __alloc_skb+0x66/0x125
[691222.128342]  [<ffffffff803fc31d>] skb_copy+0x30/0x96
[691222.128351]  [<ffffffffa077f4ec>] vboxNetFltLinuxPacketHandler+0x40/0x95 [vboxnetflt]
[691222.128355]  [<ffffffff804024b0>] dev_hard_start_xmit+0x135/0x267
[691222.128358]  [<ffffffff80413b00>] __qdisc_run+0xe4/0x1e8
[691222.128361]  [<ffffffff80402a3a>] dev_queue_xmit+0x357/0x457
[691222.128364]  [<ffffffff80427215>] ip_queue_xmit+0x2cf/0x32a
[691222.128368]  [<ffffffff802ca689>] __pollwait+0x0/0xce
[691222.128371]  [<ffffffff8029e431>] zone_statistics+0x3c/0x5f
[691222.128375]  [<ffffffff80437787>] tcp_transmit_skb+0x624/0x663
[691222.128377]  [<ffffffff80439c67>] tcp_write_xmit+0x862/0x95a
[691222.128380]  [<ffffffff80439dac>] __tcp_push_pending_frames+0x22/0x53
[691222.128383]  [<ffffffff8042edbd>] tcp_sendmsg+0x77c/0x878
[691222.128386]  [<ffffffff803f445e>] sock_aio_write+0xd8/0xe3
[691222.128389]  [<ffffffff802bd31c>] do_sync_write+0xce/0x113
[691222.128394]  [<ffffffff8020f9be>] __switch_to+0x3bb/0x3cd
[691222.128397]  [<ffffffff80255f4e>] autoremove_wake_function+0x0/0x2e
[691222.128401]  [<ffffffff80227d1d>] __ticket_spin_lock+0x9/0x1b
[691222.128404]  [<ffffffff802bdb8a>] vfs_write+0xbc/0x102
[691222.128407]  [<ffffffff804799d9>] _spin_lock_irq+0xd/0xf
[691222.128409]  [<ffffffff802bdc8c>] sys_write+0x45/0x6e
[691222.128413]  [<ffffffff802110aa>] system_call_fastpath+0x16/0x1b
[691222.128414] Mem-Info:
[691222.128415] Node 0 DMA per-cpu:
[691222.128418] CPU    0: hi:    0, btch:   1 usd:   0
[691222.128419] CPU    1: hi:    0, btch:   1 usd:   0
[691222.128421] CPU    2: hi:    0, btch:   1 usd:   0
[691222.128422] CPU    3: hi:    0, btch:   1 usd:   0
[691222.128424] Node 0 DMA32 per-cpu:
[691222.128426] CPU    0: hi:  186, btch:  31 usd: 165
[691222.128428] CPU    1: hi:  186, btch:  31 usd:  99
[691222.128429] CPU    2: hi:  186, btch:  31 usd: 161
[691222.128431] CPU    3: hi:  186, btch:  31 usd: 174
[691222.128432] Node 0 Normal per-cpu:
[691222.128434] CPU    0: hi:  186, btch:  31 usd: 156
[691222.128436] CPU    1: hi:  186, btch:  31 usd: 168
[691222.128437] CPU    2: hi:  186, btch:  31 usd: 176
[691222.128439] CPU    3: hi:  186, btch:  31 usd: 115
[691222.128442] Active_anon:423366 active_file:242194 inactive_anon:93480
[691222.128443]  inactive_file:226743 unevictable:761692 dirty:5232 writeback:0 unstable:0
[691222.128444]  free:94741 slab:109897 mapped:49010 pagetables:8652 bounce:0
[691222.128446] Node 0 DMA free:10388kB min:12kB low:12kB high:16kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:9252kB pages_scanned:0 all_unreclaimable? yes
[691222.128451] lowmem_reserve[]: 0 2871 7921 7921
[691222.128454] Node 0 DMA32 free:132312kB min:4124kB low:5152kB high:6184kB active_anon:948588kB inactive_anon:249768kB active_file:65464kB inactive_file:104264kB unevictable:1161264kB present:2940064kB pages_scanned:0 all_unreclaimable? no
[691222.128459] lowmem_reserve[]: 0 0 5050 5050
[691222.128462] Node 0 Normal free:236264kB min:7256kB low:9068kB high:10884kB active_anon:744876kB inactive_anon:124152kB active_file:903312kB inactive_file:802708kB unevictable:1885504kB present:5171200kB pages_scanned:0 all_unreclaimable? no
[691222.128467] lowmem_reserve[]: 0 0 0 0
[691222.128470] Node 0 DMA: 3*4kB 5*8kB 2*16kB 4*32kB 3*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 2*4096kB = 10388kB
[691222.128477] Node 0 DMA32: 30940*4kB 1029*8kB 8*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 132280kB
[691222.128483] Node 0 Normal: 52065*4kB 3257*8kB 113*16kB 1*32kB 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 236668kB
[691222.128490] 504062 total pagecache pages
[691222.128492] 24839 pages in swap cache
[691222.128494] Swap cache stats: add 1612707, delete 1587868, find 9746659/9806652
[691222.128495] Free swap  = 1372700kB
[691222.128497] Total swap = 1959672kB
[691222.131868] 2064384 pages RAM
[691222.131868] 69249 pages reserved
[691222.131868] 1139248 pages shared
[691222.131868] 871319 pages non-shared

Re: Kernel crash ??

Posted: 28. May 2009, 23:28
by Sasquatch
So, it barfs when using Bridged. Any more info you can give us? Check the Forum Posting Guide for what we need.

Re: Kernel crash ??

Posted: 29. May 2009, 03:29
by KeyzerSuze
Sasquatch wrote:So, it barfs when using Bridged. Any more info you can give us? Check the Forum Posting Guide for what we need.

Hi

I have the latest debian package from your repo, I have 3 virtual machines
debi386 machine doing nothing
debi336 doing a build of openwrt trunk - src tree accessed via nfs mounted src tree (from the host machine)
debamd64 machine do a debian build - very small package - collectd

I am using amd-v for all the vm, + sata + 1G nics

Re: Kernel crash ??

Posted: 23. Jun 2009, 15:19
by mtorromeo
I'm having the same issue on an ArchLinux 64 bit host. VirtualBox PUEL 2.2.4.
All virtual hosts running on a bridged interface. The host machine has 6 network interfaces, all of which are bridged.

Code: Select all

$> uname -a
Linux jupiter 2.6.29-ARCH #1 SMP PREEMPT Wed May 20 06:42:43 UTC 2009 x86_64 Intel(R) Xeon(R) CPU E5405 @ 2.00GHz GenuineIntel GNU/Linux
The problem seems to occur when the internet connection drops.

Code: Select all

ksoftirqd/0: page allocation failure. order:0, mode:0x4020
Pid: 4, comm: ksoftirqd/0 Not tainted 2.6.29-ARCH #1
Call Trace:
 <IRQ>  [<ffffffff8029dd6c>] __alloc_pages_internal+0x3cc/0x480
 [<ffffffff804152ee>] skb_copy+0x2e/0x90
 [<ffffffff802c6489>] __slab_alloc+0x6b9/0x800
 [<ffffffff804b4bc5>] _spin_lock+0x15/0x20
 [<ffffffff804152ee>] skb_copy+0x2e/0x90
 [<ffffffff802c7a2a>] __kmalloc_track_caller+0x12a/0x140
 [<ffffffff804b4bc5>] _spin_lock+0x15/0x20
 [<ffffffff8041492f>] __alloc_skb+0x6f/0x150
 [<ffffffff804152ee>] skb_copy+0x2e/0x90
 [<ffffffffa0338709>] vboxNetFltLinuxPacketHandler+0x59/0xd0 [vboxnetflt]
 [<ffffffff8041b2f0>] netif_receive_skb+0x0/0x5f0
 [<ffffffff8041b5b1>] netif_receive_skb+0x2c1/0x5f0
 [<ffffffffa0189050>] br_handle_frame_finish+0x190/0x1a0 [bridge]
 [<ffffffffa018e218>] br_nf_pre_routing_finish+0x2e8/0x3d0 [bridge]
 [<ffffffff8043c786>] nf_hook_slow+0xb6/0x120
 [<ffffffffa018df30>] br_nf_pre_routing_finish+0x0/0x3d0 [bridge]
 [<ffffffffa018e9e5>] br_nf_pre_routing+0x6e5/0x840 [bridge]
 [<ffffffff8043c686>] nf_iterate+0x66/0xb0
 [<ffffffffa0188ec0>] br_handle_frame_finish+0x0/0x1a0 [bridge]
 [<ffffffff8043c786>] nf_hook_slow+0xb6/0x120
 [<ffffffffa0188ec0>] br_handle_frame_finish+0x0/0x1a0 [bridge]
 [<ffffffffa0189214>] br_handle_frame+0x1b4/0x250 [bridge]
 [<ffffffff8041b4bb>] netif_receive_skb+0x1cb/0x5f0
 [<ffffffffa013f1d0>] bnx2_poll_work+0xc90/0x1290 [bnx2]
 [<ffffffffa0174fde>] e1000_clean_rx_irq+0x23e/0x3b0 [e1000e]
 [<ffffffff802352f8>] enqueue_task+0x18/0x60
 [<ffffffffa013f8f3>] bnx2_poll+0x63/0x26c [bnx2]
 [<ffffffff80419a31>] net_rx_action+0x131/0x210
 [<ffffffff80247a0a>] __do_softirq+0x9a/0x140
 [<ffffffff8020da5c>] call_softirq+0x1c/0x30
 <EOI>  [<ffffffff8020f5bd>] do_softirq+0x4d/0x90
 [<ffffffff802472dc>] ksoftirqd+0x9c/0x1f0
 [<ffffffff80247240>] ksoftirqd+0x0/0x1f0
 [<ffffffff80258cf7>] kthread+0x47/0x90
 [<ffffffff8020d95a>] child_rip+0xa/0x20
 [<ffffffff80258cb0>] kthread+0x0/0x90
 [<ffffffff8020d950>] child_rip+0x0/0x20
Mem-Info:
DMA per-cpu:
CPU    0: hi:    0, btch:   1 usd:   0
CPU    1: hi:    0, btch:   1 usd:   0
CPU    2: hi:    0, btch:   1 usd:   0
CPU    3: hi:    0, btch:   1 usd:   0
CPU    4: hi:    0, btch:   1 usd:   0
CPU    5: hi:    0, btch:   1 usd:   0
CPU    6: hi:    0, btch:   1 usd:   0
CPU    7: hi:    0, btch:   1 usd:   0
DMA32 per-cpu:
CPU    0: hi:  186, btch:  31 usd:  33
CPU    1: hi:  186, btch:  31 usd:  49
CPU    2: hi:  186, btch:  31 usd: 131
CPU    3: hi:  186, btch:  31 usd:  99
CPU    4: hi:  186, btch:  31 usd:  96
CPU    5: hi:  186, btch:  31 usd: 144
CPU    6: hi:  186, btch:  31 usd: 118
CPU    7: hi:  186, btch:  31 usd:  49
Normal per-cpu:
CPU    0: hi:  186, btch:  31 usd: 185
CPU    1: hi:  186, btch:  31 usd: 173
CPU    2: hi:  186, btch:  31 usd: 190
CPU    3: hi:  186, btch:  31 usd: 195
CPU    4: hi:  186, btch:  31 usd: 188
CPU    5: hi:  186, btch:  31 usd: 164
CPU    6: hi:  186, btch:  31 usd: 177
CPU    7: hi:  186, btch:  31 usd: 171
Active_anon:2194258 active_file:4589 inactive_anon:219538
 inactive_file:16901 unevictable:479 dirty:133 writeback:0 unstable:0
 free:17086 slab:1580329 mapped:57120 pagetables:5742 bounce:0
DMA free:10600kB min:8kB low:8kB high:12kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB present:9636kB pages_scanned:0 all_unreclaimable? yes
lowmem_reserve[]: 0 2995 16125 16125
DMA32 free:52980kB min:3016kB low:3768kB high:4524kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:128kB unevictable:0kB present:3067424kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 13130 13130
Normal free:4764kB min:13228kB low:16532kB high:19840kB active_anon:8777032kB inactive_anon:878152kB active_file:18356kB inactive_file:67476kB unevictable:1916kB present:13445120kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 0 0
DMA: 2*4kB 2*8kB 3*16kB 3*32kB 5*64kB 3*128kB 2*256kB 2*512kB 2*1024kB 1*2048kB 1*4096kB = 10600kB
DMA32: 3*4kB 843*8kB 19*16kB 4*32kB 1*64kB 1*128kB 5*256kB 4*512kB 5*1024kB 4*2048kB 7*4096kB = 52692kB
Normal: 965*4kB 11*8kB 2*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3980kB
21942 total pagecache pages
0 pages in swap cache
Swap cache stats: add 7, delete 7, find 0/0
Free swap  = 8388600kB
Total swap = 8388600kB
4456448 pages RAM
404199 pages reserved
2388988 pages shared
1651160 pages non-shared
The host has 16G ram and 8G swap, and at runtime, with all the vms running, this is the memory situation:

Code: Select all

$> free
             total       used       free     shared    buffers     cached
Mem:      16431716   11196824    5234892          0      19324    1165336
-/+ buffers/cache:   10012164    6419552
Swap:      8388600      75600    8313000

Re: Kernel crash ??

Posted: 23. Jun 2009, 23:40
by KeyzerSuze
I think my problem was I had upgrade my kernel (debian amd64) only a minor version update - same ABI - but I have recompiled the kernel module and haven't had any more problems.
All times are UTC+02:00
Page 1 of 1

Powered by phpBB® Forum Software © phpBB Limited