Ubuntu 14 Server VirtualBox 5.0 (VERR_NO_MEMORY)
Posted: 29. Mar 2016, 17:19
I have a Ubuntu Server running 14.04 VirtualBox 5.0.16r105871 which is also running an appliance called M3VMREP2 which is a mysql replication server. During peek transactions the appliance stops at a state of "VERR_NO_MEMORY)".
I have applied several recommendations dealing with CPU allocation and rechecked the memory usage which is well within the total available. Yet the server still consistently crashes at a state of "Guru Meditation -8 (VERR_NO_MEMORY)".
Below is yesterdays crash file. I am hoping someone can see something that I have overlooked. Any assistance would be appreciated.
showvminfo Summary:
VBox.log - Summary - (full Vbox.log is attached)
I have applied several recommendations dealing with CPU allocation and rechecked the memory usage which is well within the total available. Yet the server still consistently crashes at a state of "Guru Meditation -8 (VERR_NO_MEMORY)".
Below is yesterdays crash file. I am hoping someone can see something that I have overlooked. Any assistance would be appreciated.
showvminfo Summary:
Code: Select all
appliance@A105:~$ VBoxManage showvminfo M3VMREP2v5
Name: M3VMREP2v5
Guest OS: Ubuntu (64-bit)
Memory size: 131072MB
Page Fusion: off
CPU exec cap: 100%
HPET: off
Chipset: piix3
Firmware: BIOS
Number of CPUs: 24
PAE: on
Long Mode: on
ACPI: on
IOAPIC: on
Hardw. virt.ext: on
Nested Paging: on
Large Pages: off
VT-x VPID: on
VT-x unr. exec.: on
Paravirt. Provider: Default
State: guru meditation (since 2016-03-24T13:17:10.009000000)
NIC 1: MAC: 080027186761, Attachment: Bridged Interface 'em1', Cable connected: on, Trace: off (file: none), Type: 82540EM, Reported speed: 0 Mbps, Boot priority: 0, Promisc Policy: deny, Bandwidth group: none
Session name: headless
Guest:
Configured memory balloon size: 0 MB
OS type: Linux26_64
Additions run level: 2
Additions version: 5.0.16 r105871Code: Select all
VirtualBox VM 5.0.16 r105871 linux.amd64 (Mar 4 2016 17:23:12) release log
00:00:00.087948 Log opened 2016-03-23T23:32:31.556958000Z
00:00:00.087949 Build Type: release
00:00:00.087952 OS Product: Linux
00:00:00.087954 OS Release: 3.19.0-25-generic
00:00:00.087954 OS Version: #26~14.04.1-Ubuntu SMP Fri Jul 24 21:16:20 UTC 2015
00:00:00.087985 DMI Product Name: PowerEdge R815
00:00:00.088617 Host RAM: 515982MB total, 322564MB available
00:00:00.088620 Executable: /usr/lib/virtualbox/VBoxHeadless
00:00:00.088622 Package type: LINUX_64BITS_UBUNTU_14_04
00:00:00.093093 Oracle VM VirtualBox Extension Pack (Version: 5.0.12 r104815; VRDE Module: VBoxVRDP)
00:00:00.160481 ************************* CFGM dump *************************
00:00:00.160535 Name <string> = "M3VMREP2v5" (cb=11)
00:00:00.160536 NumCPUs <integer> = 0x0000000000000018 (24)
00:00:00.160541 RamHoleSize <integer> = 0x0000000020000000 (536 870 912, 512 MB)
00:00:00.160543 RamSize <integer> = 0x0000002000000000 (137 438 953 472, 128 GB)
00:00:00.160593
00:00:00.161259 ********************* End of CFGM dump **********************
00:39:33.943820 VMMDev: GuestHeartBeat: Guest is alive (gone 4 006 452 577 ns)
...
01:19:45.214854 TM: Giving up catch-up attempt at a 60 001 359 799 ns lag; new total: 120 001 982 980 ns
01:47:42.540044 TM: Giving up catch-up attempt at a 60 001 760 745 ns lag; new total: 180 003 743 725 ns
02:19:02.613007 TM: Giving up catch-up attempt at a 60 000 088 523 ns lag; new total: 240 003 832 248 ns
03:07:47.359824 TM: Giving up catch-up attempt at a 60 000 874 613 ns lag; new total: 300 004 706 861 ns
03:16:40.474830 TM: Giving up catch-up attempt at a 60 001 920 471 ns lag; new total: 360 006 627 332 ns
06:27:52.296088 TM: Giving up catch-up attempt at a 60 001 830 509 ns lag; new total: 420 008 457 841 ns
06:47:49.683983 TM: Giving up catch-up attempt at a 60 000 516 561 ns lag; new total: 480 008 974 402 ns
07:12:29.466001 TM: Giving up catch-up attempt at a 60 000 579 460 ns lag; new total: 540 009 553 862 ns
08:16:32.295741 TM: Giving up catch-up attempt at a 60 004 103 336 ns lag; new total: 600 013 657 198 ns
09:24:12.085396 TM: Giving up catch-up attempt at a 60 001 294 962 ns lag; new total: 660 014 952 160 ns
09:27:04.865949 TM: Giving up catch-up attempt at a 60 000 233 146 ns lag; new total: 720 015 185 306 ns
09:31:57.280995 TM: Giving up catch-up attempt at a 60 000 088 562 ns lag; new total: 780 015 273 868 ns
12:15:24.693765 TM: Giving up catch-up attempt at a 60 000 210 208 ns lag; new total: 840 015 484 076 ns
12:19:00.189717 TM: Giving up catch-up attempt at a 60 000 888 481 ns lag; new total: 900 016 372 557 ns
12:22:04.883686 TM: Giving up catch-up attempt at a 60 003 131 093 ns lag; new total: 960 019 503 650 ns
12:25:44.063559 TM: Giving up catch-up attempt at a 60 000 521 977 ns lag; new total: 1 020 020 025 627 ns
12:30:41.242579 TM: Giving up catch-up attempt at a 60 001 650 030 ns lag; new total: 1 080 021 675 657 ns
12:36:26.087012 TM: Giving up catch-up attempt at a 60 003 981 076 ns lag; new total: 1 140 025 656 733 ns
12:39:12.893385 TM: Giving up catch-up attempt at a 60 000 271 665 ns lag; new total: 1 200 025 928 398 ns
12:42:53.518366 TM: Giving up catch-up attempt at a 60 012 324 950 ns lag; new total: 1 260 038 253 348 ns
12:45:51.609031 TM: Giving up catch-up attempt at a 60 000 303 321 ns lag; new total: 1 320 038 556 669 ns
12:50:54.529809 TM: Giving up catch-up attempt at a 60 003 808 929 ns lag; new total: 1 380 042 365 598 ns
...
13:44:36.914795 AssertLogRel /home/vbox/vbox-5.0.16/src/VBox/VMM/VMMR3/PGMPhys.cpp(4367) int PGMR3PhysAllocateHandyPages(PVM): RT_SUCCESS(rc)
13:44:36.914847 100/128: idPage=0x5650000 HCPhysGCPhys=000000502f4c8000 rc=VERR_NO_MEMORY
...
13:44:37.092409 AssertLogRel /home/vbox/vbox-5.0.16/src/VBox/VMM/VMMR3/PGMPhys.cpp(4367) int PGMR3PhysAllocateHandyPages(PVM): RT_SUCCESS(rc)
13:44:37.092432 8/128: idPage=0x565001c HCPhysGCPhys=000000502f4e4000 rc=VERR_NO_MEMORY
...
13:44:37.486293 AssertLogRel /home/vbox/vbox-5.0.16/src/VBox/VMM/VMMR3/PGMPhys.cpp(4367) int PGMR3PhysAllocateHandyPages(PVM): RT_SUCCESS(rc)
13:44:37.486334 60/128: idPage=0x5650634 HCPhysGCPhys=00000066ac6d6000 rc=VERR_NO_MEMORY
13:44:37.486400 !! Guru Meditation -8 (VERR_NO_MEMORY)
...
13:47:30.105659 emR3Debug: rc=VINF_EM_TRIPLE_FAULT