Shared Folder traffic causes linux stack dump

Discussions related to using VirtualBox on Solaris hosts.
Post Reply
User Not Found
Posts: 4
Joined: 24. Aug 2020, 02:43

Shared Folder traffic causes linux stack dump

Post by User Not Found »

Host is Solaris 11.3. (Oracle Solaris 11.3.9.4.0)
ZFS pool shared to Linux Guest using VirtualBox Shared Folder.
Tested with VirtualBox 6.1.0, 6.1.6, 6.1.12 (all with extension packs).

/mnt/ztank is the Shared Folder via VirtualBox setting
/workingpool is a zpool from 5 12TB drives that are passthrough to the guest.

I run rsync from /mnt/ztank to /workingpool and after 100GB to 500GB of traffic, I get a kernel stack dump. Every time.

-----Virtualbox showvminfo-----

Code: Select all

Name:                        proxmox
Groups:                      /
Guest OS:                    Debian (64-bit)
UUID:                        3f8f63fd-f8fe-4ccf-b919-d48cda63587b
Config file:                 /home/tai/VirtualBox VMs/proxmox/proxmox.vbox
Snapshot folder:             /home/tai/VirtualBox VMs/proxmox/Snapshots
Log folder:                  /home/tai/VirtualBox VMs/proxmox/Logs
Hardware UUID:               3f8f63fd-f8fe-4ccf-b919-d48cda63587b
Memory size                  16384MB
Page Fusion:                 disabled
VRAM size:                   16MB
CPU exec cap:                100%
HPET:                        disabled
CPUProfile:                  host
Chipset:                     piix3
Firmware:                    BIOS
Number of CPUs:              6
PAE:                         disabled
Long Mode:                   enabled
Triple Fault Reset:          disabled
APIC:                        enabled
X2APIC:                      enabled
Nested VT-x/AMD-V:           disabled
CPUID Portability Level:     0
CPUID overrides:             None
Boot menu mode:              message and menu
Boot Device 1:               DVD
Boot Device 2:               HardDisk
Boot Device 3:               Not Assigned
Boot Device 4:               Not Assigned
ACPI:                        enabled
IOAPIC:                      enabled
BIOS APIC mode:              APIC
Time offset:                 0ms
RTC:                         UTC
Hardware Virtualization:     enabled
Nested Paging:               enabled
Large Pages:                 enabled
VT-x VPID:                   enabled
VT-x Unrestricted Exec.:     enabled
Paravirt. Provider:          Default
Effective Paravirt. Prov.:   KVM
State:                       running (since 2020-08-24T04:14:04.221000000)
Graphics Controller:         VMSVGA
Monitor count:               1
3D Acceleration:             disabled
Teleporter Enabled:          disabled
Teleporter Port:             0
Teleporter Address:          
Teleporter Password:         
Tracing Enabled:             disabled
Allow Tracing to Access VM:  disabled
Tracing Configuration:       
Autostart Enabled:           disabled
Autostart Delay:             0
Default Frontend:            
VM process priority:         default
Storage Controller Name (0):            IDE
Storage Controller Type (0):            PIIX4
Storage Controller Instance Number (0): 0
Storage Controller Max Port Count (0):  2
Storage Controller Port Count (0):      2
Storage Controller Bootable (0):        on
Storage Controller Name (1):            SATA
Storage Controller Type (1):            IntelAhci
Storage Controller Instance Number (1): 0
Storage Controller Max Port Count (1):  30
Storage Controller Port Count (1):      6
Storage Controller Bootable (1):        on
IDE (1, 0): /opt/VirtualBox/VBoxGuestAdditions.iso (UUID: 9cee0d89-79dc-4574-8e95-6def706dcf31)
SATA (0, 0): /home/tai/VirtualBox VMs/proxmox/proxmox.vdi (UUID: fd3996f4-338b-4737-b53a-ea5543415aef)
SATA (1, 0): /home/tai/VirtualBox VMs/proxmox/disk1.vmdk (UUID: 763b5fdf-756b-4392-be4b-d64c5b1a1efb)
SATA (2, 0): /home/tai/VirtualBox VMs/proxmox/disk2.vmdk (UUID: 1c3e38d4-14a5-4a7b-947c-6c1612827116)
SATA (3, 0): /home/tai/VirtualBox VMs/proxmox/disk3.vmdk (UUID: ed2ac9d3-9b09-4a78-add9-8dfbe6e29f2b)
SATA (4, 0): /home/tai/VirtualBox VMs/proxmox/disk4.vmdk (UUID: 62295067-20e8-4332-9078-ef549fc159a3)
SATA (5, 0): /home/tai/VirtualBox VMs/proxmox/disk5.vmdk (UUID: e9439a23-1548-4603-be77-85004fd86c77)
NIC 1:                       MAC: 08002722A860, Attachment: Bridged Interface 'net0 - Ethernet', Cable connected: on, Trace: off (file: none), Type: 82540EM, Reported speed: 0 Mbps, Boot priority: 0, Promisc Policy: deny, Bandwidth group: none
NIC 2:                       disabled
NIC 3:                       disabled
NIC 4:                       disabled
NIC 5:                       disabled
NIC 6:                       disabled
NIC 7:                       disabled
NIC 8:                       disabled
Pointing Device:             USB Tablet
Keyboard Device:             PS/2 Keyboard
UART 1:                      disabled
UART 2:                      disabled
UART 3:                      disabled
UART 4:                      disabled
LPT 1:                       disabled
LPT 2:                       disabled
Audio:                       enabled (Driver: OSS, Controller: AC97, Codec: AD1980)
Audio playback:              enabled
Audio capture:               enabled
Clipboard Mode:              disabled
Drag and drop Mode:          disabled
Session name:                headless
Video mode:                  800x600x32 at 0,0 enabled
VRDE:                        disabled
OHCI USB:                    enabled
EHCI USB:                    enabled
xHCI USB:                    disabled

USB Device Filters:

<none>

Available remote USB devices:

<none>

Currently Attached USB Devices:

<none>

Bandwidth groups:  <none>

Shared folders:

Name: 'ztank', Host path: '/ztank' (machine mapping), writable, auto-mount, mount-point: '/mnt/ztank'

VRDE Connection:             not active
Clients so far:              0

Capturing:                   not active
Capture audio:               not active
Capture screens:             0
Capture file:                /home/tai/VirtualBox VMs/proxmox/proxmox.webm
Capture dimensions:          1024x768
Capture rate:                512kbps
Capture FPS:                 25kbps
Capture options:             

Guest:

Configured memory balloon size: 0MB
OS type:                     Linux26_64
Additions run level:         2
Additions version:           6.1.6 r137129

Guest Facilities:

Facility "VirtualBox Base Driver": active/running (last update: 2020/08/24 04:14:29 UTC)
Facility "VirtualBox System Service": active/running (last update: 2020/08/24 04:14:47 UTC)
Facility "Seamless Mode": not active (last update: 2020/08/24 04:14:29 UTC)
Facility "Graphics Mode": not active (last update: 2020/08/24 04:14:29 UTC)
---------------------------------------------------
dmesg in a followup.
User Not Found
Posts: 4
Joined: 24. Aug 2020, 02:43

Re: Shared Folder traffic causes linux stack dump

Post by User Not Found »

unable to post system dmesg because I'm a new member. Hopefully the part with the stack dump can be posted below.
--------

Code: Select all

[   24.782150] 23:33:34.759362 main     VBoxService 6.1.6 r137129 (verbosity: 0) linux.amd64 (Apr  9 2020 19:52:18) release log
               23:33:34.759367 main     Log opened 2020-08-22T23:33:34.759337000Z
[   24.782235] 23:33:34.759575 main     OS Product: Linux
[   24.782281] 23:33:34.759629 main     OS Release: 5.4.34-1-pve
[   24.782322] 23:33:34.759675 main     OS Version: #1 SMP PVE 5.4.34-2 (Thu, 07 May 2020 10:02:02 +0200)
[   24.782423] 23:33:34.759727 main     Executable: /opt/VBoxGuestAdditions-6.1.6/sbin/VBoxService
               23:33:34.759728 main     Process ID: 1961
               23:33:34.759729 main     Package type: LINUX_64BITS_GENERIC
[   24.783868] 23:33:34.761196 main     6.1.6 r137129 started. Verbose level = 0
[   24.785170] 23:33:34.762472 main     vbglR3GuestCtrlDetectPeekGetCancelSupport: Supported (#1)
[   24.801784] vboxsf: g_fHostFeatures=0x8000000f g_fSfFeatures=0x1 g_uSfLastFunction=29
[   24.801943] vboxsf: Successfully loaded version 6.1.6
[   24.802024] vboxsf: Successfully loaded version 6.1.6 on 5.4.34-1-pve SMP mod_unload modversions  (LINUX_VERSION_CODE=0x50422)
[   24.803223] 23:33:34.780523 automount vbsvcAutomounterMountIt: Successfully mounted 'ztank' on '/mnt/ztank'
[ 4950.536357] hrtimer: interrupt took 38371205 ns
[27778.790478] INFO: task rsync:19916 blocked for more than 120 seconds.
[27778.790521]       Tainted: P           OE     5.4.34-1-pve #1
[27778.790553] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27778.790597] rsync           D    0 19916  18951 0x00004000
[27778.790599] Call Trace:
[27778.790606]  __schedule+0x2e6/0x700
[27778.790608]  schedule+0x33/0xa0
[27778.790632]  rtR0SemEventMultiLnxWait.isra.35+0x1a8/0x1f0 [vboxguest]
[27778.790635]  ? wait_woken+0x80/0x80
[27778.790645]  VBoxGuest_RTSemEventMultiWaitEx+0xe/0x10 [vboxguest]
[27778.790655]  VBoxGuest_RTSemEventMultiWait+0x28/0x30 [vboxguest]
[27778.790663]  vgdrvHgcmAsyncWaitCallbackWorker+0xda/0x210 [vboxguest]
[27778.790672]  VGDrvCommonIoCtl+0x8bb/0x1a70 [vboxguest]
[27778.790680]  VBoxGuestIDC+0x149/0x160 [vboxguest]
[27778.790684]  VbglR0IdcCallRaw+0x13/0x20 [vboxsf]
[27778.790687]  VbglR0HGCMFastCall+0x1c/0x20 [vboxsf]
[27778.790689]  vbsf_reg_open+0x25f/0x4d0 [vboxsf]
[27778.790692]  ? vbsf_linux_oflags_to_vbox+0xb0/0xb0 [vboxsf]
[27778.790694]  do_dentry_open+0x143/0x3a0
[27778.790696]  vfs_open+0x2d/0x30
[27778.790698]  path_openat+0x2e9/0x16f0
[27778.790777]  ? zpl_write_common_iovec+0x90/0xf0 [zfs]
[27778.790780]  do_filp_open+0x93/0x100
[27778.790782]  ? __alloc_fd+0xb2/0x150
[27778.790784]  do_sys_open+0x177/0x280
[27778.790786]  __x64_sys_openat+0x20/0x30
[27778.790788]  do_syscall_64+0x57/0x190
[27778.790790]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[27778.790792] RIP: 0033:0x7fa04c5f81ae
[27778.790797] Code: Bad RIP value.
[27778.790798] RSP: 002b:00007ffff0dde2b0 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[27778.790800] RAX: ffffffffffffffda RBX: 000055974ad37558 RCX: 00007fa04c5f81ae
[27778.790801] RDX: 0000000000000000 RSI: 00007ffff0dde430 RDI: 00000000ffffff9c
[27778.790801] RBP: 00000000000fb24d R08: 000000000000fffc R09: 00007ffff0dde39c
[27778.790802] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffff0dde430
[27778.790803] R13: 0000559745480285 R14: 000055974af0f1f0 R15: 0000000000000004
[27899.591703] INFO: task rsync:19916 blocked for more than 241 seconds.
[27899.591747]       Tainted: P           OE     5.4.34-1-pve #1
[27899.591779] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27899.591821] rsync           D    0 19916  18951 0x00004000
[27899.591823] Call Trace:
[27899.591831]  __schedule+0x2e6/0x700
[27899.591834]  schedule+0x33/0xa0
[27899.591853]  rtR0SemEventMultiLnxWait.isra.35+0x1a8/0x1f0 [vboxguest]
[27899.591855]  ? wait_woken+0x80/0x80
[27899.591865]  VBoxGuest_RTSemEventMultiWaitEx+0xe/0x10 [vboxguest]
[27899.591875]  VBoxGuest_RTSemEventMultiWait+0x28/0x30 [vboxguest]
[27899.591898]  vgdrvHgcmAsyncWaitCallbackWorker+0xda/0x210 [vboxguest]
[27899.591908]  VGDrvCommonIoCtl+0x8bb/0x1a70 [vboxguest]
[27899.591916]  VBoxGuestIDC+0x149/0x160 [vboxguest]
[27899.591922]  VbglR0IdcCallRaw+0x13/0x20 [vboxsf]
[27899.591925]  VbglR0HGCMFastCall+0x1c/0x20 [vboxsf]
[27899.591927]  vbsf_reg_open+0x25f/0x4d0 [vboxsf]
[27899.591930]  ? vbsf_linux_oflags_to_vbox+0xb0/0xb0 [vboxsf]
[27899.591932]  do_dentry_open+0x143/0x3a0
[27899.591934]  vfs_open+0x2d/0x30
[27899.591936]  path_openat+0x2e9/0x16f0
[27899.592017]  ? zpl_write_common_iovec+0x90/0xf0 [zfs]
[27899.592020]  do_filp_open+0x93/0x100
[27899.592022]  ? __alloc_fd+0xb2/0x150
[27899.592023]  do_sys_open+0x177/0x280
[27899.592025]  __x64_sys_openat+0x20/0x30
[27899.592027]  do_syscall_64+0x57/0x190
[27899.592029]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[27899.592031] RIP: 0033:0x7fa04c5f81ae
[27899.592037] Code: Bad RIP value.
[27899.592038] RSP: 002b:00007ffff0dde2b0 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[27899.592039] RAX: ffffffffffffffda RBX: 000055974ad37558 RCX: 00007fa04c5f81ae
[27899.592040] RDX: 0000000000000000 RSI: 00007ffff0dde430 RDI: 00000000ffffff9c
[27899.592041] RBP: 00000000000fb24d R08: 000000000000fffc R09: 00007ffff0dde39c
[27899.592042] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffff0dde430
[27899.592043] R13: 0000559745480285 R14: 000055974af0f1f0 R15: 0000000000000004
[28020.441941] INFO: task rsync:19916 blocked for more than 362 seconds.
[28020.441984]       Tainted: P           OE     5.4.34-1-pve #1
[28020.442030] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[28020.442073] rsync           D    0 19916  18951 0x00004000
[28020.442075] Call Trace:
[28020.442083]  __schedule+0x2e6/0x700
[28020.442085]  schedule+0x33/0xa0
[28020.442104]  rtR0SemEventMultiLnxWait.isra.35+0x1a8/0x1f0 [vboxguest]
[28020.442106]  ? wait_woken+0x80/0x80
[28020.442116]  VBoxGuest_RTSemEventMultiWaitEx+0xe/0x10 [vboxguest]
[28020.442126]  VBoxGuest_RTSemEventMultiWait+0x28/0x30 [vboxguest]
[28020.442134]  vgdrvHgcmAsyncWaitCallbackWorker+0xda/0x210 [vboxguest]
[28020.442143]  VGDrvCommonIoCtl+0x8bb/0x1a70 [vboxguest]
[28020.442164]  VBoxGuestIDC+0x149/0x160 [vboxguest]
[28020.442169]  VbglR0IdcCallRaw+0x13/0x20 [vboxsf]
[28020.442171]  VbglR0HGCMFastCall+0x1c/0x20 [vboxsf]
[28020.442174]  vbsf_reg_open+0x25f/0x4d0 [vboxsf]
[28020.442176]  ? vbsf_linux_oflags_to_vbox+0xb0/0xb0 [vboxsf]
[28020.442179]  do_dentry_open+0x143/0x3a0
[28020.442181]  vfs_open+0x2d/0x30
[28020.442183]  path_openat+0x2e9/0x16f0
[28020.442268]  ? zpl_write_common_iovec+0x90/0xf0 [zfs]
[28020.442271]  do_filp_open+0x93/0x100
[28020.442273]  ? __alloc_fd+0xb2/0x150
[28020.442275]  do_sys_open+0x177/0x280
[28020.442276]  __x64_sys_openat+0x20/0x30
[28020.442279]  do_syscall_64+0x57/0x190
[28020.442295]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[28020.442297] RIP: 0033:0x7fa04c5f81ae
[28020.442303] Code: Bad RIP value.
[28020.442304] RSP: 002b:00007ffff0dde2b0 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[28020.442305] RAX: ffffffffffffffda RBX: 000055974ad37558 RCX: 00007fa04c5f81ae
[28020.442306] RDX: 0000000000000000 RSI: 00007ffff0dde430 RDI: 00000000ffffff9c
[28020.442307] RBP: 00000000000fb24d R08: 000000000000fffc R09: 00007ffff0dde39c
[28020.442308] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffff0dde430
[28020.442308] R13: 0000559745480285 R14: 000055974af0f1f0 R15: 0000000000000004
[28141.255674] INFO: task rsync:19916 blocked for more than 483 seconds.
[28141.255718]       Tainted: P           OE     5.4.34-1-pve #1
[28141.255750] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[28141.255792] rsync           D    0 19916  18951 0x00004000
[28141.255795] Call Trace:
[28141.255802]  __schedule+0x2e6/0x700
[28141.255804]  schedule+0x33/0xa0
[28141.255823]  rtR0SemEventMultiLnxWait.isra.35+0x1a8/0x1f0 [vboxguest]
[28141.255827]  ? wait_woken+0x80/0x80
[28141.255836]  VBoxGuest_RTSemEventMultiWaitEx+0xe/0x10 [vboxguest]
[28141.255846]  VBoxGuest_RTSemEventMultiWait+0x28/0x30 [vboxguest]
[28141.255854]  vgdrvHgcmAsyncWaitCallbackWorker+0xda/0x210 [vboxguest]
[28141.255863]  VGDrvCommonIoCtl+0x8bb/0x1a70 [vboxguest]
[28141.255871]  VBoxGuestIDC+0x149/0x160 [vboxguest]
[28141.255876]  VbglR0IdcCallRaw+0x13/0x20 [vboxsf]
[28141.255878]  VbglR0HGCMFastCall+0x1c/0x20 [vboxsf]
[28141.255881]  vbsf_reg_open+0x25f/0x4d0 [vboxsf]
[28141.255883]  ? vbsf_linux_oflags_to_vbox+0xb0/0xb0 [vboxsf]
[28141.255887]  do_dentry_open+0x143/0x3a0
[28141.255888]  vfs_open+0x2d/0x30
[28141.255890]  path_openat+0x2e9/0x16f0
[28141.255991]  ? zpl_write_common_iovec+0x90/0xf0 [zfs]
[28141.255993]  do_filp_open+0x93/0x100
[28141.255996]  ? __alloc_fd+0xb2/0x150
[28141.255997]  do_sys_open+0x177/0x280
[28141.255998]  __x64_sys_openat+0x20/0x30
[28141.256000]  do_syscall_64+0x57/0x190
[28141.256002]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[28141.256005] RIP: 0033:0x7fa04c5f81ae
[28141.256009] Code: Bad RIP value.
[28141.256010] RSP: 002b:00007ffff0dde2b0 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[28141.256016] RAX: ffffffffffffffda RBX: 000055974ad37558 RCX: 00007fa04c5f81ae
[28141.256030] RDX: 0000000000000000 RSI: 00007ffff0dde430 RDI: 00000000ffffff9c
[28141.256031] RBP: 00000000000fb24d R08: 000000000000fffc R09: 00007ffff0dde39c
[28141.256032] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffff0dde430
[28141.256032] R13: 0000559745480285 R14: 000055974af0f1f0 R15: 0000000000000004
[28262.087967] INFO: task rsync:19916 blocked for more than 604 seconds.
[28262.088011]       Tainted: P           OE     5.4.34-1-pve #1
[28262.088054] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[28262.088097] rsync           D    0 19916  18951 0x00004000
[28262.088099] Call Trace:
[28262.088107]  __schedule+0x2e6/0x700
[28262.088109]  schedule+0x33/0xa0
[28262.088139]  rtR0SemEventMultiLnxWait.isra.35+0x1a8/0x1f0 [vboxguest]
[28262.088142]  ? wait_woken+0x80/0x80
[28262.088152]  VBoxGuest_RTSemEventMultiWaitEx+0xe/0x10 [vboxguest]
[28262.088162]  VBoxGuest_RTSemEventMultiWait+0x28/0x30 [vboxguest]
[28262.088171]  vgdrvHgcmAsyncWaitCallbackWorker+0xda/0x210 [vboxguest]
[28262.088179]  VGDrvCommonIoCtl+0x8bb/0x1a70 [vboxguest]
[28262.088188]  VBoxGuestIDC+0x149/0x160 [vboxguest]
[28262.088193]  VbglR0IdcCallRaw+0x13/0x20 [vboxsf]
[28262.088195]  VbglR0HGCMFastCall+0x1c/0x20 [vboxsf]
[28262.088210]  vbsf_reg_open+0x25f/0x4d0 [vboxsf]
[28262.088213]  ? vbsf_linux_oflags_to_vbox+0xb0/0xb0 [vboxsf]
[28262.088216]  do_dentry_open+0x143/0x3a0
[28262.088218]  vfs_open+0x2d/0x30
[28262.088220]  path_openat+0x2e9/0x16f0
[28262.088313]  ? zpl_write_common_iovec+0x90/0xf0 [zfs]
[28262.088317]  do_filp_open+0x93/0x100
[28262.088320]  ? __alloc_fd+0xb2/0x150
[28262.088321]  do_sys_open+0x177/0x280
[28262.088323]  __x64_sys_openat+0x20/0x30
[28262.088325]  do_syscall_64+0x57/0x190
[28262.088328]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[28262.088330] RIP: 0033:0x7fa04c5f81ae
[28262.088334] Code: Bad RIP value.
[28262.088335] RSP: 002b:00007ffff0dde2b0 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[28262.088338] RAX: ffffffffffffffda RBX: 000055974ad37558 RCX: 00007fa04c5f81ae
[28262.088339] RDX: 0000000000000000 RSI: 00007ffff0dde430 RDI: 00000000ffffff9c
[28262.088340] RBP: 00000000000fb24d R08: 000000000000fffc R09: 00007ffff0dde39c
[28262.088340] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffff0dde430
[28262.088341] R13: 0000559745480285 R14: 000055974af0f1f0 R15: 0000000000000004
[28382.919691] INFO: task rsync:19916 blocked for more than 724 seconds.
[28382.919737]       Tainted: P           OE     5.4.34-1-pve #1
[28382.919768] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[28382.919810] rsync           D    0 19916  18951 0x00004000
[28382.919813] Call Trace:
[28382.919820]  __schedule+0x2e6/0x700
[28382.919831]  schedule+0x33/0xa0
[28382.919848]  rtR0SemEventMultiLnxWait.isra.35+0x1a8/0x1f0 [vboxguest]
[28382.919851]  ? wait_woken+0x80/0x80
[28382.919859]  VBoxGuest_RTSemEventMultiWaitEx+0xe/0x10 [vboxguest]
[28382.919867]  VBoxGuest_RTSemEventMultiWait+0x28/0x30 [vboxguest]
[28382.919874]  vgdrvHgcmAsyncWaitCallbackWorker+0xda/0x210 [vboxguest]
[28382.919881]  VGDrvCommonIoCtl+0x8bb/0x1a70 [vboxguest]
[28382.919889]  VBoxGuestIDC+0x149/0x160 [vboxguest]
[28382.919892]  VbglR0IdcCallRaw+0x13/0x20 [vboxsf]
[28382.919894]  VbglR0HGCMFastCall+0x1c/0x20 [vboxsf]
[28382.919896]  vbsf_reg_open+0x25f/0x4d0 [vboxsf]
[28382.919899]  ? vbsf_linux_oflags_to_vbox+0xb0/0xb0 [vboxsf]
[28382.919901]  do_dentry_open+0x143/0x3a0
[28382.919903]  vfs_open+0x2d/0x30
[28382.919904]  path_openat+0x2e9/0x16f0
[28382.920018]  ? zpl_write_common_iovec+0x90/0xf0 [zfs]
[28382.920021]  do_filp_open+0x93/0x100
[28382.920023]  ? __alloc_fd+0xb2/0x150
[28382.920025]  do_sys_open+0x177/0x280
[28382.920027]  __x64_sys_openat+0x20/0x30
[28382.920029]  do_syscall_64+0x57/0x190
[28382.920031]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[28382.920033] RIP: 0033:0x7fa04c5f81ae
[28382.920038] Code: Bad RIP value.
[28382.920039] RSP: 002b:00007ffff0dde2b0 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[28382.920041] RAX: ffffffffffffffda RBX: 000055974ad37558 RCX: 00007fa04c5f81ae
[28382.920042] RDX: 0000000000000000 RSI: 00007ffff0dde430 RDI: 00000000ffffff9c
[28382.920042] RBP: 00000000000fb24d R08: 000000000000fffc R09: 00007ffff0dde39c
[28382.920043] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffff0dde430
[28382.920044] R13: 0000559745480285 R14: 000055974af0f1f0 R15: 0000000000000004
[28503.751611] INFO: task rsync:19916 blocked for more than 845 seconds.
[28503.751654]       Tainted: P           OE     5.4.34-1-pve #1
[28503.751698] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[28503.751740] rsync           D    0 19916  18951 0x00004000
[28503.751742] Call Trace:
[28503.751750]  __schedule+0x2e6/0x700
[28503.751764]  schedule+0x33/0xa0
[28503.751782]  rtR0SemEventMultiLnxWait.isra.35+0x1a8/0x1f0 [vboxguest]
[28503.751785]  ? wait_woken+0x80/0x80
[28503.751795]  VBoxGuest_RTSemEventMultiWaitEx+0xe/0x10 [vboxguest]
[28503.751805]  VBoxGuest_RTSemEventMultiWait+0x28/0x30 [vboxguest]
[28503.751813]  vgdrvHgcmAsyncWaitCallbackWorker+0xda/0x210 [vboxguest]
[28503.751821]  VGDrvCommonIoCtl+0x8bb/0x1a70 [vboxguest]
[28503.751841]  VBoxGuestIDC+0x149/0x160 [vboxguest]
[28503.751846]  VbglR0IdcCallRaw+0x13/0x20 [vboxsf]
[28503.751849]  VbglR0HGCMFastCall+0x1c/0x20 [vboxsf]
[28503.751851]  vbsf_reg_open+0x25f/0x4d0 [vboxsf]
[28503.751854]  ? vbsf_linux_oflags_to_vbox+0xb0/0xb0 [vboxsf]
[28503.751856]  do_dentry_open+0x143/0x3a0
[28503.751858]  vfs_open+0x2d/0x30
[28503.751860]  path_openat+0x2e9/0x16f0
[28503.751952]  ? zpl_write_common_iovec+0x90/0xf0 [zfs]
[28503.751955]  do_filp_open+0x93/0x100
[28503.751957]  ? __alloc_fd+0xb2/0x150
[28503.751959]  do_sys_open+0x177/0x280
[28503.751961]  __x64_sys_openat+0x20/0x30
[28503.751964]  do_syscall_64+0x57/0x190
[28503.751966]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[28503.751968] RIP: 0033:0x7fa04c5f81ae
[28503.751973] Code: Bad RIP value.
[28503.751974] RSP: 002b:00007ffff0dde2b0 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[28503.751976] RAX: ffffffffffffffda RBX: 000055974ad37558 RCX: 00007fa04c5f81ae
[28503.751976] RDX: 0000000000000000 RSI: 00007ffff0dde430 RDI: 00000000ffffff9c
[28503.751977] RBP: 00000000000fb24d R08: 000000000000fffc R09: 00007ffff0dde39c
[28503.751978] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffff0dde430
[28503.751979] R13: 0000559745480285 R14: 000055974af0f1f0 R15: 0000000000000004
[28624.606902] INFO: task rsync:19916 blocked for more than 966 seconds.
[28624.606947]       Tainted: P           OE     5.4.34-1-pve #1
[28624.606978] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[28624.607035] rsync           D    0 19916  18951 0x00004000
[28624.607037] Call Trace:
[28624.607045]  __schedule+0x2e6/0x700
[28624.607048]  schedule+0x33/0xa0
[28624.607065]  rtR0SemEventMultiLnxWait.isra.35+0x1a8/0x1f0 [vboxguest]
[28624.607069]  ? wait_woken+0x80/0x80
[28624.607078]  VBoxGuest_RTSemEventMultiWaitEx+0xe/0x10 [vboxguest]
[28624.607088]  VBoxGuest_RTSemEventMultiWait+0x28/0x30 [vboxguest]
[28624.607096]  vgdrvHgcmAsyncWaitCallbackWorker+0xda/0x210 [vboxguest]
[28624.607105]  VGDrvCommonIoCtl+0x8bb/0x1a70 [vboxguest]
[28624.607113]  VBoxGuestIDC+0x149/0x160 [vboxguest]
[28624.607118]  VbglR0IdcCallRaw+0x13/0x20 [vboxsf]
[28624.607120]  VbglR0HGCMFastCall+0x1c/0x20 [vboxsf]
[28624.607122]  vbsf_reg_open+0x25f/0x4d0 [vboxsf]
[28624.607125]  ? vbsf_linux_oflags_to_vbox+0xb0/0xb0 [vboxsf]
[28624.607128]  do_dentry_open+0x143/0x3a0
[28624.607129]  vfs_open+0x2d/0x30
[28624.607131]  path_openat+0x2e9/0x16f0
[28624.607210]  ? zpl_write_common_iovec+0x90/0xf0 [zfs]
[28624.607212]  do_filp_open+0x93/0x100
[28624.607215]  ? __alloc_fd+0xb2/0x150
[28624.607216]  do_sys_open+0x177/0x280
[28624.607218]  __x64_sys_openat+0x20/0x30
[28624.607220]  do_syscall_64+0x57/0x190
[28624.607223]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[28624.607225] RIP: 0033:0x7fa04c5f81ae
[28624.607246] Code: Bad RIP value.
[28624.607248] RSP: 002b:00007ffff0dde2b0 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[28624.607249] RAX: ffffffffffffffda RBX: 000055974ad37558 RCX: 00007fa04c5f81ae
[28624.607250] RDX: 0000000000000000 RSI: 00007ffff0dde430 RDI: 00000000ffffff9c
[28624.607251] RBP: 00000000000fb24d R08: 000000000000fffc R09: 00007ffff0dde39c
[28624.607252] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffff0dde430
[28624.607253] R13: 0000559745480285 R14: 000055974af0f1f0 R15: 0000000000000004
[28745.423010] INFO: task rsync:19916 blocked for more than 1087 seconds.
[28745.423054]       Tainted: P           OE     5.4.34-1-pve #1
[28745.424211] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[28745.425331] rsync           D    0 19916  18951 0x00004000
[28745.425333] Call Trace:
[28745.425341]  __schedule+0x2e6/0x700
[28745.425342]  schedule+0x33/0xa0
[28745.425360]  rtR0SemEventMultiLnxWait.isra.35+0x1a8/0x1f0 [vboxguest]
[28745.425363]  ? wait_woken+0x80/0x80
[28745.425371]  VBoxGuest_RTSemEventMultiWaitEx+0xe/0x10 [vboxguest]
[28745.425379]  VBoxGuest_RTSemEventMultiWait+0x28/0x30 [vboxguest]
[28745.425387]  vgdrvHgcmAsyncWaitCallbackWorker+0xda/0x210 [vboxguest]
[28745.425405]  VGDrvCommonIoCtl+0x8bb/0x1a70 [vboxguest]
[28745.425413]  VBoxGuestIDC+0x149/0x160 [vboxguest]
[28745.425419]  VbglR0IdcCallRaw+0x13/0x20 [vboxsf]
[28745.425421]  VbglR0HGCMFastCall+0x1c/0x20 [vboxsf]
[28745.425424]  vbsf_reg_open+0x25f/0x4d0 [vboxsf]
[28745.425426]  ? vbsf_linux_oflags_to_vbox+0xb0/0xb0 [vboxsf]
[28745.425429]  do_dentry_open+0x143/0x3a0
[28745.425430]  vfs_open+0x2d/0x30
[28745.425432]  path_openat+0x2e9/0x16f0
[28745.425512]  ? zpl_write_common_iovec+0x90/0xf0 [zfs]
[28745.425515]  do_filp_open+0x93/0x100
[28745.425517]  ? __alloc_fd+0xb2/0x150
[28745.425519]  do_sys_open+0x177/0x280
[28745.425520]  __x64_sys_openat+0x20/0x30
[28745.425522]  do_syscall_64+0x57/0x190
[28745.425525]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[28745.425527] RIP: 0033:0x7fa04c5f81ae
[28745.425533] Code: Bad RIP value.
[28745.425534] RSP: 002b:00007ffff0dde2b0 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[28745.425536] RAX: ffffffffffffffda RBX: 000055974ad37558 RCX: 00007fa04c5f81ae
[28745.425536] RDX: 0000000000000000 RSI: 00007ffff0dde430 RDI: 00000000ffffff9c
[28745.425537] RBP: 00000000000fb24d R08: 000000000000fffc R09: 00007ffff0dde39c
[28745.425538] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffff0dde430
[28745.425539] R13: 0000559745480285 R14: 000055974af0f1f0 R15: 0000000000000004
[28866.433308] INFO: task rsync:19916 blocked for more than 1208 seconds.
[28866.434620]       Tainted: P           OE     5.4.34-1-pve #1
[28866.436115] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[28866.437584] rsync           D    0 19916  18951 0x00004000
[28866.437587] Call Trace:
[28866.437595]  __schedule+0x2e6/0x700
[28866.437597]  schedule+0x33/0xa0
[28866.437703]  rtR0SemEventMultiLnxWait.isra.35+0x1a8/0x1f0 [vboxguest]
[28866.437784]  ? wait_woken+0x80/0x80
[28866.437795]  VBoxGuest_RTSemEventMultiWaitEx+0xe/0x10 [vboxguest]
[28866.437852]  VBoxGuest_RTSemEventMultiWait+0x28/0x30 [vboxguest]
[28866.438036]  vgdrvHgcmAsyncWaitCallbackWorker+0xda/0x210 [vboxguest]
[28866.438207]  VGDrvCommonIoCtl+0x8bb/0x1a70 [vboxguest]
[28866.438333]  VBoxGuestIDC+0x149/0x160 [vboxguest]
[28866.438339]  VbglR0IdcCallRaw+0x13/0x20 [vboxsf]
[28866.438342]  VbglR0HGCMFastCall+0x1c/0x20 [vboxsf]
[28866.438344]  vbsf_reg_open+0x25f/0x4d0 [vboxsf]
[28866.438347]  ? vbsf_linux_oflags_to_vbox+0xb0/0xb0 [vboxsf]
[28866.438349]  do_dentry_open+0x143/0x3a0
[28866.438351]  vfs_open+0x2d/0x30
[28866.438353]  path_openat+0x2e9/0x16f0
[28866.438486]  ? zpl_write_common_iovec+0x90/0xf0 [zfs]
[28866.438558]  do_filp_open+0x93/0x100
[28866.438560]  ? __alloc_fd+0xb2/0x150
[28866.438562]  do_sys_open+0x177/0x280
[28866.438564]  __x64_sys_openat+0x20/0x30
[28866.438567]  do_syscall_64+0x57/0x190
[28866.438569]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[28866.438571] RIP: 0033:0x7fa04c5f81ae
[28866.438576] Code: Bad RIP value.
[28866.438577] RSP: 002b:00007ffff0dde2b0 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[28866.438579] RAX: ffffffffffffffda RBX: 000055974ad37558 RCX: 00007fa04c5f81ae
[28866.438580] RDX: 0000000000000000 RSI: 00007ffff0dde430 RDI: 00000000ffffff9c
[28866.438581] RBP: 00000000000fb24d R08: 000000000000fffc R09: 00007ffff0dde39c
[28866.438582] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffff0dde430
[28866.438582] R13: 0000559745480285 R14: 000055974af0f1f0 R15: 0000000000000004
scottgus1
Site Moderator
Posts: 20965
Joined: 30. Dec 2009, 20:14
Primary OS: MS Windows 10
VBox Version: PUEL
Guest OSses: Windows, Linux

Re: Shared Folder traffic causes linux stack dump

Post by scottgus1 »

The Upload Attachment tab below where you type posts accepts zipped anything from first day first post. You can zip your dmesg and attach the full file there. However:
User Not Found wrote:/mnt/ztank is the Shared Folder via VirtualBox setting...I run rsync from /mnt/ztank to /workingpool ...I get a kernel stack dump.
Guest Additions Shared Folders (the kind made through Virtualbox) are only for manual mouse-drag-n-drop file & folder copying out of the GASF to the guest filesystem & back (possibly command-line basic copy, too). Rsync opens, reads & hashes files, and these things aren't technically supported through a GASF.

If you desire to use a shared folder, use a real shared folder supplied through Solaris, not through Virtualbox. You will need a network between host and guest for this. Host-Only at least for isolated host-to-guest only, Bridged for full LAN access in the guest too.
User Not Found
Posts: 4
Joined: 24. Aug 2020, 02:43

Re: Shared Folder traffic causes linux stack dump

Post by User Not Found »

scottgus1 wrote:The Upload Attachment tab below where you type posts accepts zipped anything from first day first post. You can zip your dmesg and attach the full file there. However:
Ah, I didn't notice the upload attachment. New to the forum, apologies.

scottgus1 wrote:Guest Additions Shared Folders (the kind made through Virtualbox) are only for manual mouse-drag-n-drop file & folder copying out of the GASF to the guest filesystem & back (possibly command-line basic copy, too). Rsync opens, reads & hashes files, and these things aren't technically supported through a GASF.
That's curious though - it's not as if hashing a file is doing anything different at the filesystem level. Whatever rsync is doing is exactly the same as any other filesystem operation you do with copying a file over, other than setting atime, ctime, etc. To hash a file is to read it, and perform that function in memory. It's not like there's any other special APIs being used.

Also, the fact that it works, but crashes after a while, indicates there's a bug.
scottgus1 wrote:If you desire to use a shared folder, use a real shared folder supplied through Solaris, not through Virtualbox. You will need a network between host and guest for this. Host-Only at least for isolated host-to-guest only, Bridged for full LAN access in the guest too.
Ugh. I did a NFS mount, and it was doing something like 30MB/s. Shared Folder ran about 60MB/s. If this was native on either Solaris or Linux, it would have been about 150MB/s to 200MB/s. I've about 14TB to transfer, so anything faster would have been nice.

However, I'm unable to create a zpool that is usable across both Solaris 11.3/11.4 and ZFS on Linux. I even went as far as creating a zpool that's at version 20!!

# zpool create -o version=20 testpool /dev/sda /dev/sdb /dev/sdc

Just couldn't get Solaris and Linux to play nice with that pool.
scottgus1
Site Moderator
Posts: 20965
Joined: 30. Dec 2009, 20:14
Primary OS: MS Windows 10
VBox Version: PUEL
Guest OSses: Windows, Linux

Re: Shared Folder traffic causes linux stack dump

Post by scottgus1 »

User Not Found wrote:it's not as if hashing a file is doing anything different at the filesystem level.
Quite true. The gurus say that there's a lot of what a normal shared folder can do that a GASF wasn't programmed for. So when someone is doing something more than strictly file copying, we assume, perhaps wrongly but with experience, that the use of the GASF might be beyond designed specs. Essentially a GASF was designed to get around not having a network available in a guest OS to make a real shared folder, best as I understood the gurus.

As far as crashing after a while, not right away, I don't know how the guts of a GASF works, myself. That's source code stuff, and whenever I look at C my eyes glaze over. :lol: But there are things that can squeeze under the wire. For example. some attempts to open/edit/save a file in a GASF fail. But on my Windows 7 guest with a 3D cabinet-modelling program in it, I can open/edit/autosave/save in a GASF all day long. Just one of those flukes. Could be how the program is doing the open/save, maybe something else. If it ever fails, I know I'll need a network.

As for the slower real shared folders, maybe try a host driver update? Virtualbox is supposed to send data through its networks to the physical PC as fast as the physical hardware can take it.

I read some stuff about ZFS and zpools, would like to have enough hardware to try it some day. Especially RAID7. But I suspect that only Solaris or Linux, not both, would have to be the controlling OS. I guess that you couldn't have them both handle the pool, if I understand what you're typing. I'd think to either make the pool in Solaris and Linux accesses via shared folder, or vice versa.
User Not Found
Posts: 4
Joined: 24. Aug 2020, 02:43

Re: Shared Folder traffic causes linux stack dump

Post by User Not Found »

scottgus1 wrote:For example. some attempts to open/edit/save a file in a GASF fail. But on my Windows 7 guest with a 3D cabinet-modelling program in it, I can open/edit/autosave/save in a GASF all day long. Just one of those flukes. Could be how the program is doing the open/save, maybe something else. If it ever fails, I know I'll need a network.
That probably because the app copies the original file to your local temp folder, works on it locally ,and then saves it back to the original spot.
scottgus1 wrote:As for the slower real shared folders, maybe try a host driver update? Virtualbox is supposed to send data through its networks to the physical PC as fast as the physical hardware can take it.
I've updated everything I can, including the Extension Pack, as well as the VBox Guest Addition on the linux guest.

As far as network speed is concerned, here's what iperf3 between the guest and host says:
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.27 GBytes 1.09 Gbits/sec 0 sender
[ 5] 0.00-10.00 sec 1.27 GBytes 1.09 Gbits/sec receiver

scottgus1 wrote:I guess that you couldn't have them both handle the pool, if I understand what you're typing. I'd think to either make the pool in Solaris and Linux accesses via shared folder, or vice versa.
I have two separate pools. ztank is local in the host. workingpool is on a (different) set of passthrough disks in the linux guest.
fth0
Volunteer
Posts: 5668
Joined: 14. Feb 2019, 03:06
Primary OS: Mac OS X other
VBox Version: PUEL
Guest OSses: Linux, Windows 10, ...
Location: Germany

Re: Shared Folder traffic causes linux stack dump

Post by fth0 »

For a test, I'd suggest to split up the transmission path to simplify: For example, start with copying the files from /mnt/ztank to /dev/null and measure the throughput. Does it degrade over time? Does it hang or stop like the rsync?
Post Reply