Can I use remote desktop without integrated or dedicated graphics card? [closed]

My PC for deep learning is ubuntu-desktop 22.04 with an nvidia GPU and a CPU without integrated graphics card, and I usually use Microsoft RDP to connect it. I must connect a monitor or an HDMI dummy plug to the graphics card, otherwise, RDP will not work. However, this method will consume a lot of GPU memory (~1GB). I wonder how to continue using RDP without consuming any video memory.

I installed xserver-xorg-video-dummy to create a dummy monitor, some display tasks have been offloaded to the CPU, but "... libexec/gnome-remote-desktop-daemon" is still using 655MB of GPU memory. What should I do to make RDP work properly without GPU?

My dummy monitor config(/etc/X11/xorg.conf):

Section "Device"    Identifier "DummyDevice"     Driver "dummy"    VideoRam 256000EndSectionSection "Monitor"    Identifier "DummyMonitor"    HorizSync 30.0-1000.0    VertRefresh 30.0-1000.0    Modeline "2560x1440_50.00"  256.09  2560 2728 3008 3456  1440 1441 1444 1482 -HSync +Vsync    Modeline "2560x1600_50.00"  285.75  2560 2736 3016 3472  1600 1601 1604 1646 -HSync +VsyncEndSectionSection "Screen"    Identifier "DummyScreen"    Device "DummyDevice"    Monitor "DummyMonitor"    DefaultDepth 24    SubSection "Display"        Depth 24        Modes "2560x1600_50.00" "2560x1440_50.00"    EndSubSectionEndSection

nvidia-smi:

+---------------------------------------------------------------------------------------+| NVIDIA-SMI 535.104.05             Driver Version: 535.104.05   CUDA Version: 12.2     ||-----------------------------------------+----------------------+----------------------+| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC || Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. ||                                         |                      |               MIG M. ||=========================================+======================+======================||   0  NVIDIA GeForce RTX 4090        Off | 00000000:01:00.0 Off |                  Off ||  0%   45C    P2              52W / 450W |    669MiB / 24564MiB |      1%      Default ||                                         |                      |                  N/A |+-----------------------------------------+----------------------+----------------------++---------------------------------------------------------------------------------------+| Processes:                                                                            ||  GPU   GI   CI        PID   Type   Process name                            GPU Memory ||        ID   ID                                                             Usage      ||=======================================================================================||    0   N/A  N/A      1703    C+G   ...libexec/gnome-remote-desktop-daemon      655MiB |+---------------------------------------------------------------------------------------+