I install KDE Plasma on laptops I intend to use as a server. If the PC is easily reachable you can use the GUI to quickly manage files or use the terminal. Disable search indexing if you install GNOME or Plasma. I never used Debian but I assume the base system is as clean as it can be.
I still remember the DDoS attacks