More than enough. I'm running 128GB with 78TB allocated and plenty of headroom. Zfs arc will eat what you give it but it's adaptive. 64GB means maybe 32GB for arc, which is fine unless you're doing heavy random io.
My advice: proxmox, zfs for storage pools, lxc containers for lightweight stuff, vms only when you need real isolation. The t320 is a solid platform. Loud though. Hope you have a basement.