These utilities to monitor Nvidia GPUs require using the proprietary Nvidia graphics drivers.
nvtop - terminal user interface to monitor Nvidia GPUs
nvtop is a (h)top like task monitor for Nvidia GPUs. It uses the ncurses to draw its text-based user interface in the terminal, and it makes use of the NVIDIA Management Library (NVML) to get the GPU information.