The port which is a protocol for transferring data to and from digital devices is known as:
USB port
USB port is correct.
USB stands for Universal Serial Bus. It is an industry standard that defines the cables, connectors and communication protocol used to transfer data (and supply power) between a computer and digital devices such as pen drives, printers, cameras and phones.
A VGA port only carries analogue video to a monitor, a parallel port is an older printer interface, and PS/2 ports connect only a keyboard or mouse, so none of them is the general data-transfer protocol described.