Ubuntu - dpkg - Purge a package

Remove/Delete everything including configuration files.

sudo dpkg -P [package name]

Example

sudo dpkg -P zip