Contact Screen Editing Columns Process Doesn't Allow for Deleting Columns.
I'm sure this is a work in progress, but there doesn't seem to be a way to remove columns that have been added to a layout, other than by choosing "Remove All Columns" and then re-creating the desired column layout.