Simply swipe your finger *left* on a media item in either the 'Up Next' or 'Finished' list.