On the phone, tap to the Orbits view and right swipe on the Orbit you want to delete. Tap the delete icon.
On the pad, switch to landscape mode and tap to the Orbits view. Select the Orbit you want to delete and tap the Orbit icon in the header. Tap Delete.