Deleting a category from the category-tree can be done by right-clicking on a category and select remove category.