You may be looking at your task categories and see some that you wish to delete but when you select them you can't see a delete option?
A: That is because there are still some tasks linked with that category and therefore the system won't offer you a delete category option.
If you then remove all the related tasks to a particular category, when you now select it you should see the "Delete Category" button: