Manage an Annotation Queue¶

This guide covers what to know before you edit a queue, unflag an item, remove a session or delete a queue.

Prerequisites¶

• An existing annotation queue. See Create an Annotation Queue and Add Sessions.

Edit the Queue Settings¶

In the left sidebar, open Annotations and click the edit icon in the queue's row.

Once a reviewer has submitted an annotation, the schema fields are locked. See Field Order for which changes are still allowed.

Change Num Reviews Required¶

You can change Num reviews required after annotation has started. OCS recomputes the status of every item that is not Flagged when you save. Annotations are kept, so you can change the number back. Authoritative marks that the system set automatically may be cleared, and they are set again when the item meets the requirement. If reviews have already been submitted, a confirmation dialog warns that some completed items may reopen.

Unflag an Item¶

In the Items table, hover over the Flagged badge to see who flagged the item and why, then click unflag.

The item's status is recalculated from the reviews it already has, so an item with reviews does not necessarily return to Pending. See Item Status Lifecycle.

Remove a Session¶

Click the trash icon in the session's row in the Items table. A dialog lists the annotations and flags that will be deleted.

Removing a session permanently deletes all its annotations. The session itself is not changed. If you add the session to the queue again, it returns as a new Pending item with no annotations.

Delete a Queue¶

Click the trash icon in the queue's row on the Annotations page.

Deleting a queue permanently deletes its items, every annotation in it and its aggregate scores. The sessions themselves are not changed.