Question & Answer

Question and Answer(Q&A) is the task of building well-formed questions and their corresponding answers. It involves the reviewing and processing textual data to generate accurate and informative question and answer pairs and summary notes.

To get started, refer below for a quick overview of the Q&A project creation process.

_images/QA-Project-Updated.gif

For details about the project creation process, refer to Getting Started.

Label & Relationships

Pre-Labeling Model

  1. Enable the Pre-Labeling Model and select the option Use Pre-Labeling Q&A Model.

  2. You can find the Q&A Prompt GPT 3.5-turbo in the dropdown menu.

  3. Once you have selected this option, an OpenAI key is required for its utilization.

  4. The task includes prompting the question, answer, and summary.

Q&A Settings

  • Configure the Question, Answer and Summary Formats.

  • Distribution - The distribution of labels is uniform or non-uniform based on that value.

After configuring the question and answer on the page, it seems as follows.

Alternative text

Advanced Settings

The Advanced Settings section sets the behavior of the task workflow in the current project.

Project Attributes

The following Project Attribute settings are available for configuration:

Break text Files in pages

It breaks the Text files into pages depending on the Number of Words per Page.

Request text highlight for Question Annotations

Allows to highlight the text for Question Annotation.

Request text highlight for Answer Annotations

Allows to highlight the text for Answer Annotation.

Request text highlight for Sumarization Annotations

Allows to highlight the text for Sumarization Annotation.

Note

If you want to skip the Question/Answer/Summary Annotation then Disable Pen icon.

Alternative text Alternative text Alternative text

Annotator View

Shortcut Keys

The following shortcut keys serve as helpful references for annotators and reviewers during the task annotation process.

Keys

Use

Ctrl + F or F3

Find Text

Ctrl + G

Find Next

Ctrl + ]

Move to next entity

Ctrl + [

Move to previous entity

Ctrl + }

Move to next entity of same type

Ctrl + {

Move to previous entity of same type

Ctrl + Arrow Right

Move to next page

Ctrl + Arrow Left

Move to previous page

Ctrl +

Zoom In

Ctrl -

Zoom Out

Ctrl + 0

Zoom Reset

Alt

Hide Annotations, Label popup, Relationship

Alt + Entity Select

Enable Entity Comment

Delete

Delete selected entity/relationship/box

Once logged into the studio, the annotator is presented with the task queue, which includes a list of tasks available for them to work on.

_images/Q-A-ANNOTATOR-VIEW.gif

Reviewer View

The reviewers have the authority to approve, reject, or request adjustments from the annotator for a given task. Watch the following video to get a better understanding of the QC/Reviewer view.

_images/QA-Reviewer.gif