Login in to Autocled

Highlighting App (beta)

This app is used to highlight information in news articles describing events of political violence . Your annotations will be used to train a model that helps automate parts of the event-coding process.

  • You will highlight locations, actors, dates, and numbers of fatalities that are directly related to political violence events.
  • Before logging off, make sure to hit the save button (top left) to ensure all annotations are saved.
  • If you leave an article unfinished, it may be shown again later.

How to Annotate Articles

  • Highlighting: Select a label by clicking it at the top or pressing its hotkey. Once a label is selected, click and drag to highlight text as that label.
  • Changing a highlight: Click an existing highlight to change its label or remove it.
  • Multiple highlights: You may create as many highlights as needed in a single article.
  • No relevant information: If an article contains no relevant information to highlight, do not add any highlights.
  • Accepting articles: Always click Accept (or the hotkey a) when you are finished reviewing an article, even if you made no highlights .
  • Saving: Annotations are saved periodically when you accept an article. To make sure you dont lose any articles, hit the save button in the top left before loggig off.

Annotate Articles

Click the button below to start annotating articles.

Annotate Articles

Goal: Your task is to highlight information in articles that describes events of political violence . We are training a model to extract the details about these events.

Only annotate information that is directly related to an event described in the article .

What to Annotate

Location
  • Where the event occurred
  • Cities, towns, villages, districts, or specific sites mentioned as the event location

Do NOT annotate:

  • Datelines (e.g., “LONDON —”)
  • Locations mentioned only for background, commentary, or other non-event related unrelated reasons
Actor(s)
  • Groups or individuals directly involved in the event
  • Groups or individuals directly targeted or involved (e.g., civilians, police, protesters, soldiers)

Do NOT annotate:

  • Politicians or officials commenting on the event
  • Actors not directly involved in the event
Date
  • When the event occurred
  • Specific dates (e.g., “March 3, 2024”)
  • Relative dates (e.g., “on Tuesday”, “last week”) if they clearly refer to the event

Do NOT annotate:

  • Dates referring to unrelated events, political decisions, or reporting dates
Number of Fatalities
  • Numbers or phrases describing how many people were killed in the event (if applicable)
  • Approximate or uncertain counts (e.g., “at least 5”, “more than 20”)

Do NOT annotate:

  • Injuries
  • Deaths from unrelated reasons

Multiple Events in One Article

  • An article may describe more than one political violence event
  • Annotate all relevant locations, actors, dates, and fatality counts
  • You do not need to link entities to specific events
  • If an actor, location, date, or fatlity count is associated with any event, it should be highlighted

Repeated Mentions

If a relevant location, actor, date, or fatality count appears multiple times, annotate every mention .

When You're Unsure

  • Annotate only if the entity is more likely than not related to a political violence event
  • If still unsure, do not annotate it