Page 1

Talos Authoring Toolkit Š A natural language parser and a nonverbal behaviour rule-set could be used for deeper understanding and more accurate annotation of the input chunks

Virtual People Factory Web Service

Batch processing & Skeleton Mapping

Module 1: Field Tool

Video Editor & Annotation Tool

Automatic Gesticon creation Deeper Understanding

WWW

Actors Video DB

Annotate Chunks

Gesture DB

Manual Cleaning process

Video Production

Antelope API

Gesticon Matching

NVB annotator

Stanford Parser

Manual Annotation

Module 2: Dialogue Hubs

Network Communication

Sentence split, etc. The NVB takes one chunk at a time (e.g., the facing on the main gate)

Text Constructor

Text Preprocessing

A

Visually Organize Hubs (relationships, topics, etc)

Annotated navigation instructions

Navigation Nodes KB Editor Location Nodes

Annotated location descriptions

Question Nodes

B

Annotated Answers

Answer Nodes Network Communication

Module 3: Natural Language Processing

Non Verbal Behaviour rules

WWW

Stanford Parser

A

Speech Recognition

Annotated navigation instructions

Navigation Nodes

Antelope API B

KB Editor Speech Grammars

Annotated location descriptions

Location Nodes

Question Nodes

NLU Component

Shallow Parsing

Annotated Answers

Answer Nodes

Deep Syntax

Successful?

No No

Network Communication

Module 4: Input Modalities (Emotion & Face Detection)

Yes

Emotion Classifier

A

E.g., Shore/ eMotion, etc

E.g., OpenCV, etc

A

Face Detector Scripted Character Reactions

Emotion Nodes

Emotion Recognition

B Face Detection

Emotion Rules

Scripted Character Reactions

FaceDetection Nodes

B

Face Detection Rules

Define: Type of Emotion

Define: No. times rule applies

Define: Intensity

Define: Character Reaction

Define: Face Coordinates

A GPS Receiver

GPS-Enabled Navigation Nodes

Annotated navigation instructions B

KB Editor GPS-Enabled Location Nodes

Camera Stream

Define: Character Reaction

Encoding QR-Codes

QR-Codes

Annotated location descriptions

Location Nodes

Annotated location descriptions

Navigation Nodes

Annotated Navigation instructions

Decoding

GPSCoordinates DB

Geotagging of Locations/ Waypoints

Matching Network Communication

Module 5: Positioning Module(GPS Script Builder, QR-Codes Builder)

No

Yes

Network Communication

Module 6: Instruments Builder(Questionnaires, Tests)

Successful

Yes

Questionaire Creation

Questionnaire

Quest.\Tests Builder

Automatic Generation of Init. Data Test Creation

Test

B 2D Menu Constructor

Tag Extraction Script Parser

TimeSchedule

Script Rendering

Script Parser

I don’t understand

Case Frames

Successful? Dialogue Manager

B

Dialogue DB

Script DB

Audio File Creation with LipSync

Script Building

Scene Editor

More Instruments can be build within this module. For example, eye-tracking, video and timing, etc

A

B

Talos_toolkit  

Annotated Answers Visually Organize Hubs (relationships, topics, etc) Questionaire Creation Annotated location descriptions Annotated locati...

Advertisement