10 MAR 2007

10 MAR 2007

SEQUOYAHForeign Language Translation System

MAJ Tracy Blocker/Dr Ed CeruttiUS Army Intelligence [email protected] and/or

[email protected] (520) 538-0921/1479

02/00/06 Sequoyah

Sequoyah

Agenda

• Sequoyah Overview/Strategy

• Sequoyah Status

• Concept

• Sequoyah Team

• Sequoyah Components and Current Technologies

• TRADOC Capability Manager Direction

• Way Ahead

02/00/06 Sequoyah

Sequoyah What Is It?Sequoyah Overview

• DOD Program of Joint Interest: Overarching program for Machine Language Translation (MLT) with Army as the Executive Agent.

• PURPOSE: Identify current and developing technologies to meet warfighter requirements for foreign language support where MLT is an appropriate tool providing:

- Automated 1 way and 2 way speech to speech (S2S) translation

- Automated speech to text (S2T) translation

- Automated 1 way and 2 way text to text translation (T2T)

- Automated text to speech (T2S) translation

• DOMAINS: Language data focused on specific military functions and paramaters

- Warfighter (Force protection, Checkpoint ops, Convoy ops, Urban combat ops, Tactical Questioning, etc)

- Internment and Resettlement

- Foreign Soldier and Security Force Training

- Medical

- Maritime Interdiction Ops

- Others….

• OBJECTIVE: MLT capability embedded in other systems (Soldier as a System [SaaS], Future Combat Systems [FCS], Distributed Common Ground System [DCGS], Deployable Joint Command and Control [DJC2], …) providing automated capability to meet the warfighters’ foreign language translation needs when a human linguist is unavailable.

02/00/06 Sequoyah

Sequoyah

SEQUOYAHDescription

•Overarching DoD program for machine language translation (MLT), with Army as the Lead Service, to develop technologies to meet Warfighter foreign language translation requirements when a human linguist is not available

•Objective is a MLT capability embedded in other systems to include Joint Command and Control, DCGS (all services), SaaS, FCS, Prophet, and others

•Key Participants: national Technical Support Workgroup, ODNI, JFCOM, DARPA, Service Labs, Defense Language Institute, PM Prophet, Army Intelligence Center and School

Characteristics supporting Current and Future Force

•One-way and two-way Speech Translation Capability when human linguist is not available

- Force Protection Operations

- Checkpoint Operations

- Civil Affairs Operations

- Medical Support

- Detainee and EPW Operations

- Intelligence Support

•Two-way text translation capability for documents and communication over GIG

•Internet and satellite broadcast transcription and translation

Benefits/Capabilities

•Greatly increase points of presence for foreign language translation capabilities on the battlefield

•Enable communications with foreign speakers when human linguist is not available, enhancing mission success with

- Host Nation

- Coalition partners

- Indigenous people

•Enable rapid translations and triage of documents and media focusing analysts on most important and priority documents/media for exploitation

Phraselator

Speech to Speech System

Voice Response Translator

Coalition Chatline PlusDeployed at COCOMs, Navy, State Dept

Broadcast Transcription and TranslationDeployed at COCOMs

02/00/06 Sequoyah

Sequoyah

APOD: Aerial Port of DebarkationSPOD: Sea Port of Debarkation

CONOPS / OV-1• Provides an automated two way speech

and text language translation capability through

- Web enabled services (GIG)

- Mobile (computing platforms)

- Portable (handheld computing platforms)

• Integrated seamlessly into other systems/programs (DJC2, Net-Enabled Command Capability, FCS, SaaS, DCGS, Prophet, etc)

• Capability will be resident in/at

- All DoD mission sets (Force protection, civil affairs, legal, medical, intelligence, etc)

- Strategic level down to the individual warfighter

- Embedded throughout DoD

• Translation support for languages on DoD language priority list (Linguists required – human linguists available=Machines language translations systems)

• Enables basic to intermediate proficiency machine language translation capability commensurate with mission requirements

• Provides language translation modules for immediate download from a central repository

• Provides warfighters the ability to update and tailor system to local mission requirements

• Provides help desk services to assist with language modules, updates and other software integration issues

02/00/06 Sequoyah

Sequoyah

Sequoyah Transition MGT Office Organization

Program Management

Joint CoalitionTask Force

DOTMLPF Integration

• Service component liaison• COCOM liaison• Other Gov’t Agencies• USD AT&L liaison

• C4ISR• Joint IERs

• Joint Doctrine Dev• Joint Training Dev

• Foreign language committee • Service SLAs• DLI Liaison• Academia Interface

• Rapid Response• Sustainment • Tech Refresh

USAIC&FH

• Metrics• Data Procedures• Process Improvement• Data Verification

Program Transition

T2T Programs

S2S Programs

S2T, T2S, T2TSubordinate tech

• Rapid Response• Sustainment • Tech. Refresh

• Rapid Response• Sustainment • Tech.

Business Mgt.

Budget &Accounting

• Rapid Response• Sustainment • Tech. Refresh

• Program Plan •Transition Pans/ Agreements • PEO coordination

• MOU, MOAs • Purchase Agreements• SOWs

Logistics

• Safety • Material release

Prophet

Test & Evaluation

Engineering

• Software• Hardware • Tech Assessment

• Mission Sets• Domain Creation• Archives• Data Verification

• Assessments• Test Procedures• Technology Verif• TRL Evaluations

• Advanced Systems • Supporting Tech• Tech Roadmap• Prototype Dev• R&D Coordination

• RDEC• ARL• DARPA• NRL• AFRL

• RDEC• ARL• DARPA• NRL• AFRL

TestBed ARL

Lessons Learned

User Feedback

Lessons Learned

User Feedback

Program Oversight

Contracts &Purchasing

Plans & Scheduling

Formal Acquisition Documents

Research &Development

Standards

Data Collection & Verification

Technology Dev. & Integration

Joint Interoperability

LanguageRequirements

Joint Requirements Oversight

RequirementsRequirements

02/00/06 Sequoyah

Sequoyah

Current JFCOM/Sequoyah MLT Efforts• One-Way Speech Translation Systems

- P2 Phraselator

- Voice Response Translator

- Other products

• English-Iraqi Two-Way Speech (IS2S) Translation System

- Leverages off of DARPA TRANSTAC Program: six developers

- System and Operational Assessments in process

• Coalition Chat Line +

- Text to Text translation for coalition operations with soft copy input

- T2T translation for soft copy documents

• Broadcast Transcription and Translation

- Speech to Text translation of television broadcasts in Modern Standard Arabic, Spanish and Chinese

- Provides transcription in target language and translation in English synchronized with video

• DOCEX (currently supported by NGIC)

- T2T translation with paper input for 60+ languages

- MLT only a portion of system capability

02/00/06 Sequoyah

Sequoyah

Path Ahead

• Pathway to Program of Record: Incorporated into the Sequoyah program as it progresses to POR

• Further Testing and Improvement

• Resident Capability: CENTRIXS

• Languages To Be Added: Dari, Romanian, Turkish, Improved Thai

•Description: Embedded Microsoft capability to collaborate and share electronic documents with coalition and ally nations in translated text to text that is nearly instantaneous. Bi-directional translation engines are used for capability (primarily SYSTRAN commercial vendor, but other vendors are available depending on supported language).

•Key Participants: JFCOM, SPAWAR-San Diego (US Navy), CERDEC C2D, PM Prophet, S-TMO, FT Huachuca

Record of Success

• Exercise Support: Combined Endeavor 03 & 04, BALTOPS 03, & Rescuer/MEDCEUR 03

• OIF Support: Multi-National Division Center South-Iraq (Camp Babylon, Al Hillah, Karbala, Ad Diwaniyah, & Al Kut)

• Combatant Command Use of CCL+: SOUTHCOM, EUCOM & PACOM

• Languages Supported: English, German, Dutch, Spanish, Portuguese, Italian, French, Russion, Polish, Ukrainian, Korean, Japanese, Chinese, Thai, Arabic, Hebrew, Bahasa, Indonesia, Farsi

Coalition Chat Line Plus (CCL+)Coalition Chat Line Plus (CCL+)Sequoyah

02/00/06 Sequoyah

Sequoyah

Text Entry Area

Chat Room Participants

Coalition Chat Line Plus CCL(+)

Fielded T2T Systems

02/00/06 Sequoyah

Sequoyah

Path Ahead


•Description: Real-time tracking and translation of broadcast media to include video, audio, internet, and other electronic media. Language Translation and Data Storage is integrated with analyst tools to correlate information and develop Intelligence Products for strategic or tactical use.

•Key Participants: JFCOM, DARPA, Service Labs, PM Prophet, S-TMO, FT Huachuca

Record of Success

• Available for use now

• CENTOM J2 OSINT Section, JIOC: Arabic WEB and TV monitoring

• Asst Secretary of Defense for International Security Affairs: Arabic TV monitoring

• PSYOP TF 15, MNC-I: Arabic TV monitoring

• SOCOM Joint Interagency Collaboration Center: R&D Pilot for advanced information retrieval CONOPS development

• National Virtual Translation Center: R&D Pilot for support of human translation and language learning

Broadcast Transcription and TranslationSequoyah

02/00/06 Sequoyah

Sequoyah

Path Ahead


Record of Success

• Over 400 systems deployed

• More systems ordered

Voice Response TranslatorSequoyah

•Description: Handheld device allowing soldier basic 1 way speech to speech (1WS2S) foreign language communication based on common required phrases (mission oriented). Soldier speaks basic words/phrases into system and words/phrases are translated into target language.

•Key Participants: JFCOM, Service Labs, PM Prophet, S-TMO, FT Huachuca

02/00/06 Sequoyah

Sequoyah

Path Ahead


•Description: Handheld device allowing soldier basic 1 way speech to speech (1WS2S) foreign language communication based on common required phrases (mission oriented). Soldier selects recorded phrase for the system to play in target language.

•Key Participants: JFCOM, Service Labs, PM Prophet, S-TMO, FT Huachuca

Record of Success

• Over 1400 systems deployed

• More systems ordered

P2 Phraselator Sequoyah

02/00/06 Sequoyah

Sequoyah

Path Ahead


• Complete testing and subsequent system modifications

Record of Success

• Testing in Iraq now

English/Iraqi Speech to Speech TranslationSequoyah

•Description: Handheld device allowing soldier basic 1 way speech to speech (1WS2S) foreign language communication based on common required phrases (mission oriented). Soldier speaks basic words/phrases into system and words/phrases are translated into target language.

•Key Participants: JFCOM, DARPA, Service Labs, PM Prophet, S-TMO, FT Huachuca

02/00/06 Sequoyah

Sequoyah Coordination with Pending TCMTRADOC Capability Manager Ground Sensor

1. Immediate funding of program to meet machine language translation requirements

a. Support OIF/OEF requirements

b. Support GWOT requirements

c. Preparation for future force requirements

d. Priority languages: Iraqi Arabic, MSA, Dari, Pashto, Farsi, Chinese, other languages as listed on Strategic Language List

2. Integrate proven Sequoyah capabilities to address current force machine language translation requirements (Joint Command and Control, DCGS, SaaS, FCS, Prophet, and others)

3. Accelerate RDT&E of Sequoyah Program

a. Development of translation data to support machine language translation software

b. Rapid assessment of “cutting edge” translation systems

c. Maturing the capabilities

Initial Investment

Mature Capability

YR 1

Typical Development of Specific Machine Language Translation Capability Timeline: 2 years

Priority Mission Sets: force protection, civil affairs, medical support, detainee and EPW ops, intelligence support, etc

Data Collection

Data Preparation

Development of Translation Capability (includes assessment)

Initial Capability

YR 2

02/00/06 Sequoyah

Sequoyah

Sequoyah Way Ahead

• JCIDS (Joint Capabilities Integration and Development System) Process• CDD (Capabilities Development Document): AROC approved; Submitted to Joint Staffing on

9 FEB 07• Possible MS B Decision in FY 09 or 10

• FUNDING:• Discussion/Coordination for 09-13 POM• Joint Forces Command and Office of the Secretary of Defense• Army Supplemental• ODNI Proposals

• TESTBED:• Parallel Corpora Collections• Best of Breed Tests/Review

• INTEGRATION:• Requirements Collection from Other Services and DoD Agencies• Coordination with DJC2, DCGS (all services), SaaS, FCS, Intel Systems

• DEPLOYMENTS: Continued Deployments on promising technologies

02/00/06 Sequoyah

Sequoyah

ALWAYS OUT FRONT

Always Engaged !MAJ Tracy Blocker/Dr Ed CeruttiUS Army Intelligence [email protected] and/or

[email protected] (520) 538-0921/1479

02/00/06 Sequoyah

Sequoyah

Broadcast Transcription Translation (BTT)

Real-time Monitoring of Al-JazeeraReal-time streaming video

(~5 min delay)

Automatic transcriptionof Arabic speech from

BBN Audio Indexer

Automatic translationof Arabic transcript from

Language Weaver

Real-time Tracking and Translation of Broadcast Media: Video: Television, Live and Recorded Video Audio: Radio, Voice Recordings

Text: Electronic Media – Websites, E-mail Graphic: OCR Input

– Language Translation and Data Storage Integrated with Analyst Tools to Correlate Information and Develop Intelligence Products for Strategic or Tactical Use

– Network-ready, Scaleable, Ruggedized Capability, Deployable at Multiple Operational Echelons, Configurable to get Maximum Utility from Translator Resources

eTAP-Arabic TV Processing Component

Power conditioner

Satellite receiver

Servers for :Video encoding,Speech transcription,Language translation, Content management

24” cubic container

Monitor and keyboard

Fielded BTT Systems

10 MAR 2007

Documents

Transcript of 10 MAR 2007