Skip to main content
Linguistic Data Consortium (UBC)
BOLT English Translation Treebank - Chinese SMS/Chat
Version 1.0
Bies, Ann; Mott, Justin; Warner, Colin; Kulick, Seth, 2022, "BOLT English Translation Treebank - Chinese SMS/Chat", https://hdl.handle.net/11272.1/AB2/JBOOKU, Abacus Data Network, V1
Learn about Data Citation Standards.
Dataset Metrics
9 Downloads
Description
Abstract

Introduction

BOLT English Translation Treebank - Chinese SMS/Chat was developed by the Linguistic Data Consortium (LDC) and consists of SMS and chat text data translated from Chinese to English and annotated for part-of-speech and syntactic structure.

The DARPA BOLT (Broad Operational Language Translation) program developed machine translation and information retrieval for less formal genres, focusing particularly on user-generated content. LDC supported the BOLT program by collecting informal data sources -- discussion forums, text messaging and chat -- in Chinese, Egyptian Arabic and English. The collected data was translated and annotated for various tasks including word alignment, treebanking, propbanking and co-reference.

Part-of-speech and treebank annotation conformed to Penn Treebank II style, incorporating changes to those guidelines that were developed under the GALE (Global Autonomous Language Exploitation) program. Those changes primarily concerned the tokenization of hyphenated words, part-of-speech and tree changes necessitated by the tokenization changes, and updates to the syntactic annotation to comply with updated annotation guidelines. Supplementary guidelines for English treebanks and web text are included with this release.

Data

The source data is Chinese SMS and chat text collected by LDC between 2010 and 2013, translated into English and released in BOLT Chinese SMS/Chat Parallel Training Data (LDC2021T11). A subset of the translated text -- 194 files representing 108,385 tokens -- was selected for the treebank and annotated for word-level tokenization, part-of-speech and syntactic structure. Only the translated English text is included in the source data for this release.

The unannotated Chinese source data was released as BOLT Chinese SMS/Chat (LDC2018T15), the Chinese-English word alignment data was released as BOLT Chinese-English Word Alignment and Tagging -- SMS/Chat Training (LDC2019T13) and the Chinese Treebank of the Chinese data was released as part of Chinese Treebank 9.0 (LDC2016T13).

Data is presented in a variety of UTF-8 encoded text formats, specifically, plain text, XML, and Penn Treebank. See the included documentation for more information about specific formats.

(2021-12-15)
Subject Other
Keyword Linguistics
Notes DCMI Type(s): Text
Application(s): Automatic content extraction, information detection, machine translation, parsing, part of speech tagging
Language(s): English
Language ID(s): eng
Metadata automatically created from https://catalog.ldc.upenn.edu/LDC2021T19 [07 Feb 2022]
Table
Tree
Filter by
1 to 3 of 3 Files
LDC2012T19_File_Manifest.txt
Documentation/Plain Text - 56.8 KB
Published Feb 7, 2022
3 Downloads
MD5: 443e636820d94893dcf83d14a737e4ab
File manifest
Documentation
LDC2021T19.iso
Data/Optical Disc Image - 46.4 MB
Published Feb 7, 2022
3 Downloads
MD5: 53d83057f9bb724dadc37305581df9e5
ISO disc image containing all documentation and data
Data
Working_with_ISO_Images.txt
Documentation/Plain Text - 1.3 KB
Published Feb 7, 2022
3 Downloads
MD5: 4d4231d07ac669e105f71e602457efea
Working with ISO disc images
Documentation
Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Files and Add Dataset Terms of Access

Restricting limits access to published files. You can add or edit Terms of Access for the dataset, and allow people to Request Access to restricted files.

Enable access request
Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.
Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Select File(s)

Please select one or more files.

Share Dataset

Share this dataset on your favorite social media networks.

Dataset Citations

Citations for this dataset are retrieved from Crossref via DataCite using Make Data Count standards. For more information about dataset metrics, please refer to the User Guide.

Sorry, no citations were found.
Restricted Files Selected

The selected file(s) may not be downloaded because you have not been granted access.

Download Options

The files selected are too large to download as a ZIP.

You can select individual files that are below the 4.0 GB download limit from the files table, or use the Data Access API for programmatic access to the files.

Select File(s)

Please select a file or files to be downloaded.

Restricted Files Selected

The restricted file(s) selected may not be downloaded because you have not been granted access.

Click Continue to download the files you have access to download.

Delete Dataset

Are you sure you want to delete this dataset and all of its files? You cannot undelete this dataset.

Delete Draft Version

Are you sure you want to delete this draft version? Files will be reverted to the most recently published version. You cannot undelete this draft.

Unpublished Dataset Private URL

Private URL can only be used with unpublished versions of datasets.

Unpublished Dataset Private URL

Are you sure you want to disable the Private URL? If you have shared the Private URL with others they will no longer be able to use it to access your unpublished dataset.

Delete Files

The file(s) will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Compute

This dataset contains restricted files you may not compute on because you have not been granted access.

Deaccession Dataset

Are you sure you want to deaccession? The selected version(s) will no longer be viewable by the public.

Deaccession Dataset

Are you sure you want to deaccession this dataset? It will no longer be viewable by the public.

Version Differences Details

Please select two versions to view the differences.

Version Differences Details
 
Version:
Last Updated:
Version:
Last Updated:
Select File(s)

Please select a file or files for access request.

Select File(s)

Embargoed files cannot be accessed. Please select an unembargoed file or files for your access request.

Edit Tags

Select existing file tags or create new tags to describe your files. Each file can have more than one tag.

Request Access

  You need to Log In to request access.

???file.mapData.unpublished.header???

???file.mapData.unpublished.message???

Dataset Terms

Please confirm and/or complete the information needed below in order to continue.

Linguistic Data Consortium Data Use Agreement

A. Except as to the extent prohibited by any user agreement, the user shall have the right to

  1. incorporate portions of the LDC (Linguistic Data Consortium) data into its own work products for internal, non-commercial use and not for redistribution,
  2. incorporate small excerpts of text or audio data from the LDC data for display or publication in a scientific or technical context, but only for the purpose of descriving the research and related issues, and
  3. publish statistics and other summaries of the LDC data.

B. License

Except as otherwise provided herein, the user shall have no right to copy, redistribute, transmit, publish, sell, transfer, or otherwise use the LDC data for any purpose. The user shall give appropriate attribution to the LDC data in all scholarly or similar publications for which the LDC data or potions thereof have been used.

C. Access to Individual Users

Only individuals who are then-current faculty, students or staff members of LDC Member institutions or consultants or individuals providing services or doing research for Member institutions shall have access to the LDC data.

D. Copyright

The LDC data is protected by copyright as a collective work or compilation under the laws of the United States and other countries. All content, material, and other elements comprising LDC data are also copyrighted works. Users must abide by all additional copyright notices or restrictions contained in the LDC data license agreement supplements.

Preview Guestbook

Upon downloading files the guestbook asks for the following information.

Account Information

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

-

https://abacus.library.ubc.ca/api/access/datafile/

Request Access

Please confirm and/or complete the information needed below in order to request access to files in this dataset.

Linguistic Data Consortium Data Use Agreement

A. Except as to the extent prohibited by any user agreement, the user shall have the right to

  1. incorporate portions of the LDC (Linguistic Data Consortium) data into its own work products for internal, non-commercial use and not for redistribution,
  2. incorporate small excerpts of text or audio data from the LDC data for display or publication in a scientific or technical context, but only for the purpose of descriving the research and related issues, and
  3. publish statistics and other summaries of the LDC data.

B. License

Except as otherwise provided herein, the user shall have no right to copy, redistribute, transmit, publish, sell, transfer, or otherwise use the LDC data for any purpose. The user shall give appropriate attribution to the LDC data in all scholarly or similar publications for which the LDC data or potions thereof have been used.

C. Access to Individual Users

Only individuals who are then-current faculty, students or staff members of LDC Member institutions or consultants or individuals providing services or doing research for Member institutions shall have access to the LDC data.

D. Copyright

The LDC data is protected by copyright as a collective work or compilation under the laws of the United States and other countries. All content, material, and other elements comprising LDC data are also copyrighted works. Users must abide by all additional copyright notices or restrictions contained in the LDC data license agreement supplements.

Compute Batch
Clear Batch
Dataset Dataset Persistent ID
Compute Batch
Submit for Review

You will not be able to make changes to this dataset while it is in review.

Publish Dataset

Are you sure you want to republish this dataset?

Select if this is a minor or major version update.

Publish Dataset

This dataset cannot be published until Linguistic Data Consortium is published by its administrator.

Publish Dataset

This dataset cannot be published until Linguistic Data Consortium and Abacus Data Network are published.

Return to Author

Return this dataset to contributor for modification.

Contact Abacus Data Network Support

Abacus Data Network Support

Please fill this out to prove you are not a robot.

+ =