GALE Phase 3 and 4 Arabic Newswire Parallel Text

Version 1.1

Chen, Song; Krug, Gary; Strassel, Stephanie, 2015, "GALE Phase 3 and 4 Arabic Newswire Parallel Text", https://hdl.handle.net/11272.1/AB2/LJCNZH, Abacus Data Network, V1

Learn about Data Citation Standards.

Contact Owner

Dataset Metrics

5 Downloads

Description	Introduction GALE Phase 3 and 4 Arabic Newswire Parallel Text was developed by the Linguistic Data Consortium (LDC). Along with other corpora, the parallel text in this release comprised training data for Phases 3 and 4 of the DARPA GALE (Global Autonomous Language Exploitation) Program. This corpus contains Modern Standard Arabic source text and corresponding English translations selected from newswire data collected by LDC in 2007 and 2008 and transcribed and translated by LDC or under its direction. LDC has also released the following GALE Arabic Parallel Text data sets: GALE Phase 1 Arabic Broadcast News Parallel Text - Part 1 (LDC2007T24) GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2 (LDC2008T09) GALE Phase 1 Arabic Blog Parallel Text (LDC2008T02) GALE Phase 1 Arabic Newsgroup Parallel Text - Part 1 (LDC2009T03) GALE Phase 1 Arabic Newsgroup Parallel Text - Part 2 (LDC2009T09) GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 1 (LDC2012T06) GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 2 (LDC2012T14) GALE Phase 2 Arabic Newswire Parallel Text (LDC2012T17) GALE Phase 2 Arabic Broadcast News Parallel Text (LDC2012T18) GALE Phase 2 Arabic Web Parallel Text (LDC2013T01) GALE Phase 3 and 4 Arabic Broadcast Conversation Parallel Text (LDC2015T05) GALE Phase 3 and 4 Arabic Broadcast News Parallel Text (LDC2015T07) Data GALE Phase 3 and 4 Arabic Newswire Parallel Text includes 551 source-translation document pairs, comprising 156,775 tokens of Arabic source text and its English translation. Data is drawn from seven distinct Arabic newswire sources: Agence France Presse, Al Ahram, Al Hayat, Al-Quds Al-Arabi, An Nahar, Asharq Al-Awsat and Assabah. The files in this release were transcribed by LDC staff and/or transcription vendors under contract to LDC in accordance with the Quick Rich Transcription guidelines developed by LDC. Transcribers indicated sentence boundaries in addition to transcribing the text. Data was manually selected for translation according to several criteria, including linguistic features, transcription features and topic features. The transcribed and segmented files were then reformatted into a human-readable translation format and assigned to translation vendors. Translators followed LDC’s Arabic to English translation guidelines. Bilingual LDC staff performed quality control procedures on the completed translations. Source data and translations are distributed in TDF format. TDF files are tab-delimited files containing one segment of text along with meta information about that segment. Each field in the TDF file is described in TDF_format.txt. All data are encoded in UTF-8. Acknowledgement This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Subject	Other
Keyword	Linguistics

Change View

Table

Tree

Filter by

	1 to 3 of 3 Files
	LDC2015T19.iso Data/Optical Disc Image - 5.7 MB Published Aug 30, 2020 2 Downloads MD5: fc02c9d34c8ec619d83f71f9a2aa199e ISO disc image including all documentation and data Data	Access File File Access Restricted Users may not request access to files. Download Metadata Data File Citation EndNote XML RIS BibTeX
	LDC2015T19_File_Manifest.txt Documentation/Plain Text - 69.4 KB Published Aug 30, 2020 2 Downloads MD5: e30a5cef84f1b6a46c0cb42d4c0d86bd File manifest Documentation	Access File File Access Restricted Users may not request access to files. Download Metadata Data File Citation EndNote XML RIS BibTeX
	Working_with_ISO_Images.txt Documentation/Plain Text - 1.3 KB Published Aug 30, 2020 1 Download MD5: 4d4231d07ac669e105f71e602457efea Working with ISO disc images Documentation	Access File File Access Restricted Users may not request access to files. Download Metadata Data File Citation EndNote XML RIS BibTeX

Citation Metadata

Dataset Persistent ID	hdl:11272.1/AB2/LJCNZH
Publication Date	2015-08-17
Citation Date
Title	GALE Phase 3 and 4 Arabic Newswire Parallel Text
Other ID	Linguistic Data Consortium: LDC2015T19 ISBN: 1-58563-733-5 ISLRN: 859-613-244-400-3 DOI: https://doi.org/10.35111/jarg-t405
Author	Chen, Song Krug, Gary Strassel, Stephanie
Contact	Use email button above to contact. Abacus support
Description	Introduction GALE Phase 3 and 4 Arabic Newswire Parallel Text was developed by the Linguistic Data Consortium (LDC). Along with other corpora, the parallel text in this release comprised training data for Phases 3 and 4 of the DARPA GALE (Global Autonomous Language Exploitation) Program. This corpus contains Modern Standard Arabic source text and corresponding English translations selected from newswire data collected by LDC in 2007 and 2008 and transcribed and translated by LDC or under its direction. LDC has also released the following GALE Arabic Parallel Text data sets: GALE Phase 1 Arabic Broadcast News Parallel Text - Part 1 (LDC2007T24) GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2 (LDC2008T09) GALE Phase 1 Arabic Blog Parallel Text (LDC2008T02) GALE Phase 1 Arabic Newsgroup Parallel Text - Part 1 (LDC2009T03) GALE Phase 1 Arabic Newsgroup Parallel Text - Part 2 (LDC2009T09) GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 1 (LDC2012T06) GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 2 (LDC2012T14) GALE Phase 2 Arabic Newswire Parallel Text (LDC2012T17) GALE Phase 2 Arabic Broadcast News Parallel Text (LDC2012T18) GALE Phase 2 Arabic Web Parallel Text (LDC2013T01) GALE Phase 3 and 4 Arabic Broadcast Conversation Parallel Text (LDC2015T05) GALE Phase 3 and 4 Arabic Broadcast News Parallel Text (LDC2015T07) Data GALE Phase 3 and 4 Arabic Newswire Parallel Text includes 551 source-translation document pairs, comprising 156,775 tokens of Arabic source text and its English translation. Data is drawn from seven distinct Arabic newswire sources: Agence France Presse, Al Ahram, Al Hayat, Al-Quds Al-Arabi, An Nahar, Asharq Al-Awsat and Assabah. The files in this release were transcribed by LDC staff and/or transcription vendors under contract to LDC in accordance with the Quick Rich Transcription guidelines developed by LDC. Transcribers indicated sentence boundaries in addition to transcribing the text. Data was manually selected for translation according to several criteria, including linguistic features, transcription features and topic features. The transcribed and segmented files were then reformatted into a human-readable translation format and assigned to translation vendors. Translators followed LDC’s Arabic to English translation guidelines. Bilingual LDC staff performed quality control procedures on the completed translations. Source data and translations are distributed in TDF format. TDF files are tab-delimited files containing one segment of text along with meta information about that segment. Each field in the TDF file is described in TDF_format.txt. All data are encoded in UTF-8. Acknowledgement This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.
Subject	Other
Keyword	Linguistics (ACV)
Producer	Linguistic Data Consortium (University of Pennsylvania) (LDC) https://www.ldc.upenn.edu/
Production Date	2015-09-15
Production Place	Philadelphia
Grant Information	Defense Advanced Research Projects Agency: GALE Program Grant No. HR0011-06-1-0003
Distributor	Linguistic Data Consortium (University of Pennsylvania) (LDC) https://www.ldc.upenn.edu/
Deposit Date	2015-11-26
Date of Collection	Start: 2007 ; End: 2008
Kind of Data	Linguistic data
Series	LDC: Linguistic Data Consortium
Data Sources	Newswire

Geospatial Metadata

Geographic Coverage	United Arab Emirates Iran, Islamic Republic of Jordan Lebanon Oman Qatar Saudi Arabia Syrian Arab Republic

Social Science and Humanities Metadata

Study Level Error Notes	DCMI type: TextProject: GALEApplication: Machine translationLanguage: Standard Arabic, EnglishLanguage ID: arb, eng Previous handle https://hdl.handle.net/11272/EDRIU has been deprecated

Waiver

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation above, generated by the Dataverse.

No waiver has been selected for this dataset.

Linguistic Data Consortium Data Use Agreement

A. Except as to the extent prohibited by any user agreement, the user shall have the right to

incorporate portions of the LDC (Linguistic Data Consortium) data into its own work products for internal, non-commercial use and not for redistribution,
incorporate small excerpts of text or audio data from the LDC data for display or publication in a scientific or technical context, but only for the purpose of descriving the research and related issues, and
publish statistics and other summaries of the LDC data.

B. License

Except as otherwise provided herein, the user shall have no right to copy, redistribute, transmit, publish, sell, transfer, or otherwise use the LDC data for any purpose. The user shall give appropriate attribution to the LDC data in all scholarly or similar publications for which the LDC data or potions thereof have been used.

C. Access to Individual Users

Only individuals who are then-current faculty, students or staff members of LDC Member institutions or consultants or individuals providing services or doing research for Member institutions shall have access to the LDC data.

D. Copyright

The LDC data is protected by copyright as a collective work or compilation under the laws of the United States and other countries. All content, material, and other elements comprising LDC data are also copyrighted works. Users must abide by all additional copyright notices or restrictions contained in the LDC data license agreement supplements.

Disclaimer

Terms of Use

Introduction
1. The "Service" means, collectively, all aspects of the Abacus / NESSTAR and associated services and websites.
2. The term "Content" means the data, text, graphics, photos, sounds, music, videos, audiovisual combinations, interactive features, software, scripts, and any other electronic materials you may view on or access through the Service.
Your Acceptance of this Agreement
1. By clicking you agree to the terms and conditions of this Agreement, which supplement the policies, rules and requirements of your institution.
2. If you do not agree to these Terms of Use you must not log in, access, browse or otherwise use the Service. If you have questions or concerns, please contact abacus-support@lists.ubc.ca.
Use of the Service and Content
Use of the Service and Your Content. You may access and use the Content uploaded on the Service strictly in compliance with the copyright terms identified on or associated with such Content.
General Conditions of Use
1. Without limiting the foregoing and the prohibited uses set out in Policy #104, Acceptable Use and Security of UBC Electronic Information and Systems, which is hereby incorporated by reference, the following is not permitted:
  1. using any automated system, including without limitation, "robots," "spiders," or "offline readers," to harvest or scrape information from the Service or any part(s) thereof, or to send more request messages in a given period of time than a human can reasonably produce in the same period by using a conventional on-line web browser; or
  2. in any way intentionally placing undue burden on the technical systems or networks connected to the Service.
2. UBC may suspend your account, or access to the Service, if it learns or is credibly notified (as determined by UBC) that your conduct is in violation of these Terms of Use.
Liability and Indemnity
1. The Service and the Content is provided to you AS IS. You understand that UBC does not endorse any Content submitted to the Service by any user, or any opinion, recommendation, or advice expressed therein, and UBC expressly disclaims any and all liability in connection with Content, including without limitation all direct, indirect, special, incidental or consequential damage or any other damages whatsoever and howsoever caused, arising out of or in connection with the use of the Service or any Content, or in reliance on the Service or the Content.
2. In addition, the Service may contain links to third party websites. UBC has no control over, and assumes no responsibility for, the content, privacy policies, or practices of any third party websites.
3. You agree to indemnify and hold harmless UBC, its Board of Governors, agents, contractors, licensors, and licensees against any all claims arising from or in any way relating to your use of the Service.
Trademarks
Certain words, phrases, names, designs or logos used on the Site may constitute trademarks, service marks or trade names of the UBC or other entities. The display of any such marks or names on the Site does not imply that UBC or other entities have granted a license or authorization of any kind to use such marks or names. You may not use any of UBC's trademarks, service marks or trade names without UBC's prior written permission.
Choice of Law
The laws of the Province of British Columbia and the laws of Canada applicable therein shall govern as to the interpretation, validity and effect of this document, notwithstanding any conflict of laws provisions of your domicile, residence or physical location. You hereby consent and submit to the exclusive jurisdiction of the courts of the Province of British Columbia in any action or proceeding instituted under or related to your use of the Service.

Guestbook

No guestbook is assigned to this dataset, you will not be prompted to provide any information on file download.

Dataset Version	Summary	Contributors	Published on
No records found.

Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Files and Add Dataset Terms of Access

Restricting limits access to published files. You can add or edit Terms of Access for the dataset, and allow people to Request Access to restricted files.

Terms of Access

Request Access

Enable access request

Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.

Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Select File(s)

Please select one or more files.

Share Dataset

Share this dataset on your favorite social media networks.

Dataset Citations

Citations for this dataset are retrieved from Crossref via DataCite using Make Data Count standards. For more information about dataset metrics, please refer to the User Guide.

Sorry, no citations were found.

Restricted Files Selected

The selected file(s) may not be downloaded because you have not been granted access.

Download Options

The files selected are too large to download as a ZIP.

You can select individual files that are below the 4.0 GB download limit from the files table, or use the Data Access API for programmatic access to the files.

Select File(s)

Please select a file or files to be downloaded.

Restricted Files Selected

The restricted file(s) selected may not be downloaded because you have not been granted access.

Click Continue to download the files you have access to download.

Delete Dataset

Are you sure you want to delete this dataset and all of its files? You cannot undelete this dataset.

Delete Draft Version

Are you sure you want to delete this draft version? Files will be reverted to the most recently published version. You cannot undelete this draft.

Unpublished Dataset Private URL

Private URL can only be used with unpublished versions of datasets.

Unpublished Dataset Private URL

Are you sure you want to disable the Private URL? If you have shared the Private URL with others they will no longer be able to use it to access your unpublished dataset.

Delete Files

The file(s) will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Compute

This dataset contains restricted files you may not compute on because you have not been granted access.

Deaccession Dataset

Are you sure you want to deaccession? The selected version(s) will no longer be viewable by the public.

Deaccession Dataset

Are you sure you want to deaccession this dataset? It will no longer be viewable by the public.

Version Differences Details

Please select two versions to view the differences.

Version Differences Details

Version:
Last Updated:

Select File(s)

Please select a file or files for access request.

Select File(s)

Embargoed files cannot be accessed. Please select an unembargoed file or files for your access request.

Edit Tags

Select existing file tags or create new tags to describe your files. Each file can have more than one tag.

Request Access

You need to Log In to request access.

???file.mapData.unpublished.header???

???file.mapData.unpublished.message???

Dataset Terms

Please confirm and/or complete the information needed below in order to continue.

Linguistic Data Consortium Data Use Agreement

A. Except as to the extent prohibited by any user agreement, the user shall have the right to

incorporate portions of the LDC (Linguistic Data Consortium) data into its own work products for internal, non-commercial use and not for redistribution,
incorporate small excerpts of text or audio data from the LDC data for display or publication in a scientific or technical context, but only for the purpose of descriving the research and related issues, and
publish statistics and other summaries of the LDC data.

B. License

C. Access to Individual Users

D. Copyright

Preview Guestbook

Upon downloading files the guestbook asks for the following information.

Guestbook Name

Collected Data

Account Information

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

Download URL

https://abacus.library.ubc.ca/api/access/datafile/

Request Access

Please confirm and/or complete the information needed below in order to request access to files in this dataset.

Linguistic Data Consortium Data Use Agreement

A. Except as to the extent prohibited by any user agreement, the user shall have the right to

incorporate portions of the LDC (Linguistic Data Consortium) data into its own work products for internal, non-commercial use and not for redistribution,
incorporate small excerpts of text or audio data from the LDC data for display or publication in a scientific or technical context, but only for the purpose of descriving the research and related issues, and
publish statistics and other summaries of the LDC data.

B. License

C. Access to Individual Users

D. Copyright

Compute Batch

Clear Batch

Dataset	Dataset Persistent ID

Compute Batch

Submit for Review

You will not be able to make changes to this dataset while it is in review.

Publish Dataset

Are you sure you want to republish this dataset?

Select if this is a minor or major version update.

Minor Release (1.2)

Major Release (2.0)

Publish Dataset

This dataset cannot be published until Linguistic Data Consortium is published by its administrator.

Publish Dataset

This dataset cannot be published until Linguistic Data Consortium and Abacus Data Network are published.

Return to Author

Return this dataset to contributor for modification.