MATERIAL Farsi-English Language Pack

Version 1.0

Bills, Aric; Chouder, Sarra; Corey, Cassian; Davoodian, Marjan; Dubinski, Eyal; Ellis, Corinna; Farnam, Reza; Gibby, Paul; Hartwig, Luke; Kalnins, Dagmara; Kazi, Michael; Lam, Julie; Le, Hanh; Malyska, Nicolas; Marvi, Sarah; McConnell, Sara; Melot, Jennifer; Mensch, Alyssa; Moore, Alex; Morrison, Michelle; Paget, Shelley; Richardson, Frederick; Roberts, Annette; Rubino, Carl; Moaddel, Marjan Sadeghi, 2025, "MATERIAL Farsi-English Language Pack", https://hdl.handle.net/11272.1/AB2/WLFTJ6, Abacus Data Network, V1

Learn about Data Citation Standards.

Contact Owner

Dataset Metrics

1 Download

Description	Abstract Introduction MATERIAL Farsi-English Language Pack was developed by Appen for the IARPA (Intelligence Advanced Research Projects Activity) MATERIAL (Machine Translation for English Retrieval of Information in Any Language) program. It contains approximately 61 hours of Farsi conversational telephone speech, transcripts, English translations, annotations and queries. The MATERIAL program focused on underserved languages with the ultimate goal to build cross language information retrieval systems to find speech and text content using English search queries. Data The Farsi speech in this release represents that spoken in the Greater Tehran, Central/Southwest, Northeast, and Northwest dialect regions of Iran, as well as a standard formal dialect in use throughout the country. The gender distribution among speakers is approximately equal; speakers' ages range from 16 years to 67 years. Calls were made using different telephones (e.g., mobile, landline) from a variety of environments including the street, a home or office, a public place, and inside a vehicle. Transcripts cover approximately a third of the speech data, and approximately 3% of the speech data was translated into English. Further information about transcription and translation methodologies is contained in the documentation accompanying this release. Farsi-English Language Pack also includes English queries and their relevance annotations. Annotators marked transcripts by query (simple, conceptual, hybrid) and by their relevance to query search terms. Speech data is presented either as two channel wav or single channel sphere files, both in 8kHz A-law format. All text data is UTF-8 encoded. (2024-12-16)
Subject	Other
Keyword	Linguistics
Notes	DCMI Type(s): Sound, Text Sample Type: Alaw Sample Rate: 8000 Application(s): Information retrieval, speech recognition Language(s): English, Persian Language ID(s): eng, fas Metadata automatically created from https://catalog.ldc.upenn.edu/LDC2024S13 [28 Mar 2025]

Filter by

	1 to 3 of 3 Files
	LDC2024S13.iso Optical Disc Image - 3.3 GB Published Mar 28, 2025 1 Download MD5: b8e8336243ace95d41c46f3c35e5b547 ISO disc image containing all documentation and data Data	Access File File Access Restricted Users may not request access to files. Download Metadata Data File Citation EndNote XML RIS BibTeX
	LDC2024S13_File_Manifest.txt Plain Text - 205.6 KB Published Mar 28, 2025 0 Downloads MD5: b4378d6ad3042377216dfa2ff2452655 File manifest Documentation	Access File File Access Restricted Users may not request access to files. Download Metadata Data File Citation EndNote XML RIS BibTeX
	Working_with_ISO_Images.txt Plain Text - 1.3 KB Published Mar 28, 2025 0 Downloads MD5: 4d4231d07ac669e105f71e602457efea Working with ISO disc images Documentation	Access File File Access Restricted Users may not request access to files. Download Metadata Data File Citation EndNote XML RIS BibTeX

Citation Metadata

Dataset Persistent ID	hdl:11272.1/AB2/WLFTJ6
Publication Date	2025-03-28
Title	MATERIAL Farsi-English Language Pack
Other ID	Linguistic Data Consortium: LDC2024S13 ISLRN: 202-347-751-598-9 DOI: https://doi.org/10.35111/7dhe-8213
Author	Bills, Aric Chouder, Sarra Corey, Cassian Davoodian, Marjan Dubinski, Eyal Ellis, Corinna Farnam, Reza Gibby, Paul Hartwig, Luke Kalnins, Dagmara Kazi, Michael Lam, Julie Le, Hanh Malyska, Nicolas Marvi, Sarah McConnell, Sara Melot, Jennifer Mensch, Alyssa Moore, Alex Morrison, Michelle Paget, Shelley Richardson, Frederick Roberts, Annette Rubino, Carl Moaddel, Marjan Sadeghi
Contact	Use email button above to contact. Abacus Support
Description	Abstract Introduction MATERIAL Farsi-English Language Pack was developed by Appen for the IARPA (Intelligence Advanced Research Projects Activity) MATERIAL (Machine Translation for English Retrieval of Information in Any Language) program. It contains approximately 61 hours of Farsi conversational telephone speech, transcripts, English translations, annotations and queries. The MATERIAL program focused on underserved languages with the ultimate goal to build cross language information retrieval systems to find speech and text content using English search queries. Data The Farsi speech in this release represents that spoken in the Greater Tehran, Central/Southwest, Northeast, and Northwest dialect regions of Iran, as well as a standard formal dialect in use throughout the country. The gender distribution among speakers is approximately equal; speakers' ages range from 16 years to 67 years. Calls were made using different telephones (e.g., mobile, landline) from a variety of environments including the street, a home or office, a public place, and inside a vehicle. Transcripts cover approximately a third of the speech data, and approximately 3% of the speech data was translated into English. Further information about transcription and translation methodologies is contained in the documentation accompanying this release. Farsi-English Language Pack also includes English queries and their relevance annotations. Annotators marked transcripts by query (simple, conceptual, hybrid) and by their relevance to query search terms. Speech data is presented either as two channel wav or single channel sphere files, both in 8kHz A-law format. All text data is UTF-8 encoded. (2024-12-16)
Subject	Other
Keyword	Linguistics (Linguistic Data Consortium)
Notes	DCMI Type(s): Sound, Text Sample Type: Alaw Sample Rate: 8000 Application(s): Information retrieval, speech recognition Language(s): English, Persian Language ID(s): eng, fas Metadata automatically created from https://catalog.ldc.upenn.edu/LDC2024S13 [28 Mar 2025]
Producer	Linguistic Data Consortium https://www.ldc.upenn.edu/
Distribution Date	2024-12-16
Deposit Date	2024-12-16
Series	LDC: Linguistic Data Consortium
Data Sources	Telephone conversations

Waiver

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation above, generated by the Dataverse.

No waiver has been selected for this dataset.

User License Agreement for MATERIAL Farsi-English Language Pack (LDC2024S13)

(“User”) agrees to use the data designated as MATERIAL Farsi-English Language Pack (LDC2024S13) (the “Data”) and distributed by the Linguistic Data Consortium (“LDC”) subject to the following understandings, terms and conditions.

User agrees to use the Data received under this Agreement only for non-commercial linguistic education, research and technology development.

User may include limited excerpts from the Data in articles, reports and other documents describing the results of User’s non-commercial linguistic education, research and technology development. Unless explicitly permitted herein, User shall not otherwise publish, retransmit, disclose, display, copy, reproduce or redistribute the Data. User shall have no right to copy, redistribute, transmit, publish or otherwise use the Data for any other purpose.

Please see the README in each delivery archive for more details on the Data.

As a recipient of the Data, User agrees to:

Insert the following statement in any product, report, publication, presentation, and/or other document that references the data: “This product contains or makes use of IARPA data, MATERIAL Farsi-English Language Pack (LDC2024S13).”
Accept the Data “as is.” User is solely responsible for any damage that may arise from its use of the Data. User agrees to hold the US Government (“USG”), the source of the Data, harmless and to indemnify the USG for all liabilities, demands, damages, expenses and losses arising out of its use for any purpose of the Data. Unless prohibited by law, User assumes all liability for claims for damages against it by third parties which may arise from the use, storage, or disposal of the Data, regardless of whether such liability is based on breach of contract, tort, strict liability, breach of warranties, infringement of intellectual property, failure of essential purpose or otherwise.
Not further distribute the Data.

LDC has entered into a License Agreement with IARPA to distribute the Data. Under the terms of that License Agreement, LDC may be required to identify recipients of the Data to IARPA.

User shall give appropriate reference to the Data in scholarly publications whenever they are mentioned. The following citation format is required:

Aric Bills, Sarra Chouder, Cassian Corey, Marjan Davoodian, Eyal Dubinski, Corinna Ellis, Reza Farnam, Paul Gibby, Luke Hartwig, Dagmara Kalnins, Michael Kazi, Julie Lam, Hanh Le, Nicolas Malyska, Sarah Marvi, Sara McConnell, Jennifer Melot, Alyssa Mensch, Alex Moore, Michelle Morrison, Shelley Paget, Frederick Richardson, Annette Roberts, Carl Rubino, Marjan Sadeghi Moaddel, Bern Samko, Kenneth Saw, Pradeepti Sen, Rosanna Smith, Jonathan Taylor, Brian Thompson, Audrey Tong, Richard Tong, Andrew Weller, Sasha Wilmoth, Jennifer Yu, Ilya Zavorin. MATERIAL Farsi- English Language Pack LDC2024S13. Web Download. Philadelphia: Linguistic Data Consortium, 2024.

Guestbook

No guestbook is assigned to this dataset, you will not be prompted to provide any information on file download.

Dataset Version	Summary	Contributors	Published on
No records found.

Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Files and Add Dataset Terms of Access

Restricting limits access to published files. You can add or edit Terms of Access for the dataset, and allow people to Request Access to restricted files.

Terms of Access

Request Access

Enable access request

Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.

Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Select File(s)

Please select one or more files.

Share Dataset

Share this dataset on your favorite social media networks.

Dataset Citations

Citations for this dataset are retrieved from Crossref via DataCite using Make Data Count standards. For more information about dataset metrics, please refer to the User Guide.

Sorry, no citations were found.

Restricted Files Selected

The selected file(s) may not be downloaded because you have not been granted access.

Download Options

The files selected are too large to download as a ZIP.

You can select individual files that are below the 4.0 GB download limit from the files table, or use the Data Access API for programmatic access to the files.

Select File(s)

Please select a file or files to be downloaded.

Restricted Files Selected

The restricted file(s) selected may not be downloaded because you have not been granted access.

Click Continue to download the files you have access to download.

Delete Dataset

Are you sure you want to delete this dataset and all of its files? You cannot undelete this dataset.

Delete Draft Version

Are you sure you want to delete this draft version? Files will be reverted to the most recently published version. You cannot undelete this draft.

Unpublished Dataset Private URL

Private URL can only be used with unpublished versions of datasets.

Unpublished Dataset Private URL

Are you sure you want to disable the Private URL? If you have shared the Private URL with others they will no longer be able to use it to access your unpublished dataset.

Delete Files

The file(s) will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Compute

This dataset contains restricted files you may not compute on because you have not been granted access.

Deaccession Dataset

Are you sure you want to deaccession? The selected version(s) will no longer be viewable by the public.

Deaccession Dataset

Are you sure you want to deaccession this dataset? It will no longer be viewable by the public.

Version Differences Details

Please select two versions to view the differences.

Version Differences Details

Version:
Last Updated:

Select File(s)

Please select a file or files for access request.

Select File(s)

Embargoed files cannot be accessed. Please select an unembargoed file or files for your access request.

Edit Tags

Select existing file tags or create new tags to describe your files. Each file can have more than one tag.

Request Access

You need to Log In to request access.

???file.mapData.unpublished.header???

???file.mapData.unpublished.message???

Dataset Terms

Please confirm and/or complete the information needed below in order to continue.

User License Agreement for MATERIAL Farsi-English Language Pack (LDC2024S13)

User agrees to use the Data received under this Agreement only for non-commercial linguistic education, research and technology development.

Please see the README in each delivery archive for more details on the Data.

As a recipient of the Data, User agrees to:

Insert the following statement in any product, report, publication, presentation, and/or other document that references the data: “This product contains or makes use of IARPA data, MATERIAL Farsi-English Language Pack (LDC2024S13).”
Accept the Data “as is.” User is solely responsible for any damage that may arise from its use of the Data. User agrees to hold the US Government (“USG”), the source of the Data, harmless and to indemnify the USG for all liabilities, demands, damages, expenses and losses arising out of its use for any purpose of the Data. Unless prohibited by law, User assumes all liability for claims for damages against it by third parties which may arise from the use, storage, or disposal of the Data, regardless of whether such liability is based on breach of contract, tort, strict liability, breach of warranties, infringement of intellectual property, failure of essential purpose or otherwise.
Not further distribute the Data.

LDC has entered into a License Agreement with IARPA to distribute the Data. Under the terms of that License Agreement, LDC may be required to identify recipients of the Data to IARPA.

User shall give appropriate reference to the Data in scholarly publications whenever they are mentioned. The following citation format is required:

Preview Guestbook

Upon downloading files the guestbook asks for the following information.

Guestbook Name

Collected Data

Account Information

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

Download URL

https://abacus.library.ubc.ca/api/access/datafile/

Request Access

Please confirm and/or complete the information needed below in order to request access to files in this dataset.

User License Agreement for MATERIAL Farsi-English Language Pack (LDC2024S13)

User agrees to use the Data received under this Agreement only for non-commercial linguistic education, research and technology development.

Please see the README in each delivery archive for more details on the Data.

As a recipient of the Data, User agrees to:

Insert the following statement in any product, report, publication, presentation, and/or other document that references the data: “This product contains or makes use of IARPA data, MATERIAL Farsi-English Language Pack (LDC2024S13).”
Accept the Data “as is.” User is solely responsible for any damage that may arise from its use of the Data. User agrees to hold the US Government (“USG”), the source of the Data, harmless and to indemnify the USG for all liabilities, demands, damages, expenses and losses arising out of its use for any purpose of the Data. Unless prohibited by law, User assumes all liability for claims for damages against it by third parties which may arise from the use, storage, or disposal of the Data, regardless of whether such liability is based on breach of contract, tort, strict liability, breach of warranties, infringement of intellectual property, failure of essential purpose or otherwise.
Not further distribute the Data.

LDC has entered into a License Agreement with IARPA to distribute the Data. Under the terms of that License Agreement, LDC may be required to identify recipients of the Data to IARPA.

User shall give appropriate reference to the Data in scholarly publications whenever they are mentioned. The following citation format is required:

Compute Batch

Clear Batch

Dataset	Dataset Persistent ID

Compute Batch

Submit for Review

You will not be able to make changes to this dataset while it is in review.

Publish Dataset

Are you sure you want to republish this dataset?

Select if this is a minor or major version update.

Minor Release (1.1)

Major Release (2.0)

Publish Dataset

This dataset cannot be published until Linguistic Data Consortium is published by its administrator.

Publish Dataset

This dataset cannot be published until Linguistic Data Consortium and Abacus Data Network are published.

Return to Author

Return this dataset to contributor for modification.