LT World

Sections
Personal tools
Log in

Skip to content. | Skip to navigation

Supporters

provided by

dfki logo

with support by

eu star logofp7 logo

through

meta logo
clarin logo

as well as by

bmbf logo

through

take logo

You are here: Home kb Resources & Tools Language Data European Language Newspaper Text

European Language Newspaper Text


100 million words of French, 90 million words of German and 15 million words of Portuguese

  • German
  • French
  • Portuguese

  • Multilingual

  • Syntax
  • Morphology

morphosyntactically,

syntactic dependencies, POS

  • POS-tagged Text Corpus

  • Written

The European Language Newspaper Text corpus is also know as the French Language News Corpus. This corpus includes roughly 100 million words of French, 90 million words of German and 15 million words of Portuguese and has been marked using SGML. The text is taken from the following sources:

 

  1. Approximately 60 million words of text in French and German have been made available from the Associated Press (AP) World Stream. AP World Stream is a compilation of AP news reports produced in 86 bureaus in 68 countries.

    The Associated Press Worldstream newswire service provides articles in six languages, interleaved on a single data stream. The data is collected via an Associated Press installed telephone line at the LDC.

     

  2. Approximately 110 million words of text in French, German and Portuguese have been made available from Agence France Presse. Each language was supplied in separate data streams collected via a Dateno MKII satellite receiver and associated equipment at the LDC.

     

  3. Approximately 20 million words of text in German have been made available from Deutsche Presse Agentur. The text is collected via an AP Datafeatures telephone line installed at the Linguistic Data Consortium.

     

  4. A smaller part of the corpus comes from Le Monde newspaper. The Le Monde data covers about 5.6 million words of French. It is quite distinct from the AP and AFP materials in its markup approach, because it has been prepared in compliance with the conventions of the Text Encoding Initiative (TEI), rather than having been based on the model of the TIPSTER collections, which were originally developed prior to the establishment of the TEI conventions.

http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC95T11

  • Audio CD

  • Linguistic Data Consortium (LDC)

The Reduced Licensing Fee for this corpus is US$150.

  • David S. Graff

information retrieval, language modeling