CORPUS TOOLS FOR TYPE-LOGICAL GRAMMARS

INTRODUCTION

This is the first public release of my suite of corpus tools for type-logical grammars. At the moment, it is a considerably less polished (and more idiosyncratic) collection of utilities than Grail 3 which the collection is designed to work with. I hope people will find it useful nonetheless.

This research has received the generous support from the Conseil Regional d'Aquitaine, and benefited from the grants Grammaire du Français and Itipy.

All source code and model files are provided under the GNU lesser general public license and downloading any of these files constitutes an agreement to all the terms of this license.

MODELS

The models files below are meant to be used in conjunction with the Clark & Curran tools, which I highly recommend.

FRENCH MODELS

The French grammars as well as the procedure followed for extracting it are described in my TALN 2010 articles.

Moot, R. (2010), Semi-automated Extraction of a Wide-Coverage Type-Logical Grammar for French, Proceedings of Traitement Automatique des Langues Naturelles 2010, (TALN 2010), (pdf).

DUTCH MODELS

The Dutch grammar as well as the extraction procedure are described in the following book chapter;

Moot, R. (2010), Automated extraction of type-logical supertags from the Spoken Dutch Corpus, in Srinivas Bangalore and Aravind Joshi, eds, `Complexity of Lexical Descriptions and its Relevance to Natural Language Processing: A Supertagging Approach', MIT Press.

UTILITIES

The different corpus utilities are classified below according to their function.

CORPUS DISPLAY

CORPUS TRANSFORMATION

LEXICON EXTRACTION

MAXIMUM ENTROPY

These scripts perform several steps for transform the extracted lexicon into a format suitable for the maximum entropy supertagger and for evaluation the supertagger on the test data.

SUPERTAGGER

A series of Java files based on and requiring an installation of the Edinburgh maximum entropy tools. Used in coordination with the scripts above for training and evaluating the supertagger.

CORPUS SEARCH

These scripts provide some search functions I needed in order to get an idea of some of the constructions found in the corpus and the number of occurrences.

ERROR TRACKING

These scripts compare a tagged file to a correct file in order to find instances of a specific error made by the supertagger. This may help improving the maximum entropy models either by adding new features or by improving the extraction algorithm.

MODELS

DOWNLOAD

All files in one big tarball.

OTHER CORPUS RESOURCES

Richard.Moot@labri.fr