Published January 10, 2021 | Version 1.0.1
Dataset Open

ENGLISH-AKUAPEM TWI PARALLEL CORPUS

Description

This dataset (verified_data.csv) is bilingual machine translation training corpus for English and Akuapem Twi of 25,421 sentence pairs. 
A transformer-based machine translator was used to generate initial translations in Akuapem Twi, which were later verified and corrected where necessary by native speakers. 
The main idea of a typical use case for the dataset is for further training of machine translation models in Akuapem Twi.
The data can also be used for other downstream NLP tasks such as Named Entity Recognition and POS tagging, with appropriate additional annotations. 
Another potential application is training unsupervised embeddings for the Akuapem Twi language.
In addition a higher quality 697 crowdsourced sentences (crowdsourced_data.csv) are provided for use as an evaluation set for the tasks highlighted above. It is recommended as a testing dataset for machine translation English to Twi and Twi to English models.

Acknowledgement: This project was supported by the AI4D language dataset fellowship through K4all and Zindi Africa

Files

crowdsourced_data.csv

Files (1.8 MB)

Name Size Download all
md5:3666cad4504712a2fdb45a18a61202ed
35.6 kB Preview Download
md5:64f236fe3c3067a5924fd52773443810
2.7 kB Preview Download
md5:8c64d25f35a163709a736c1063cd966b
1.8 MB Preview Download