Fast and Efficient Parallel Alignment Model for Aligning both Long and Short Sentences
Chandramma1, Sameena H S2, Sandhya Soman3, Piyush Kumar Pareek4
1Mrs. Chandramma, Department of Computer Science & Engineering, Vivekananda Institute of Technology, Bengaluru (Karnataka), India.
2Ms. Sameena, Assistant Professor, Department of Computer Science and Engineering, Global Academy of Technology, Bengaluru (Karnataka), India.
3Ms. Sandhya Soman, Assistant Professor, Kristu Jayanti College, Bengaluru (Karnataka), India.
4Dr. Piyush Kumar Pareek, Department of Computer Science & Engineering, East West Group of Institutions, Bengaluru (Karnataka), India.
Manuscript received on 21 May 2019 | Revised Manuscript received on 11 June 2019 | Manuscript Published on 27 June 2019 | PP: 73-77 | Volume-8 Issue-1C May 2019 | Retrieval Number: A10150581C19/2019©BEIESP
Open Access | Editorial and Publishing Policies | Cite | Mendeley | Indexing and Abstracting
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC-BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: Recently, demand for fast and efficient translation system been widely seen. However, translation model are dependent parallel corpora. However, it is challenging to obtain large parallel corpora for resource starved language such as Kannada-Telugu pair. The existing Giza++ based word alignment and Moses phrase based alignment model are efficient for aligning only short sentences. However, for longer sentence the accuracy of model degrades. For performing alignment for longer sentences, neural based alignment has been presented in recent times. However, these models are trained using fixed vector length. Thus, induces memory and training overhead. For overcoming research challenges, this work presents a parallel alignment model using recurrent neural network (RNN). Further, to utilize memory efficiently and minimize training time parallel execution of RNN under GPU is considered. For improving alignment accuracy presented a cost function by combing statistical and neural based alignment method. Experiment are conducted to evaluate the proposed alignment model in terms of accuracy, Word alignment error (WAE), memory utilization, and computation time.
Keywords: Neural Alignment Model, Phrase Alignment, Statistical Alignment, Word Alignment Model.
Scope of the Article: Open Models and Architectures