Sentence 4556 has more than 256 words. Can not handle such long sentence. Please cut it short first!

[ajesujoba]

I want to create a suffix array index of the source and target sides of my training bitext. But it appears I cannot process sentences with more than 256 words. Is there a way I can increase the maximum number of words per sentence to 512 or 1024?

[hieuhoang]

no idea I'm afraid. No one has worked on the code for years. If you fix it, please create a pull request