You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Oct 18, 2021. It is now read-only.
For our models so far we've always done minimal amounts of preprocessing (anything OOV is mapped to UNK, that's about it). Preprocessing could help (and perhaps more so than with SMT, considering we have bigger issues with rare words), and Henry mentioned gaining 3 BLEU points by playing around with preprocessing, making it worthwhile to consider making this part of our pipeline.
The text was updated successfully, but these errors were encountered:
For our models so far we've always done minimal amounts of preprocessing (anything OOV is mapped to UNK, that's about it). Preprocessing could help (and perhaps more so than with SMT, considering we have bigger issues with rare words), and Henry mentioned gaining 3 BLEU points by playing around with preprocessing, making it worthwhile to consider making this part of our pipeline.
The text was updated successfully, but these errors were encountered: