Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filtered dataset is None #1

Open
Iambestfeed opened this issue Aug 6, 2023 · 2 comments
Open

Filtered dataset is None #1

Iambestfeed opened this issue Aug 6, 2023 · 2 comments

Comments

@Iambestfeed
Copy link

I tried run this example on your repo but i get output is None
image
I really don't know what's going on, can you help me.

@AlekseyKorshuk
Copy link
Owner

Hey, I can't see any None in the photo you provided. This is just one sample that is empty string. The reason could be because of cleaners. This example is just to show how to configure yaml file for both cleaners and filters.
To try something reasonable, you can run another example with instructions.

@Iambestfeed
Copy link
Author

@AlekseyKorshuk
Here is the notebook where I ran the example and found the error.
https://colab.research.google.com/drive/1N858KtJuuAl14fbYCht-HUp3aoMGn-uo?usp=sharing
Looks like the problem lies with the clearners. It causes filtered texts to become ''

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants