Best LLMs for document classification

[oreju]

Hello everyone,

I’m really excited about this repository! I was wondering if anyone could share which LLM solution—or combination of LLMs—they’ve tried with ExtractThinker that produced the best results.

Thanks!

[enoch3712]

Hello @oreju

You can look at the tests:

https://github.com/enoch3712/ExtractThinker/blob/main/tests/test_classify.py

You have several examples, and personally i use small models followed by bigger models, like gpt4o-mini followed by gpt4o if is not over the treshold.

This example is clear in the test_mom_classification_layers test