[Research Spike] Collect open source implementations and frameworks of QA systems

[Shreyanand]

There are open source implementation and resources available for training QA models. We should collect and discuss those resources here. Once the discussion converges, we should use the frameworks for implementation.

[Shreyanand]

Language models

• T5
• BERT
• BART
• GPT-2
• BLOOM
• llama

Vectorstores

These can provide context windows for the QA tasks.

• ElasticVectorSearch
• Pinecone
• Weaviate (OS)
• FAISS (OS)
• Qdrant (OS)
• Chroma (OS)
• Milvus (OS)

Retrievers

• Dense passage retrieval DPR
• BM25

Extractive QA

• Huggingface AutoModelForQuestionAnswering
• Haystack ExtractiveQAPipeline

Generative QA

• Long form QA (lfqa) eli5 BART huggingface
• lfqa pinecone haystack
• haystack RAGenerator, Seq2SeqGenerator OpenAIAnswerGenerator
• Open book QA-generated

Other relevant sources

• Semantic search for already existing FA Questions (Like similar product questions on amazon website)
• Pinecone, Pinecone open-ai
• Langchain open ai prompt optimization and then QA
• Langchain openai Chatbot example
• End to end example of open-ai api used with Supabase documentation

Video Resources

1, 2, 3, 4

[codificat]

End to end example of open-ai api used with Supabase documentation

I just spotted a discussion about this one on hackernews

[Shreyanand]

Bucket these technologies

1. Free and open source: Huggingface, Haystack
2. Free to test but pay to use: Open-AI
3. Different licenses? Bloom

[Shreyanand]

chat-GPT style implementations that involve Reinforcement learning

Huggingface Transformer Reinforcement learning
Colossal AI
Lucidrains
OpenAssistant

[Shreyanand]

Frameworks

• GPT-index
• Langchain
• Haystack
• Huggingface

[goern]

do you have any conclusion we can feed back into https://docs.google.com/document/d/1W5bxcG0DKQU2cyajijp6v3pVfNxKUjmYGKMIv3rSO2o/edit# ?