Welcome to ExamInsight, a powerful application powered by the cutting-edge Pathway framework! This project revolutionizes exam preparation by leveraging the capabilities of Real-time Augmented Generation (RAG) to analyze exam papers and provide valuable insights to students and educators.

ExamInsight ingests data from PDFs of exam papers stored in its data folder and presents insightful analysis through an interactive Streamlit interface. Built with Pathway, Docker, and Streamlit, this application runs seamlessly in a production-ready, containerized environment. Its in-memory scalable vector store ensures efficient handling of data and adapts in real-time to any changes made to the PDFs. This means you're always working with the most up-to-date information, ensuring accurate analysis and relevant insights.

This project was initialized on 10/10/2024. For a detailed sequence of commands executed during the project setup, please refer to initial-commands.md.

• What Problem It Solves
• Architecture Overview
• Getting Started
• Demo
• Contributing
• Contact Information

ExamInsight directly addresses the challenge of effectively analyzing past exam papers to identify patterns and trends. Manually reviewing numerous papers is time-consuming and prone to bias. ExamInsight automates this process, providing data-driven insights into question patterns, frequently tested topics, and potential areas of difficulty.

The application currently ingests data from PDFs located in the data folder. However, one of its most powerful features is the ability to connect to external dynamic data sources. Imagine connecting ExamInsight to your Google Drive where exam papers are shared and updated! This opens up a world of possibilities for keeping your information current and relevant. For more information on connecting data sources, check out these resources:

• LLM App Examples
• Pathway App Templates

ExamInsight is built upon a robust and scalable architecture:

• Pathway: This powerful RAG framework forms the backbone of our application, enabling real-time updates and powering the live Gen AI features.
• Docker: By containerizing our application with Docker, we ensure easy deployment and management across different environments.
• Streamlit: Provides an intuitive and interactive web-based frontend for users to easily interact with ExamInsight, ask questions about the exam papers, and visualize the analysis.
• Local Data Folder for Data Ingestion: The data folder stores the PDFs that fuel the application. When connected to external data sources like Google Drive, ExamInsight dynamically adapts to changes, ensuring you always have the latest information.

Ready to experience the power of ExamInsight? Follow these steps:

Prerequisites:

• Docker
• Install Pathway: pip install pathway-ai

Installation:

1. Clone the repository:

   git clone https://github.com/muzammil-13/ExamInsights_app.git
   cd ExamInsights_app

2. Build the Docker image:

   docker build -t examinsight .

3. Run the project:

   docker run -p 8000:8000 -p 8501:8501 examinsight

Adding PDFs and Connecting Google Drive:

• Adding PDFs: Place your PDF files in the data folder.
• Connecting Google Drive: Follow the instructions in the documentation to configure Google Drive integration for live updates.

We welcome contributions from the community! If you'd like to contribute to ExamInsight, please follow our contribution guidelines outlined in CONTRIBUTING.md.

For any questions, suggestions, or collaboration opportunities, feel free to reach out to us at [email protected] .