💬 UML University Chatbot

❓ What

A University Chatbot for the University of Massachusetts Lowell that can answer a variety of questions about the university.
It uses RAG to index and vectorized data from UML's websites to query against for information.
The model and RAG DB management is performed using containers as the underlying technologies. Specifically through Ramalama

👨‍💻 Technologies

• Ramalama
• Retrieval Augmentation Generation
• AWS EKS
• AWS ECR OCI Compliant Registry
• AWS CDK(Managed)
• AWS EC2
• GitHub Actions CI/CD

➰ Workflow

Main Deployment

Ramalama deployed on AWS EKS (managed Kubernetes). ...

RAG

1. rag-runner container image hosted on gcp-rag-runner ECR repo. Builds and uploads RAG database image.
2. RAG database container image stored on another ECR repo
3. Manually trigger a Kubernetes Job to (re)build the RAG database

Important

To update any part of the RAG database building process, locally rebuild and push the rag-runner image to the ECR repo. Future jobs automatically fetch the new image.

🗫 Members

• Gurpreet Singh
• Nick Bottari
• Roshan Rajesh
• Nicolas Busse