A Large Language Model-based Web Application for Contextual Document Conversation
Journal Title: International Journal of Innovations in Science and Technology - Year 2024, Vol 6, Issue 4
Abstract
The emergence of Large Language Models (LLM), such as ChatGPT, Gemini, and Claude has ushered in a new era of natural language processing, enabling rich textual interactions with computers. However, despite the capabilities of these new language models, they face significant challenges when queried on recent information or private data not included in the model’s dataset. Retrieval Augmented Generation (RAG) overcame the problems mentioned earlier by augmenting user queries with relevant context from a user-provided document(s), thus grounding the model’s response to inaccurate source material. In research, RAG enables users to engage interactively with their documents, instead of manually reading through their document(s). Users provide their document(s) to the system, which is then converted into vector indices, and used to inject contextual information into the user prompt during retrieval. The augmented prompt then enables the language model to contextually answer user queries. The research is composed of a web application, with an intuitive interface for interacting with the LIama 3.2 1B, an open-source LLM. Users can upload their document(s) and chat with the LLM in the context of their uploaded document(s).
Authors and Affiliations
Asad Khan, Abdul Haseeb Malik, Talha Ahsan, Qazi Ejaz Ali
Keywords
Related Articles
- EP ID EP760589
- DOI -
- Views 11
- Downloads 0
Analyzing the Shadows:Machine Learning Approaches for Depression Detection on Twitter
Depression is a leading cause of disability worldwide, affecting approximately 4.4% of the global population. It can escalate from mild symptoms to severe outcomes, including suicide, if not treated early. Thus, develo...
Enhancing Three-Phase Induction Motor Performance with Soft Ramp Control
hree-phase induction motors experience high inrush currents during start-up, exceeding their rated capacity and potentially damaging stator windings. This paper explores the implementation of soft ramp control to addre...
Assessment of Public Participation Modalities through Social Media Platforms for Approval of Private Housing Schemes: Case Studies under LDA Lahore, Pakistan
Public participation through social media networks in Private housing scheme (PHS) projects is essential for fostering a feeling of community and avoiding resistance to the planning of housing scheme initiatives. It mi...
Impact of Internal Forces on Employee Behaviors: Role of Situational Factors
The current research investigated the effects of motivation, ability, and role perception (internal forces), also known as drivers on employee behaviors as well as to find out the moderating role of situational factors...
Contrasting Impact of Start State on Performance of AReinforcement Learning Recommender System
A recommendation problem and RL problem are very similar, as both try to increase user satisfaction in a certain environment. Typical recommender systems mainly rely on history of the user to give future recommendation...