Logo image
LLM Chatbot for Autonomous User Support in High-Performance Computing (HPC)
Conference proceeding

LLM Chatbot for Autonomous User Support in High-Performance Computing (HPC)

Rajesh Pasupuleti, Ravi Vadapalli, Christopher Mader and Subhan Shakoor
Proceedings (IEEE International Conference on Emerging Technologies and Factory Automation), pp.1487-1493
2025-12-03

Abstract

Amplitude shift keying Artificial intelligence (AI) Autonomous User Support Chatbot Circuits Cloud computing Data Centers Feedback Feedback loop High-Performance Computing (HPC) HTTP Internet Large Language Models Media Access Control Open AI Protocols Systems Administration Virtual private networks
This manuscript represents a transformative approach to High-Performance Computing (HPC) operations and support through a Large Language Model (LLM)-based chatbot. The proposed system is designed to autonomously resolve up to 70% of commonly raised tickets, significantly reducing the operational workload and response times. By utilizing advanced fine-tuning methodologies on domain-specific HPC documentation, the chatbot ensures high accuracy, context relevance, and adaptability to complex user queries. The study emphasizes the pivotal role of prompt engineering in maximizing the chatbot's effectiveness, showcasing tailored strategies to craft precise, task-oriented prompts. We also highlight systematic evaluation methods, including accuracy metrics, usability testing, and real-world performance benchmarks, to assess and refine the chatbot's operational performance and impact. Furthermore, the framework underscores the scalability of LLM-based solutions for broader HPC challenges, such as resource allocation, job scheduling, and systems administration. This work not only enhances operational efficiency but also sets a foundation for integrating intelligent automation in HPC workflows, driving innovation and elevating the user experience in computational environments.

Metrics

1 Record Views

Details

Logo image