PhD-Developing Continual Adaptive Learning Techniques for Large Language Models in Neural Information Retrieval
PhD @Loughborough University posted 21 hours agoJob Description
Project details
This PhD project investigates the critical challenge of catastrophic forgetting in neural information retrieval (NIR) systems. Contemporary NIR architectures exhibit significant performance degradation when integrating new information while attempting to preserve existing knowledge – a fundamental limitation in our expanding digital landscape.
Background:
Neural information retrieval has transformed traditional search systems through innovative deep learning implementations. Modern approaches include embedding-based architectures (DRMM, KNRM, DUET) and pre-training based frameworks (BERTdot, ColBERT), which have demonstrated remarkable success in static environments. However, these models face considerable challenges in continuous learning scenarios.
The phenomenon of catastrophic forgetting emerges as a central challenge when models incorporate new information, leading to deterioration of previously acquired knowledge. While continual learning strategies have shown promising results across various domains, their application within NIR systems demands deeper exploration, particularly concerning topic distribution shifts and data volume dynamics. Moreover, adaptive learning strategies are necessary to ensure models can adjust effectively to evolving data and retrieval requirements without compromising performance.
Existing NIR systems require complete retraining to integrate new information—an approach that is computationally demanding and impractical for real-world deployment. Recent research suggests promising directions in applying continual learning to NIR, yet fundamental challenges remain in developing specialised strategies, understanding topic shifts, and implementing efficient memory management solutions.
Research Objectives:
1. Develop a framework for continual and adaptive learning in NIR systems, addressing catastrophic forgetting while enabling the model to dynamically adjust to new data and retrieval tasks.
2. Design and optimise advanced continual learning strategies, focusing on memory management, handling topic diversity, and adapting to variations in data volume, ensuring models can learn continuously and flexibly.
3. Integrate domain adaptation techniques and refine evaluation metrics, ensuring the scalability and practical efficiency of the proposed strategies across dynamic information retrieval environments.
4. Case Study: Apply the developed methods in a real-world NIR system to demonstrate their practical effectiveness in dynamic and ever-evolving environments.
94% of Loughborough’s research impact is rated world-leading or internationally excellent. REF 2021
Supervisors
Primary supervisor:Â Professor Georgina Cosma
Entry requirements
Our entry requirements are listed using standard UK undergraduate degree classifications i.e. first-class honours, upper second-class honours and lower second-class honours.
Entry requirements for United Kingdom
Applicants should have, or expect to achieve, at least a 2:1 Honours degree (or equivalent) in computer science or a related subject. A relevant Master’s degree and/or experience in one or more of the following will be an advantage: artificial intelligence, information sciences, mathematics with experience in programming.
English language requirements
Applicants must meet the minimum English language requirements. Further details are available on the International website.
Applicants must meet the minimum English language requirements. Further details are available on the International website.
Fees and funding
Tuition fees for 2024-25 entry
UK fee
£4,786 Full-time degree per annum
International fee
£27,500 Full-time degree per annum
Tuition fees for 2025-26 entry
UK fee
£5,006 Full-time degree per annum
International fee
£28,600 Full-time degree per annum
Fees for the 2024-25 academic year apply to projects starting in October 2024, January 2025, April 2025 and July 2025.Fees for the 2025-26 academic year apply to projects starting in October 2025, January 2026, April 2026 and July 2026.
Tuition fees cover the cost of your teaching, assessment and operating University facilities such as the library, IT equipment and other support services. University fees and charges can be paid in advance and there are several methods of payment, including online payments and payment by instalment. Fees are reviewed annually and are likely to increase to take into account inflationary pressures.
How to apply
All applications should be made online. Under programme name, select Computer Science. Please quote the advertised reference number: CO/GC – SF4/2025 in your application.
To avoid delays in processing your application, please ensure that you submit a CV and the minimum supporting documents.
The following selection criteria will be used by academic schools to help them make a decision on your application. Please note that this criteria is used for both funded and self-funded projects.
Please note, applications for this project are considered on an ongoing basis once submitted and the project may be withdrawn prior to the application deadline, if a suitable candidate is chosen for the project.
