Postdoctoral Researcher in Large Language Models and Knowledge Graphs (m/f/d)

Temporary, Full-time · Heidelberg

Read job description in:
Das sind Ihre Aufgaben
HITS is looking for a 
 
Postdoctoral Researcher in Large Language Models and Knowledge Graphs (m/f/d)
 
to join the Machine Learning and Artificial Intelligence (MLI) Group to perform research at the intersection of large language models and knowledge graphs. A known disadvantage of large language models is their lack of factual correctness. Often it is not clear if generated content is factually correct, and even worse, often it is not possible to decide based on the generated output if the answer is correct: The generated content of a large language model sounds confident independently of its correctness.

 The current state-of-the-art approach for making language models more factual is based on so called retrieval augmented generation, where additional input data is appended to a user’s query.
In this project, we want to develop an alternative approach that does not only add additional information to a user’s query, but instead combines inference within a language model with inference on structured data such as knowledge graphs and Bayesian networks, with the goal of making the language model more factual. To this end we develop a joint inference process that combines inference in a transformer model with inference on structured data and derive these inference algorithms in a common theoretical framework.
Ihr Profil
Your role
  • Conduct cutting-edge research in machine learning at the intersection of large language models (LLMs) and structured data such as knowledge graphs
  • Publish your research findings at major machine learning conferences such as Neurips, ICML, and ICLR.
  • Collaborate with other members of the research group
  • Supervision of research interns, bachelor- and master-students.
 
What qualifies you for this job
  • PhD in a machine learning related field such as Computer Science, Mathematics, or Physics
  • Theoretical knowledge in machine learning
  • Publications at conferences such as Neurips, ICML, ICLR, or AISTATS
  • Theoretical understanding and practical experience in at least two of the following fields
    • Graph Neural Networks
    • Inference in Knowledge Graphs
    • Inference in Bayesian Networks and Factor Graphs
    • Transformer Models
  • Experience in building prototypes in machine learning frameworks such as PyTorch and Tensorflow
 
If you are not familiar with all of the above - this position provides the perfect opportunity to gain experience in the remaining fields.
Warum wir?
The environment of this job
  • Ideal working environment with our own high-performance computing infrastructure and access to national high-performance computers
  • You will work within a highly motivated team of individual researchers in a collaborative working environment
  • Our institute provides an interdisciplinary research environment and lots of opportunities for interdisciplinary collaboration
  • The MLI research group has connections to world leading industrial (Microsoft Research, Samsung AI, Google Deepmind) as well as academic research labs (Cambridge, Edinburgh, MIT, ETH Zurich).
  • This is a temporary position from 1.9.2024 – 31.8.2025.
 
HITS benefits
  • Option for location-flexible working
  • Extensive social benefits, such as: 
    • Subsidized cafeteria meals 
    • Job ticket
    • Allowance for further training and career development 
    • Company pension plan and additional health care benefits 
    • Many more individually selectable benefits
    • 30 days of paid vacation 
    • Family-friendly working environment 
Learn more about Working at HITS
 
For any additional information regarding the position please contact Jun.-Prof. Dr. Jan Stühmer
  • Cover letter, including your motivation
  • Curriculum vitae
  • Relevant academic certificates
  • Summary of research accomplishments 
  • Names and contact information for two references. 
HITS gGmbH stands for equal opportunities and we strongly believe that our research benefits from inclusive and diverse teams.
Über uns
Das HITS (Heidelberger Institut für Theoretische Studien) wurde 2010 von dem Physiker und SAP-Mitbegründer Klaus Tschira (1940-2015) und der Klaus Tschira Stiftung als privates, gemeinnütziges Forschungsinstitut gegründet. Es betreibt Grundlagenforschung in den Naturwissenschaften, der Mathematik und der Informatik. Zu den Hauptforschungsrichtungen zählen komplexe Simulationen auf verschiedenen Skalen, Datenwissenschaft und -analyse sowie die Entwicklung rechnergestützter Tools für die Forschung. Die Anwendungsfelder reichen von der Molekularbiologie bis zur Astrophysik. Ein wesentliches Merkmal des Instituts ist die Interdisziplinarität, die in zahlreichen gruppen- und disziplinübergreifenden Projekten umgesetzt wird. Die Grundfinanzierung des HITS wird von der Klaus Tschira Stiftung bereitgestellt.

Your mission
HITS is looking for a 
 
Postdoctoral Researcher in Large Language Models and Knowledge Graphs (m/f/d)
 
to join the Machine Learning and Artificial Intelligence (MLI) Group to perform research at the intersection of large language models and knowledge graphs. A known disadvantage of large language models is their lack of factual correctness. Often it is not clear if generated content is factually correct, and even worse, often it is not possible to decide based on the generated output if the answer is correct: The generated content of a large language model sounds confident independently of its correctness.

 The current state-of-the-art approach for making language models more factual is based on so called retrieval augmented generation, where additional input data is appended to a user’s query.
In this project, we want to develop an alternative approach that does not only add additional information to a user’s query, but instead combines inference within a language model with inference on structured data such as knowledge graphs and Bayesian networks, with the goal of making the language model more factual. To this end we develop a joint inference process that combines inference in a transformer model with inference on structured data and derive these inference algorithms in a common theoretical framework.
Your profile
Your role
  • Conduct cutting-edge research in machine learning at the intersection of large language models (LLMs) and structured data such as knowledge graphs
  • Publish your research findings at major machine learning conferences such as Neurips, ICML, and ICLR.
  • Collaborate with other members of the research group
  • Supervision of research interns, bachelor- and master-students.
 
What qualifies you for this job
  • PhD in a machine learning related field such as Computer Science, Mathematics, or Physics
  • Theoretical knowledge in machine learning
  • Publications at conferences such as Neurips, ICML, ICLR, or AISTATS
  • Theoretical understanding and practical experience in at least two of the following fields
    • Graph Neural Networks
    • Inference in Knowledge Graphs
    • Inference in Bayesian Networks and Factor Graphs
    • Transformer Models
  • Experience in building prototypes in machine learning frameworks such as PyTorch and Tensorflow
 
If you are not familiar with all of the above - this position provides the perfect opportunity to gain experience in the remaining fields.
Why us?
The environment of this job
  • Ideal working environment with our own high-performance computing infrastructure and access to national high-performance computers
  • You will work within a highly motivated team of individual researchers in a collaborative working environment
  • Our institute provides an interdisciplinary research environment and lots of opportunities for interdisciplinary collaboration
  • The MLI research group has connections to world leading industrial (Microsoft Research, Samsung AI, Google Deepmind) as well as academic research labs (Cambridge, Edinburgh, MIT, ETH Zurich).
  • This is a temporary position from 1.9.2024 – 31.8.2025.
 
HITS benefits
  • Option for location-flexible working
  • Extensive social benefits, such as: 
    • Subsidized cafeteria meals 
    • Job ticket
    • Allowance for further training and career development 
    • Company pension plan and additional health care benefits 
    • Many more individually selectable benefits
    • 30 days of paid vacation 
    • Family-friendly working environment 
Learn more about Working at HITS
 
For any additional information regarding the position please contact Jun.-Prof. Dr. Jan Stühmer 
  • Cover letter, including your motivation
  • Curriculum vitae
  • Relevant academic certificates
  • Summary of research accomplishments 
  • Names and contact information for two references. 
HITS gGmbH stands for equal opportunities and we strongly believe that our research benefits from inclusive and diverse teams.
About us
HITS, the Heidelberg Institute for Theoretical Studies, was established in 2010 by physicist and SAP co-founder Klaus Tschira (1940-2015) and the Klaus Tschira Foundation as a private, non-profit research institute. HITS conducts basic research in the natural, mathematical, and computer sciences. Major research directions include complex simulations across scales, making sense of data, and enabling science via computational research. Application areas range from molecular biology to astrophysics. An essential characteristic of the Institute is interdisciplinarity, implemented in numerous cross-group and cross-disciplinary projects. The base funding of HITS is provided by the Klaus Tschira Foundation.

We look forward to receiving your application for this position.
We appreciate your interest in our institute. Please fill in the following short form.  You also have the possibility to upload your documents. Contact details of referees can be uploaded in a separate document under "Other". Should you have any difficulties uploading your files, please contact us by mail at jobs@h-its.org.
Uploading document. Please wait.
Please add all mandatory information with a * to send your application.