Master Thesis: Multimodal Demo Selection

Join our Team

About this opportunity

This master's thesis will explore Multimodal Feedback-Guided Demonstration Selection. The goal is to move beyond simple similarity-based retrieval and investigate whether demonstrations can be selected based on their actual usefulness to the model. The project will consider the complete demonstration - image, question/instruction, and answer; and will investigate how multiple complementary demonstrations can be selected efficiently.

The topic sits at the intersection of multimodal AI, retrieval, LLMs, in-context learning, and representation learning, with opportunities for both practical system development and research-oriented experimentation.

What you will do

You will design, implement, and evaluate a demonstration-selection framework for Large Multimodal Models.

Your work will include:

• Reviewing research on multimodal in-context learning, demonstration retrieval, vision-language models, and feedback-guided prompting

• Implementing baseline retrieval methods such as random, visual similarity, textual, and multimodal retrieval

• Building a feedback-guided retriever that learns which demonstrations are useful based on changes in LMM performance

• Representing demonstrations using their image, question/instruction, and answer, rather than visual information alone

• Investigating a selection of multiple demonstrations while considering usefulness, diversity, and redundancy

• Evaluating the impact of demonstration ordering and context size

• Conducting experiments on established multimodal benchmarks using open-source LMMs

• Performing ablation studies to understand which components contribute most to performanc

• Comparing the proposed approach with existing methods, including GRIP

• Analyzing results and documenting findings in a master's thesis and, where appropriate, a research publication

The skills you bring

• Background in Computer Science, Artificial Intelligence, Data Science, Electrical Engineering, or a related field

• Good programming skills in Python

• Knowledge of machine learning and deep learning

• Familiarity with PyTorch or similar ML frameworks

• Basic understanding of Transformers and neural representation learning

• Interest in Large Language Models, Computer Vision, NLP, or Multimodal AI

• Experience with Hugging Face, vision-language models, GPU computing, or contrastive learning is an advantage

• An analytical and research-oriented mindset, with the ability to design experiments and interpret results independently

Why join Ericsson?

At Ericsson, you´ll have an outstanding opportunity. The chance to use your skills and imagination to push the boundaries of what´s possible. To build solutions never seen before to some of the world’s toughest problems. You´ll be challenged, but you won’t be alone. You´ll be joining a team of diverse innovators, all driven to go beyond the status quo to craft what comes next.

What happens once you apply?

Click Here to find all you need to know about what our typical hiring process looks like.Encouraging a diverse and inclusive organization is core to our values at Ericsson, that's why we champion it in everything we do. We truly believe that by collaborating with people with different experiences we drive innovation, which is essential for our future growth. We encourage people from all backgrounds to apply and realize their full potential as part of our Ericsson team. Ericsson is proud to be an Equal Opportunity Employer. learn more.

Primary country and city: Sweden (SE) || Stockholm

Req ID: 790806