| CARVIEW |
News 1
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed in mollis sem, nec luctus ligula. Duis ullamcorper turpis ac purus pretium lacinia non ut metus. Nunc scelerisque urna mollis neque tristique rutrum. Aenean metus turpis, hendrerit id porta non, viverra ut felis. Etiam ultricies vulputate quam vitae molestie. Mauris a fermentum turpis. Donec leo nisi, porttitor et rhoncus vitae, dictum vitae arcu. Etiam tincidunt accumsan arcu, et pellentesque lorem. Nullam lobortis turpis at scelerisque dapibus. Fusce in cursus lorem. Vestibulum a pretium turpis, ut dapibus dolor. Aenean quis lacus nec nulla interdum sodales. Fusce facilisis viverra condimentum.
UTTER Unified Transcription and Translation
for Extended Reality
UTTER's Final In-Person Meeting
Final Meeting of the UTTER Project📍 Amsterdam | June 11–13, 2025The UTTER project reached a key milestone with its final...
View moreFSTP Second Call
Our Horizon Europe project, UTTER, invites project proposals from research organizations and SMEs to develop and/or pilot...
FSTP call tab, for the essential documentation pertaining to the Submission & Evaluation process.Proposals are to be submitted via our proposal management portal at:
https://utter-fstp.science.uva.nl
' onClick="gtag('event','news',{ event_category:'click_news_slider', event_label:'FSTP Second Call'})"> View more
UTTER 2nd User Day
Save the date and join us on July 5th for our 2nd User Day where we will explore multilingual and multimodal LLMs and the future...
CascadeFundingOpportunities!This event is fully remote and open to the public.
Secure your spot now for July 5th here:
.jpg)
' onClick="gtag('event','news',{ event_category:'click_news_slider', event_label:'UTTER 2nd User Day'})"> View more
news
Partner Impact: NAVER LABS Europe in UTTER
2025-10-07
NAVER LABS Europe has shared their impressive results and innovations developed within the HE-UTTER project in their latest...
here' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'Partner Impact: NAVER LABS Europe in UTTER'})"> View moreUTTER at MT Marathon 2025 in Helsinki
2025-09-02
At this year’s Machine Translation Marathon (August 25–29, Helsinki ), UTTER partners from the University of Edinburgh and...
(see the video here)The Marathon was a valuable opportunity to showcase UTTER’s work, exchange ideas with the MT community, and push forward research on more fair, more inclusive language technologies.
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'UTTER at MT Marathon 2025 in Helsinki'})"> View more
UTTER Co-organizes AutoMin 2025
2025-08-18
🚀 We’re excited to be part of the organizing team for AutoMin 2025– a workshop dedicated to advancing research on Automatic...
https://naverlabs.zoom.us/j/9262839636)The program includes:
🔹 Keynotes from leading experts in industry and research
🔹 Presentations from the AutoMin 2025 shared task teams
🔹 Discussions on the future of automatic meeting summarization
Full program & details 👉https://ufal.github.io/automin-2025/index.html
Organizers:
Tirthankar Ghosal (Oak Ridge National Laboratory, US)
Ondrej Bojar (Charles University, Prague, Czech Republic)
Laurent Besacier (Naver Labs Europe, France)
Thibaut Thonet (Naver Labs Europe, France)
Kartik Shinde (SproutsAI, US / India)' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'UTTER Co-organizes AutoMin 2025'})"> View more
🚀 UTTER @ IWSLT 2025 🎤
2025-08-04
UTTER participated in advancing research on speech LLMS by proposing TWO systems to the instruction-following shared task.
Two AI prototypes to boost human-AI interaction
2025-07-21
As part of the Horizon Europe UTTER Project, we’ve developed two innovative AI prototypes designed to enhance human-AI...
Customer Service Assistant Prototype
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'Two AI prototypes to boost human-AI interaction'})"> View more
UTTER's Final In-Person Meeting
2025-06-13
Final Meeting of the UTTER Project
📍 Amsterdam | June 11–13, 2025
The UTTER project reached a key milestone with its final...
View moreUTTER among top European model builders using...
2025-06-12
We're proud to share that our very own Professor André Martins represented the EuroLLM and UTTER projects in two prominent...
Building and Customizing AI Models for European Applications: From Foundation to Fine-TuningResearchers at GTC – Accelerating Scientific Discovery: NVIDIA Technologies in the Lab
In an exciting moment for the team, both EuroLLM and UTTER were featured in NVIDIA CEO Jensen Huang’s keynote, underlining their growing significance in Europe’s AI landscape.
Stay tuned as we continue to contribute to the development of open, sovereign, and cutting-edge AI in Europe.
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'UTTER among top European model builders using...'})"> View more
2nd Workshop on UncertaiNLP
2025-06-10
We are excited to announce the 2nd Workshop on Uncertainty-Aware NLP (UncertaiNLP) – a dedicated venue for advancing research...
https://lnkd.in/etrhaMUB' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'2nd Workshop on UncertaiNLP'})"> View moreSuccesses from UTTER’s FSTP Projects
2025-05-20
We’re excited to share the recent progress and achievements from FSTP projects supported by UTTER. These innovative...
INFINITY' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'Successes from UTTER’s FSTP Projects'})"> View moreUTTER at COLING 2025
2025-01-17
UTTER contributed to COLING 2025 with two key papers presented by the team, including Laurent Besacier (NAVER LABS Europe):
📌...
Paper | GitHub📌 Speech Foundation Models & Crowdsourcing for Efficient, High-Quality Data Collection – Explores how foundation models and crowdsourcing enhance speech data collection. Paper
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'UTTER at COLING 2025'})"> View moreUTTER FSTP Open Call 2 Results Announced!
2024-12-16
We’re thrilled to reveal the results of UTTER’s FSTP Open Call 2, part of the Horizon Europe Unified Transcription and...
Results-FSTP2.pdf' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'UTTER FSTP Open Call 2 Results Announced!'})"> View moreEuroLLM-9B Released!
2024-12-04
We’re excited to announce EuroLLM-9B, a 9-billion-parameter model trained on 4 trillion tokens across all EU languages + 11...
Technical blog postUTTER's 2nd In-Person Meeting
2024-09-17
This year's UTTER in-person meeting took place in sunny Lisbon.
We came together to share new ideas, discuss our vision and...
View moreTower LLM Accepted to COLM24!
2024-09-05
We’re thrilled to share that Tower LLM, an open multilingual large language model designed for translation-related tasks, ...
View moreHE-UTTER Second User Day Recordings available...
2024-07-05
For everyone who couldn't join UTTER's 1st User Day on July 5th: Take a look at the recordings of the event here!
2nd User Day | Project Overview with Vlad Niculae2nd User Day | Research Spotlight with Ben Peters
2nd User Day| Research Spotlight with Marcely Zanan Boito
2nd User Day | More on EU Projects with Sébastien Bratières
2nd User Day | Keynote: Nuno Guerreiro on Tower LLM
2nd User Day | Keynote: Eneko Agirre on Latxa
2nd User Day | Keynote: Simone Conia on Minerva
2nd User Day | LLM research Discussion
2nd User Day |1st FSTP Call Presentations: SURE GB (Orfeas Menis)
2nd User Day | 1st FSTP Call Presentations: DeMint (Juan Antonio Pérez Ortiz)
2nd User Day | 1st FSTP Call Presentations: InCroMin (Marko Cechovic)
2nd User Day | What´s next? 2nd round of Cascade Funding Announcement
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'HE-UTTER Second User Day Recordings available...'})"> View moreUTTER 2nd User Day
2024-06-20
Save the date and join us on July 5th for our 2nd User Day where we will explore multilingual and multimodal LLMs and the...
CascadeFundingOpportunities!This event is fully remote and open to the public.
Secure your spot now for July 5th here:
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'UTTER 2nd User Day'})"> View more
FSTP Second Call
2024-05-01
Our Horizon Europe project, UTTER, invites project proposals from research organizations and SMEs to develop and/or pilot...
FSTP call tab, for the essential documentation pertaining to the Submission & Evaluation process.Proposals are to be submitted via our proposal management portal at:
https://utter-fstp.science.uva.nl
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'FSTP Second Call'})"> View more
UTTER Co-Organizes the First UncertaiNLP Workshop
2024-03-27
UTTER has co-organized the first UncertaiNLP workshop, held alongside the 18th EACL Conference in Malta. Focused on...
View more🚀 UTTER YouTube Channel is live!
2023-10-30
You can now explore a range of content, from UTTER User Day to our latest collaborations and contributions in multimodal LLMs...
UTTER YouTube Channel.' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'🚀 UTTER YouTube Channel is live!'})"> View moreThe FSTP call will be open for submission soon!
2023-07-26
Our Horizon Europe project, UTTER, invites project proposals from research organizations and SMEs to develop and/or pilot...
FSTP call tab or the EU Funding and tenders protal, for the essential documentation pertaining to the Submission & Evaluation process.Proposals are to be submitted via our proposal management portal at:
https://utter-fstp.science.uva.nl
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'The FSTP call will be open for submission soon!'})"> View more
HE-UTTER First User Day Recordings available,...
2023-07-05
For everyone who couldn't join UTTER's 1st User Day on July 5th: Take a look at the recordings of the event here!
Demo-José... Demo-José SousaHE-UTTER FIRST USER DAY
2023-07-03
🌟 Exciting Announcement! 🌟
UTTER USER DAY - JOIN US IN BUILDING THE NEXT GENERATION OF MULTIMODAL EXTENDED REALITY TECHNOLOGIES
July 5th, 2023
13h30 - 17h30 UTC+1
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'HE-UTTER FIRST USER DAY'})"> View more
UTTER's first in-person meeting
2023-06-19
We held the HE-UTTER's first two-day physical meeting in Amsterdam. It was an outstanding opportunity to come together,...
View moreAbout UTTER
2022-10-01
In the last almost three years, the pandemic forced us into our homes, where we endured a stream of lockdowns. We had to...
View moreevents
UTTER Final In-Person Meeting
Date: 11th-13th June, 2025
Location: Amsterdam
UTTER Second In-Person Meeting
Date: 9th-10th September, 2024
Location: Lisbon
UTTER 2nd User Day
Date: 5th July, 2024
Location: online
HE-UTTER 1st User Day
Date: 5th July, 2023
Location: online
UTTER First In-Person Meeting
Date: 19th-20th June, 2023
Location: Amsterdam
UTTER Kick-off meeting
Date: 24th-27th October, 2022
Location: online
FSTP CALLS
Concluded FSTP-funded projects
2025-07-01
UTTER has supported 15 FSTP projects - all successfully completed!
Explore highlights of the concluded FSTP projects...
-Massive Language Adaptation of LLMsSECOND CALL
- DETOX -DETOX
- Cognifit Harmony -Cognifit Harmony
- TEASE -TEASE
- INFINITY -INFINITY
- Vision AI for XR -Vision AI for XR
- SwarmChat -SwarmChat
- EOLAS -EOLAS
For more detail including descriptions and summary of results follow the following links:
- D06/D1.2 UTTER's Report on 1st set of FSTP projects
- D11/D1.3 UTTER's Report on 2nd set of FSTP projects
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'Concluded FSTP-funded projects'})"> View more
Results - UTTER 2nd FSTP Call
2024-12-16
Results of UTTER FSTP Open call 2 for recipients of financial support
Project Horizon European Unified Transcription and...
on UTTER's and on the European commission Funding and tender opportunities website on May 1st, 2024. Both the final decisions and the selected projects are formally communicated, on December 9th, 2024 and published on UTTER's website on December 16th, 2024: https://he-utter.eu/#fstp.The selected projects' details can be accessed via the following link:
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'Results - UTTER 2nd FSTP Call '})"> View moreFunding Opportunity -FSTP 2nd open Call
2024-05-01
FINANCIAL SUPPORT FOR THIRD PARTIES (FSTP) CALL 2
Funding opportunity for research organization and SMEs – development and...
Call documentationSubmissions are only accepted during the submission period through UTTER's proposal management portal https://utter-fstp.science.uva.nl
Questions can be emailed to: utter-fstp@list.uva.nl
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'Funding Opportunity -FSTP 2nd open Call'})"> View moreResults - UTTER 1st FSTP Call
2023-12-21
Results of UTTER FSTP Open call 1 for recipients of financial support
Project Horizon European Unified Transcription and...
The selected project's details can be accessed via the following link:
FSTP OPEN Call 1 -Selected Projects
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'Results - UTTER 1st FSTP Call '})"> View more
Funding opportunity- FSTP 1st open Call
2023-07-06
FINANCIAL SUPPORT FOR THIRD PARTIES (FSTP) CALL 1
Funding opportunity for research organization and SMEs – development and...
FSTP- Key FactsProposals are to be submitted via UTTER’s proposal management portal at: https://utter-fstp.science.uva.nl
Please check out these two video recordings showcasing our project prototypes:
' onClick="gtag('event','news',{ event_category:'click_news_card', event_label:'Funding opportunity- FSTP 1st open Call '})"> View more
FSTP Call- Key Facts
Below are the tentative key facts for the UTTER FSTP funding. For the final version, check each of the calls.
● Improving or demonstrating efficiency of XR model inference;
● Improving or demonstrating efficiency of XR model training;
● Designing interfaces for usability;
● Extending XR models to new languages, domains or modalities;
● Applying XR models to new tasks;
● Building resources for XR models;
● Evaluation of XR models
Approx. €895,206 to be distributed in total (€424,240 in the second call).
● Horizon Europe eligible countries;
● One organization per project only (i.e. no collaborative multi-party projects);
● Only one proposal per applying institution will be considered;
● Resubmission in the second call is allowed.
● Lightweight submission and evaluation procedure.
● Technical approach;
● Business, Integration and Dissemination (“BID”) plan;
● Budget adequacy;
● Team.
(1) Development;
(2) Dissemination.
● published: July 2023
● project submission period: August – October 2023
● project start: January 2024
● project duration: 6 – 9 months
Second call
● published: May 2024
● project submission period: May – July 2024
● project start: January 2025
● project duration: 6 months
1. 50 % after signing the contract;
2. 50 % after demonstrating and disseminating results.
Abstract
In a sentence, UTTER will take online and hybrid interaction to the next level, where users interact in an extended reality. We will develop the technology which will make that possible and we will demonstrate it in two use cases.
We will develop conversation platforms in which human agents interact while being assisted by AI agents.
- We have a use case focussed on speech dialogue
- And another focused on multilingual chat-based dialogues
Our meeting assistant will empower users of videoconferencing tools, with capabilities such as summarisation, minuting, and retrieval.
Our multilingual customer support assistant empowers a customer service agent to provide support in any language.
Objectives
In UTTER we will develop technologies that will provide the next level of support for online and hybrid meetings, that will offer an eXtended Reality (XR) experience. We will provide the type of meeting support that would normally only have been possible with a personal assistant, such as automatically taking minutes and summaries, and providing transcripts. Our XR models will also be applied to online customer support.
The main project objectives are:
1. Research: Advancing research in responsible creation and application of multilingual, multimodal pretrained XR models
- Advance the state-of-the-art in multimodal, multilingual pre-trained models and their application to downstream tasks. This project will focus on making them customizable, efficient, and ethical.
2. Deployment: Development of new methods and algorithms for adapted, contextualised, and robust dialogue assistant XR models
- Leverage multimodal models to deliver tools which provide a new paradigm in quality, robustness, and contextualisation capabilities for dialogue assistant components such as transcription, translation, and summarisation.
3. Integration: Development of tools for online meetings and customer support agents
- Design and implementation of interfaces to visualise, edit and publish transcripts, minutes, combined with meeting platforms like Zoom to deliver multilingual transcription and translation support.
4. Exploitation: Sustainable, maintainable platform and services
- Development of a plan for sustainable exploitation and use of the platforms, systems and technologies developed in UTTER.
5. Dissemination: Dissemination and communication of project results to stakeholders
- Dissemination and communication of project results to stakeholders and user group. Successful promotion and use of platform in the pilots run under the financial support to third parties call.
Results
UTTER's Core Outputs
Find all of our models and data on Hugging Face, and our code repositories on GitHub.
- Models, datasets and tools
- Models, datasets and tools [2025-09-30]
- Workshops, shared tasks and schools
- Workshops, shared tasks and schools [2025-09-30]
Dissemination
This section includes all dissemination and communication activities related to the project needed to reach the goals, promote the UTTER Project results, and maximise its impact. The UTTER Consortium will ensure dissemination of its results and communication with its audiences and interested parties in several ways, through multiple dissemination and communication channels.
Find out more below
- Vision
- Goals [2021-10-30]
- Participation in Events
- Participation in Events [2025-09-30]
- Publications
- Publications [2025-09-30]
partners
partners / contact
Universiteit van Amsterdam
[ UVA ]
Netherland
Maryam Hashemi Shabestari
Maryam Hashemi Shabestari
Project manager
Unbabel
[ UNB ]
Portugal
Maria Henriques
Maria Henriques
Dissemination coordinator
Instituto de Telecomunicações
[ IT ]
Portugal
André Martins
André Martins
Scientific coordinator and Researcher
Naver Labs Europe
[ NAV ]
France
Laurent Besacier
Laurent Besacier
Innovation coordinator and Researcher
The University of Edinburgh
[ UEDIN ]
United Kingdom
Alexandra Birch
Alexandra Birch
Ethics coordinator and Researcher
This project has received funding from the European Union’s Horizon Europe Research and Innovation programme under Grant Agreement No 101070631 and from the UK Research and Innovation (UKRI) under the UK government's Horizon Europe funding guarantee (Grant No 10039436). Views and opinions expressed are however those of the UTTER consortium only and do not necessarily reflect those of the European Union and UKRI. Neither the European Union nor the UKRI nor the granting authority can be held responsible for them.
graph - chart
documents
UTTER's 1st Ethics Review
UTTER's Data Management Plan
UTTER's final report on adaptable and context-aware models
UTTER's final report on data and resources
UTTER's final report on efficient, usable models
UTTER's final report on uncertainty-aware, robust and explainable models
UTTER's final report on XR models
UTTER's first prototype evaluation report
UTTER's first report on adaptable and context
UTTER's first report on data and resources
UTTER's first report on efficient usable models
UTTER's first Report on Uncertainty-Aware, Robust and Explainable Models
UTTER's first report on XR models
UTTER's Report on first set of FSTP projects
UTTER's report on second set of FSTP projects
UTTER's Second Ethics Review
UTTER's Second prototype evaluation report
UTTER's third ethics review
UTTER's third prototype evaluation report
contact us
project netboard login
