Skip to main content
EuroPython logo

Representation is King: The Journey to Quality Dialog Embeddings

Track:
PyData: LLMs
Type:
Talk
Level:
intermediate
Room:
Terrace 2A
Start:
11:20 on 12 July 2024
Duration:
30 minutes

Abstract

In natural language processing, embeddings are crucial for understanding textual data. In this talk, we’ll explore sentence embeddings and their application in dialog systems. We’ll focus on a use case involving the classification of dialogs.

We’ll demonstrate the necessity of sentence transformers for this problem, specifically utilizing one of the top-performing small-sized sentence transformers. We will show how to fine-tune this model with both labeled and unlabeled dialog data, using the SentenceTransformers Python framework.

This talk is practical, packed with easy-to-follow examples, and aimed at building intuition around this topic. While some basic knowledge of Transformers would be beneficial, it is not required. Newcomers are also welcome.

Recording


Resources