Meeting 50, 2023-08-18
- Bengt Sennblad
- Nikolay Oskolkov
When is the meeting? | 18-August-2023 at 10.00 - 11.00 |
Where is the meeting? | Zoom video-conference: http://meet.nbis.se/aiaio |
What is the meeting about? | “The attention concept in Deep Learning” (tentative title) |
Who is the responsible presenter? | Nikolay Oskolkov, NBIS, LU |
Abstract: Biological sequences can be viewed as text and therefore analyzed using natural language processing techniques. In this presentation, I will discuss text generation via attention mechanism that underlies some large language models such as ChatGPT, and compare it with more traditional Markov Chain and LSTM techniques. I will concentrate on deriving and coding attention mechanism from scratch and explaining its principles.
Presentation: (Please download and open in your computer - The Confluence wiki’s rendering of html files is not really good)
