# What have Large Language Models actually learned about language

Canonical page: https://dominiklukes.net/speaking/what-have-large-language-models-actually-learned-about-langu-2024

This talk will explore what exactly large language models (LLMs) have learned about languages, and why it matters. It will attempt an outline of an answer to how these models understand the structure of language, and how this compares to how humans think about language. To answer the question, it will look at how LLMs perform across a range of different languages, even those with smaller digital footprints, and what this implies about how they represent language.

It will contrast the results from this investigation with the latest findings from the field of "mechanistic interpretability." These findings offer insights into the inner workings of LLMs, offering clues about the fundamental differences between how we understand language and how language is represented inside the models.

Finally, it will suggest a need a new approach to LLM research that brings together a richer understanding of language and a systematic investigation into how LLMs perform across a variety of languages.

Talk · Wolfson College, OxfordXML · 26 November 2024

## About this item

- Type: Talk
- Date: 26 November 2024
- Venue: Wolfson College, OxfordXML
- Place: Oxford

## Related

- [Building with AI in education: How to make your own AI apps using large language models](https://dominiklukes.net/speaking/building-with-ai-in-education-how-to-make-your-own-ai-apps-u-2024) (Talk · 24 January 2024)
- [EdTech in Universities](https://dominiklukes.net/speaking/edtech-in-universities-2024) (Talk · 25 January 2024)
- [Magical Meaning Machines](https://dominiklukes.net/speaking/magical-meaning-machines-2024) (Talk · 20 November 2024)
- [Semantic Machines](https://dominiklukes.net/speaking/semantic-machines-2024) (Talk · 14 August 2024)
- [Talk and panel on AI at Tsinghua University](https://dominiklukes.net/speaking/talk-and-panel-on-ai-at-tsinghua-university-2024) (Talk · 20 March 2024)
- [Workshop at Learning Impact Europe 2024](https://dominiklukes.net/speaking/workshop-at-learning-impact-europe-2024-2024) (Talk · 9 October 2024)

Section: [Speaking](https://dominiklukes.net/speaking)