Sponsor Presentations: Rethinking How We're Linking: What to do when speeding things up slows them down (Sponsor: Meta)

Thursday - May 16th, 2024 3:30 p.m.-4:30 p.m. in Room 309

Presented by:

Description

The common belief that re-writing Modules as CExtensions will improve performance only works to a point. At Meta, we operate at a massive scale with applications that can include over 20,000 shared libraries. When loading that many files, import performance slows down significantly. In this session, I will share how we greatly improved performance by statically linking native extensions into the runtime. Get ready for a quick overview of linkers and loaders, a brief foray into binary layout, and a deep dive into how Native extensions work in Python.