March 18, 2023, 3:35 p.m.
Łukasz Kaiser - our graduate - among the authors of the GPT-4 system!
A few days ago, OpenAI released the GPT-4 system
One of the core contributors to the system was our alumnus Łukasz Kaiser, currently an employee of OpenAI, formerly in Google Brain. Łukasz served as Long context lead, and was also on the Long context research team. In addition, his contribution is also on a more fundamental level - the letter T in the name GPT (=Generative Pre-trained Transformer) is for Transformer, which stands for the neural network architecture developed in 2017, of which Łukasz was a co-developer. Łukasz is also a co-author of a popular library TensorFlow.
We encourage you to take a look at the system's technical report.
This Monday Łukasz was a guest on our deep learning seminar held by Marek Adamczyk.