Menu

Oct. 20, 2024, 12:11 p.m.

Łukasz Kaiser, co-author of the famous paper 'Attention is all you need!' and a graduate in computer science and mathematics from the University of Wrocław, receives the NEC C&C Prize. Congratulations!

The paper introduced the concept of transformers - a groundbreaking neural network architecture. The original application was machine translation, but now it is widely used in a vast number of applications, including natural language processing, computer vision, reinforcement learning, audio, robotics, and even chess.

Transformers are best known as the 'T' in the acronym 'GPT'. This architecture was also used in the AlphaFold system, for which a Nobel Prize in Chemistry was recently awarded.
 

Łukasz Kaiser and Jen-Hsun Huang (CEO of NVIDIA) during a panel dedicated to 'Attention Is All You Need' (NVIDIA materials)
Łukasz Kaiser and Jen-Hsun Huang (CEO of NVIDIA) during a panel dedicated to 'Attention Is All You Need' (NVIDIA materials)