April 2025
Intermediate to advanced
408 pages
11h 50m
Portuguese (Portugal, Brazil)
book
Processamento de linguagem natural com transformadores, edição revisada
by Lewis Tunstall, Leandro von Werra, Thomas Wolf
Content preview from Processamento de linguagem natural com transformadores, edição revisada
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Capítulo 3. Anatomia do transformador
Este trabalho foi traduzido com recurso a IA. Agradecemos o teu feedback e comentários: translation-feedback@oreilly.com
No Capítulo 2, vimos o que é preciso para afinar e avaliar um transformador. Agora vamos dar uma olhada em como eles funcionam nos bastidores. Neste capítulo, exploraremos os principais blocos de construção dos modelos de transformadores e como implementá-los usando o PyTorch. Também forneceremos orientações sobre como fazer o mesmo no TensorFlow. Primeiro, vamos nos concentrar na construção do mecanismo de atenção e, em seguida, adicionar os bits e peças necessários para fazer um codificador de transformador funcionar. Também vamos dar uma breve olhada nas diferenças arquitetônicas entre os módulos codificador e decodificador. No final deste capítulo, você será capaz de implementar um modelo simples de transformador!
Embora um conhecimento técnico profundo da arquitetura do Transformer não seja geralmente necessário para utilizar 
Transformers e afinar modelos para o teu caso de utilização, pode ser útil para compreender e navegar pelas limitações dos transformers e utilizá-los em novos domínios.
Este capítulo também apresenta uma taxonomia de transformadores para te ajudar a entender o zoológico de modelos que surgiram nos últimos anos. Antes de mergulhar no código, vamos começar com uma visão geral da arquitetura original ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.