September 2022
Intermediate to advanced
549 pages
11h 27m
Chinese
Content preview from 基于AWS的数据科学实践
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
278
｜
第
7
章
训练任务小结
训练阶段耗时
训练总时长： 8h 36m 46s
初始化： 6m 48s 838ms
训练循环： 8h 28m 58s...
完成： 58s 214ms
发现的问题
检查瓶颈，减少阻塞式调用，更换分布式训练策略，
增大批次。
规则触发次数： 4072
违规次数： 4072
数据点数量： 62013
p95阈值： 70%
p5阈值： 10%
窗口： 500
耐心值： 1000
图 7-29：SageMaker 调试器的深度剖析分析模型训练任务
7.12
阐述和解释模型预测
我们也可以使用
SageMaker
调试器在训练过程中追踪梯度、层级和权重。我们将使
用其监控模型训练过程中
BERT
的注意力机制。通过理解模型如何学习，我们可以
更好地识别模型的偏差并可能解释模型的预测。为了做到这一点，我们需要捕捉张
量（
tensors
）作为
SageMaker
调试器的“集合（
collections
）”，包括注意力分数、
查询向量和键向量。该信息之后可用于绘制查询向量和键向量中的注意力头（
heads
）
和独立神经元。让我们创建在训练中以一定间隔使用正则表达式捕捉注意力张量的
DebuggerHookConfig
和
CollectionConfig
：
debugger_hook_config = DebuggerHookConfig(
s3_output_path=s3_bucket_for_tensors,
collection_configs=[
CollectionConfig(
name="all", ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.