Skip to Content
基于AWS的数据科学实践
book

基于AWS的数据科学实践

by Chris Fregly, Antje Barth
September 2022
Intermediate to advanced
549 pages
11h 27m
Chinese
China Electric Power Press Ltd.
Content preview from 基于AWS的数据科学实践
307
第 8 章
规模化训练与优化模型
杰夫
·
贝索斯最喜爱的商业战略家之一彼得
·
德鲁克(
Peter Drucker
)曾说过:“
If
you can
’
t measure it, you can
’
t improve it
(如果你不能衡量它,你就不能增长它)。”
这句名言概括了本章的本质,关注衡量、优化并改进我们的预测模型。
在第
7
章,我们使用
Amazon SageMaker
基于单独一组超参数训练了单个模型。我
们也演示了如何微调预训练的
BERT
模型来构建评价文本分类模型,用以大致预测
来源于社交渠道、合作网站等的产品评价的情绪。
在本章,我们将使用
SageMaker
实验(
Experiments
)来规模化地衡量、追踪、比较
并改善模型。之后,我们使用
SageMaker
超参数微调(
Hyper-Parameter Tuning
)为
特定的算法和数据集选择最佳超参数。接下来,我们也将展示如何使用不同的通信
策略和分布式文件系统进行分布式训练。最后,我们提供通过
SageMaker Autopilot
的超参数选择算法、
SageMaker
为
S3
优化的管道以及
AWS
的增强网络硬件来降低
开销并提升性能的技巧。
8.1
自动发现模型的最优超参数
既然我们理解了如何追踪并比较模型训练,我们就可以使用被称为超参数微调
(
hyper-parameter tuning, HPT
)或超参数优化(
hyper-parameter optimization,
HPO
)的可扩展过程,为数据集和算法自动寻找最佳超参数。
SageMaker
原生支持 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

设计机器学习系统

设计机器学习系统

Chip Huyen
Python设计模式(第2版)

Python设计模式(第2版)

Posts & Telecom Press, Chetan Giridhar
AWS认证数据工程师助理考试指南

AWS认证数据工程师助理考试指南

Sakti Mishra, Dylan Qu, Anusha Challa

Publisher Resources

ISBN: 9787519869663