May 2024
Intermediate
252 pages
5h 31m
Chinese
Content preview from Ray 分布式机器学习：利用Ray 进行大模型的数据处理、训练、推理和部署
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
236
|
第
11
章
工作流编排
（
AirFlow 等
）
计算步骤
（
Spark 等
）
notebook
（
Colab 等
）
外部存储
（
S3 等
）
跟踪和指标
（
W&B 等
）
特征存储
（
Feast 等
）
KubeRay/Ray 自动扩展器
批量推理
批量推理
批量推理
模型服务
预处理
RayRay Ray
TensorFlow
训练
PyTorch
训练
Ray Cluster Ray Cluster Ray Cluster
图 11.2：使用 Ray AIR 和其他 ML 生态组件创建自定义 ML 平台
11.3
继续学习
从第
1
章对
Ray
的概述到本章介绍
Ray
的生态，我们学习了很多内容。虽然你
现在应该对
Ray Core
的基础知识、
Ray Cluster
的工作原理以及何时使用
AIR
及
其组成库（
Datasets
、
Train
、
RLlib
、
Tune
和
Serve
）有了很好的掌握，但关于
各个知识点仍有很多内容需要学习。
首先，
Ray Core
的用户指南（
https://oreil.ly/cX6vj
）深入介绍了
Ray
任务、执行
器和对象的使用，还介绍了它们在集群节点上的位置以及如何处理应用程序的
依赖项。特别地，你将学到有用的设计模式和反模式，以优化
Ray Core
程序，
避免常见陷阱。要了解更多关于
Ray
的内部工作原理，建议阅读一些关于
Ray
的论文，例如
Ray
的架构白皮书（
https://oreil.ly/lfW_h
）。
我们没有介绍
Ray
在可观测性方面的工具，具体可参考官方的
Ray
可观测性文
档（
https://oreil.ly/xDWtK ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.