May 2024
Intermediate
252 pages
5h 31m
Chinese
Content preview from Ray 分布式机器学习：利用Ray 进行大模型的数据处理、训练、推理和部署
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Ray
集群
|
195
（例如
Promtail
）的
sidecar
（边车）容器中（
https://oreil.ly/LyEGy
）。
容器的
STDERR
日志记录
另一种方法是将日志重定向到
STDERR
。为此，可在所有
Ray
容器上设置
环境变量
RAY_LOG_TO_STDERR=1
。对于
Kubernetes
配置，这意味着在每个
Ray
groupSpec
的
Ray
容器的
env
字段中添加一个条目：
env:
...
- name: "RAY_LOG_TO_STDERR"
value: "1"
...
然后，可以使用面向
STDERR
和
STDOUT
流的
Kubernetes
日志记录工具进行日志
聚合。
9.3
使用
Ray
集群启动器
Ray
集群启动器的目标是在任何云环境中轻松部署
Ray
集群。
Ray
集群启动器
的功能如下所示：
•
使用云提供商的
SDK
创建新的实例
/
虚拟机。
•
执行
shell
命令以使用提供的选项来设置
Ray
。
•
运行任何用户自定义的设置命令。这对于设置环境变量和安装软件包非常
有用
注
6
。
1
•
初始化
Ray
集群。
•
部署自动扩展器进程。
我们将在
9.5
节详细介绍自动扩展的细节。接下来，我们介绍使用集群启动器部
署
Ray
集群。为此，你需要提供一个集群配置文件。
9.3.1
配置
Ray
集群
要运行
Ray
集群，必须在集群配置文件中指定资源需求。
注 6：要在部署集群后动态设置环境，可以使用运行时环境。
...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.