May 2024
Intermediate
252 pages
5h 31m
Chinese
Content preview from Ray 分布式机器学习：利用Ray 进行大模型的数据处理、训练、推理和部署
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Ray
集群
|
191
Client
连接：
import ray
ray.init(address="ray://localhost:10001")
print(ray.cluster_resources())
@ray.remote
def test():
return 12
ray.get([test.remote() for i in range(12)])
使用这种方法，就可以直接在笔记本计算机上运行
Ray
程序（不需要通过
kubectl
或作业提交来传输代码）。
9.2.3
公开
KubeRay
在先前的示例中，我们使用端口转发作为访问
Ray
主节点服务的方法。对于生
产环境，你可能想使用其他方法公开服务。以下介绍适用于在
Kubernetes
上运
行的服务。
默认情况下，
Ray
服务可以从运行
Ray
管理器的
Kubernetes
集群中的任何位置
进行访问。例如，要从与
Ray
集群相同的
Kubernetes
命名空间的
Pod
中使用
Ray
Client
，可使用
ray.init("ray://raycluster-complete-head-svc:10001")
。
要从另一个
Kubernetes
命名空间连接，可使用
ray.init("ray://raycluster-
complete-head-svc.default.svc.cluster.local:10001")
。如果
Ray
集群是
非默认命名空间，请使用该命名空间替换
default
。
如果从集群外部访问服务，可使用入口控制器。任何标准的入口控制器都应与
Ray Client ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.