Skip to Content
Ray 分布式机器学习:利用Ray 进行大模型的数据处理、训练、推理和部署
book

Ray 分布式机器学习:利用Ray 进行大模型的数据处理、训练、推理和部署

by Max Pumperla, Edward Oakes, Richard Liaw
May 2024
Intermediate
252 pages
5h 31m
Chinese
China Machine Press
Content preview from Ray 分布式机器学习:利用Ray 进行大模型的数据处理、训练、推理和部署
184
|
9
介绍如何在云上运行
Ray
集群以及如何自动扩展。
9.1
手动创建
Ray Cluster
1
本节介绍手动创建
Ray
集群,你需要有一组可以相互通信并安装了
Ray
的机器
3
首先,你可以选择任何一台机器作为主节点。在该节点上运行以下命令:
ray start --head --port=6379
这个命令将打印启动的
Ray GCS
服务器的
IP
地址,即本地节点的
IP
地址加上
指定的端口号
4
2
...
Next steps
To connect to this Ray runtime from another node, run
ray start --address='<head-address>:6379'
If connection fails, check your firewall settings and network configuration.
你需要这个
<head-address>
将其他节点连接到集群,所以确保复制地址。如果
省略
--port
参数,
Ray
将使用随机端口。
接下来,我们通过在其他各个节点上运行以下命令,将集群中的其他节点连接
到主节点:
ray start --address=<head-address>
确保传递正确的
<head-address>
,它应该类似于
123.45.67.89:6379
。运行此
命令,你应该看到以下形式的输出:
--------------------
Ray runtime started.
--------------------
To terminate ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

通过可观测性确保数据与AI的可靠性

通过可观测性确保数据与AI的可靠性

Barr Moses, Michael Segner

Publisher Resources

ISBN: 9787111753384