May 2024
Intermediate
252 pages
5h 31m
Chinese
Content preview from Ray 分布式机器学习：利用Ray 进行大模型的数据处理、训练、推理和部署
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Ray
生态及其他
|
235
如果你拥有
ML
平台（如
Vertex
或
SageMaker
），就可以使用
Ray AIR
的任何子
集来增强系统。这里，“
ML
平台”的含义很广，指任何负责运行端到端
ML
任
务的系统。换句话说，
AIR
可以通过与现有的管道或工作流编排器、存储和跟
踪服务集成，无须替换整个
ML
平台，补强现有的
ML
平台。
11.2.3
将
AIR
集成到
ML
平台
现在，你对
Ray
（特别是
AIR
）与其他生态组件的关系有了更深入的了解，我们
再总结一下构建自定义
ML
平台，并将
Ray
与其他生态组件集成所需的步骤。
基于
AIR
构建的
ML
系统的核心由一组
Ray
集群组成，每个集群负责不同的
作业。例如，一个集群可以运行预处理、训练
PyTorch
模型并运行推理；另
一个集群选择先前训练的模型进行批量推理和模型服务等。你可以利用
Ray
Autoscaler
满足扩展需求，并使用
KubeRay
在
Kubernetes
上部署整个系统。然
后，你可以根据需要使用其他组件增强这个核心系统，例如：
•
将其他计算步骤添加到设置中，例如，使用
Spark
运行数据密集型的预处理
任务。
•
使用工作流编排器（如
AirFlow
、
Oozie
或
SageMaker Pipelines
）调度和创
建
Ray
集群，并运行
Ray AIR
应用程序和服务。每个
AIR
应用程序可以是
大型编排工作流的一部分，例如，与前一项中的
Spark ETL
作业衔接
注
14
。
1
•
创建
Ray AIR
集群，用于交互式
Jupyter notebook
，例如由
Google Colab
或
Databricks ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.