May 2024
Intermediate
252 pages
5h 31m
Chinese
Content preview from Ray 分布式机器学习：利用Ray 进行大模型的数据处理、训练、推理和部署
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
30
|
第
1
章
1.4 Ray
的生态
Ray
的高级库功能十分强大，本书将深入探讨这些高级库。虽然它们对于数据
科学很重要，但我们并不希望给人一种
Ray
是万金油解决方案的印象。通常，
最好和最成功的框架是能与现有解决方案和编程思想进行集成的框架。所以最
好专注于自己的核心优势，并利用其他工具填补不足，
Ray
在这方面做得非常
出色。
在本书中，特别是第
11
章，我们将讨论许多基于
Ray
的强大的第三方库。
Ray
生态还与许多现有工具进行了集成。例如，
Ray Dataset
是
Ray
的数据加载和计
算库。如果你已经使用了
Spark
注
18
或
Dask
等数据处理引擎，则可以将这些工
具与
Ray
一起使用。具体来说，你可以使用
Dask-on-Ray
调度器在
Ray
集群上
运行整个
Dask
生态，或者可以使用
Spark on Ray
项目（
https://oreil.ly/J1D5I
）
将
Spark
计算任务与
Ray
集成。同样，
Modin
项目（
https://oreil.ly/brGPJ
）是
Pandas DataFrames
的分布式即插即用替代方案，它使用
Ray
（或
Dask
）作为分
布式执行引擎（“
Pandas on Ray
”）。
1
Ray
并不试图替代所有这些工具，而是在与它们集成的同时，仍然可以访问原生
的
Ray Dataset
库。在第
11
章中，我们将详细介绍
Ray
与其他生态工具的关系。
许多
Ray
库的重要特性之一是它们无缝集成了常用工具作为后端。
Ray
通常创
建常见的接口，而不是创建新标准
注
19
。这些接口支持以分布式方式运行任务，
这是大多数相应的后端所没有或功能欠缺的。例如 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.