April 2023
Intermediate to advanced
452 pages
7h 21m
Japanese
Content preview from ハイパフォーマンスPython 第2版
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
10章クラスタとジョブキュー
10章を読めば以下の問いに答えられるようになる
- なぜクラスタが便利なのか？
- クラスタリングのコストとは何か？
multiprocessingによる解法をクラスタ対応させるにはどうすればよいか？- IPythonのクラスタ機能はどのように動作するか？
- DaskとSwifterを使ってPandasを並列化する方法は？
- NSQを使うとどのように堅牢な実用システムを組めるか？
一般に「クラスタ」は、複数の計算機をまとめて1つの共通タスクを解くものと理解されています。外部からは、巨大な単一システムとして見えます。
1990年代に、ごくふつうのPCをLAN上でまとめてクラスタ化するという、いわゆるベオウルフ型クラスタ（https://oreil.ly/2aNvw）が普及してきました。そのあと、Googleの基盤（https://oreil.ly/V83g1）が、とくにMapReduceの処理をするために、自社のデータセンターでPCクラスタを使い、実施に拍車がかかりました。成長の結果、TOP500プロジェクト（https://oreil.ly/rHOQO）のランキングによれば、もっとも強力なコンピュータはクラスタ構成をしていて、すべてLinuxを使う高速なマシンを採用しています。
Amazon Webサービス（AWS）は、クラウド上で実用クラスタを運用するのにも、機械学習などの短期間のタスク用にその都度クラスタを構成するのにも、よく使われています。AWSを用いると、10個のCPUを積んだり、最大768GBのRAMを積んだマシンを1時間1ドルから10ドル程度で借りることができます。AWSや他のクラウド上で重い計算タスクや大量のRAMが必要なタスクをアドホックなクラスタを使って処理したい場合は、「 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.