November 2021
Intermediate to advanced
340 pages
10h 46m
Chinese
Content preview from Spark快速大数据分析（第2版）
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Spark SQL
与
DataFrame
：
读写外部数据源
｜
137
5.6
小结
本章探索了
Spark SQL
如何与外部组件交互。我们讨论了如何创建包括
Pandas UDF
在
内的用户自定义函数，还展示了执行
Spark SQL
查
询的一些方式（包括
Spark SQL shell
、
Beeline
和
T
ableau
）。然后，针对如何用
Spark SQL
连接
SQL
数据库、
PostgreSQL
、
MySQL
、
Azure Cosmos DB
、
MS SQL
Server
等外部数据源，我们给出了一些示例。
本章还探索了
Spark
为复杂数据类型准备的内建函数
，并且举了一些使用高阶函数的例子。
最后，我们讨论了一些常用的关系型算子，并展示了如何执行一些
DataFrame
操作。
第
6
章将探索如何操作
Dataset
，并介绍强类型操作的优点
。你还将了解什么时候应该使用
Dataset
，以及为什么应该使用它。
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.