March 2018
Beginner to intermediate
332 pages
6h 1m
Korean
Content preview from 9가지 사례로 익히는 고급 스파크 분석(2판): 현실 세계 빅데이터로 배우는 데이터 과학과 머신러닝
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
229
8
장
뉴욕 택시 운행 데이터로 위치 및 시간 데이터 분석하기
2013
년의 월별 데이터는
http
://
www
.
andresmh
.
com
/
nyctaxitrips
/
에서 내려받을 수 있다. 사
용할 수 있는 스파크 클러스터가 충분히 크다면, 이제부터 수행할 분석을
2013
년 전체 데이터
로도 해볼 수 있을 것이다. 먼저 클라이언트 노드에 작업 디렉터리를 만들고 요금 데이터의 구
조를 살펴보도록 하자.
$ mkdir taxidata
$ cd taxidata
$ curl -O https://nyctaxitrips.blob.core.windows.net/data/trip_data_1.csv.zip
$ unzip trip_data_1.csv.zip
$ head -n 10 trip_data_1.csv
이 파일은 머릿줄을 제외하면 한 줄에 택시 운행 한 건씩
CSV
형식으로 기록되어 있다. 각 운
행 정보는 택시 정보(해시된 메달리온 번호
1
)와 운전자 정보(해시된 핵 라이선스
Hack
License
, 택시
면허
), 운행 시작 시각과 종료 시각과 같은 시간 정보, 승객의 탑승 지점과 하차 지점의 경도·위
도 좌표 등의 속성으로 이뤄진다.
8.2
스파크에서 서드파티 라이브러리로 작업하기
자바 플랫폼의 최고 장점 하나는 이 플랫폼만을 위해서 수년간 개발되어온 코드의 양 그 자체
다. 어떤 자료형이나 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.