Skip to Content
Jupyter Cookbook
book

Jupyter Cookbook

by Toomey, Nikhil Borkar, Nikhil Akki, Juan Tomás Oliva Ramos
April 2018
Beginner content levelBeginner
238 pages
7h 13m
English
Packt Publishing
Content preview from Jupyter Cookbook

How to do it...

We can use a script like this:

import pysparkif not 'sc' in globals():    sc = pyspark.SparkContext()#check if a number is primedef isprime(n):    # must be positive    n = abs(int(n))     # 2 or more    if n < 2:        return False     # 2 is the only even prime number    if n == 2:         return True    if not n & 1:        return False     # range starts with 3 and only needs to go up the square root of n    # for all odd numbers    for x in range(3, int(n**0.5)+1, 2):        if n % x == 0:            return False    return True nums = sc.parallelize(range(1000000))# Compute the number of primes in the RDDprint(nums.filter(isprime).count())

Producing the output:

As you can see in the isprime

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Python Cookbook, 3rd Edition

Python Cookbook, 3rd Edition

David Beazley, Brian K. Jones
Pandas 1.x Cookbook - Second Edition

Pandas 1.x Cookbook - Second Edition

Matthew Harrison, Theodore Petrou
bash Cookbook, 2nd Edition

bash Cookbook, 2nd Edition

Carl Albing, JP Vossen

Publisher Resources

ISBN: 9781788839440Supplemental Content