book

Programming Interactivity, 2nd Edition

Name: Programming Interactivity, 2nd Edition
Author: Joshua Noble
ISBN: 9781449311445

by Joshua Noble

January 2012

Beginner

724 pages

21h 55m

English

O'Reilly Media, Inc.

Read now

Unlock full access

Programming Interactivity
A Note Regarding Supplemental Files
Preface
What Is—and Isn’t—in This BookWhat’s InWhat’s Not InConventions Used in This BookCompanion WebsiteUsing Code ExamplesSafari® Books OnlineHow to Contact UsAcknowledgments
1. Introducing Interaction Design
What This Book Is ForProgramming for InteractivityThe Nature of InteractionMessages and InteractionInterfaces and InteractionLanguages of InteractionDesign and InteractionArt and InteractionData Exchange and ExplorationWorking Process
2. Programming Basics
Why You’ll Read This Chapter More Than OnceThe Nature of CodeVariablesSimple TypesintSigned versus unsignedfloatcharbool or booleanstringbytelongArraysCastingOperatorsControl Statementsif/thenfor Loopwhile LoopcontinuebreakFunctionsDefining a FunctionPassing Parameters to a FunctionSome Suggestions on Writing FunctionsOverloading FunctionsObjects and PropertiesScopeReview
3. Processing
Downloading and Installing ProcessingExploring the Processing IDEThe Basics of a Processing ApplicationThe setup() MethodThe size() methodThe frameRate() methodThe print() methodThe draw() MethodThe Basics of Drawing with ProcessingThe rect(), ellipse(), and line() MethodsRGB Versus HexadecimalThe fill() MethodThe background() MethodThe line() MethodThe stroke() and strokeWeight() MethodsThe curve() MethodThe vertex() and curveVertex() MethodsCapturing Simple User InteractionThe mouseX and mouseY VariablesThe mousePressed() MethodThe mouseReleased() and mouseDragged() MethodsThe keyPressed and key VariablesImporting LibrariesDownloading LibrariesLoading External Data into ProcessingLoading and Displaying ImagesThe PImage classThe loadImage() methodThe image() methodDisplaying Videos in the Processing EnvironmentUsing the Movie ClassReading and Writing FilesThe loadStrings() methodThe saveStrings() methodRunning and Debugging ApplicationsExporting Processing ApplicationsConclusionReview
4. Arduino
Starting with ArduinoInstalling the IDEMac OS XWindowsLinuxConfiguring the IDETouring an Arduino BoardThe ControllerUno Versus Mini Versus MegaWhat’s a pin?Digital versus analog pinsPins on the MiniPins on the MegaTouring the Arduino IDEThe Basics of an Arduino ApplicationThe setup StatementThe loop MethodFeatures of the Arduino LanguageConstantsMethodsArraysStringsHow to Connect Things to Your BoardResistorsHello WorldDebugging Your ApplicationImporting LibrariesRunning Your CodeRunning Your Board Without a USB ConnectionReview
5. Programming Revisited
Object-Oriented ProgrammingClassesThe Basics of a ClassClass RulesPublic and Private PropertiesInheritanceProcessing: Classes and FilesC++: Classes and Files.cpp and .hA Simple C++ ApplicationPointers and ReferencesPointerReferenceWhen to Use PointersWhen to Use ReferencesSome Rules for PointersSome Rules for ReferencesPointers and ArraysWhen Are You Going to Use This?Review
6. openFrameworks
Your IDE and ComputerWindowsVisual StudioCode::Blocks for WindowsMac OS XLinuxCode::Blocks for LinuxUsing makefilesTaking Another Quick Tour of C++Basic Variable TypesArraysMethodsClasses and Objects in C++Getting Started with oFTouring an oF ApplicationMethodsVariablesCreating “Hello, World”Drawing in 2-DSetting Drawing ModesDrawing PolygonsDisplaying Video Files and ImagesImagesVideoCompiling an oF ProgramCompiling in XcodeCompiling in Code::BlocksDebugging an oF ApplicationUsing the cout StatementUsing the GNU DebuggerUsing the Debugger in XcodeUsing the Debugger in Code::BlocksImporting LibrariesofxOpenCvofxVectorGraphicsofxAssimpModelLoaderofxNetworkofxOscReview
7. Physical Input
Interacting with Physical ControlsThinking About KineticsGetting Gear for This ChapterControlling ControlsThe Button As an Electrical ObjectThe Button As an Interactive ObjectReading the Value of a ButtonTurning KnobsThe Dial As an Interactive ObjectPotentiometersUsing LightsWiring an LEDDetecting Touch and VibrationReading a Piezo SensorGetting Piezo SensorsDetecting ProximityProximity Through CapacitanceDetecting MotionPIR Motion SensorReading DistanceReading Input from an Infrared SensorUnderstanding Binary NumbersBinary NumbersBits and Bit OperationsWhy Do You Need to Know Any of This?Communicating with Other ApplicationsSending Messages from the ArduinoopenFrameworksDetecting Forces and TiltIntroducing I2CGyroscopesWhat’s NextReview

8. Programming Graphics
The Screen and GraphicsSeeing Is Thinking, Looking Is ReadingMath, Graphics, and Coordinate SystemsDrawing StrategiesUse Loops to DrawUse Vectors to DrawDraw Only What You NeedUse SpritesTransformation MatricesCreating MotionShaping the GazeSetting the MoodCreating TweensUsing VectorsUsing Graphical ControlsControlP5 LibraryEvent HandlingImporting and Exporting GraphicsUsing PostScript in ProcessingUsing PostScript Files in oFWhat’s NextReview
9. Bitmaps and Pixels
Using Pixels As DataUsing Pixels and Bitmaps As InputProviding Feedback with BitmapsLooping Through PixelsofPixelsManipulating BitmapsManipulating Color BytesUsing Convolution in Full ColorAnalyzing Bitmaps in oFAnalyzing ColorAnalyzing BrightnessDetecting MotionUsing Edge DetectionUsing Pixel DataUsing TexturesTextures in oFTextures in ProcessingSaving a BitmapWhat’s NextReview
10. Sound and Audio
Sound As FeedbackSound and InteractionHow Sound Works on a ComputerAudio in ProcessingInstantiating the Minim LibraryGenerating Sounds with MinimFiltering Sounds with MinimSound in openFrameworksopenFrameworks and the FMOD Ex LibraryMaximilianPhysical Manipulation of Sound with ArduinoA Quick Note on PWMCreating Interactions with SoundFurther ResourcesReview
11. Arduino and Feedback
Using MotorsDC MotorsStepper MotorsMotor ShieldsSmart FeedbackUsing ServosConnecting a ServoCommunicating with the ServoWiring a ServoUsing Household CurrentsWorking with AppliancesIntroducing the LilyPad BoardUsing VibrationNano, Fio, and MiniUsing an LED MatrixUsing the LEDControl LibraryUsing the SPI ProtocolSerial LED MatrixUsing LCDsUsing Solenoids for MovementWhat’s NextReview
12. Protocols and Communication
Communicating over NetworksUsing XMLUnderstanding Networks and the InternetNetwork OrganizationNetwork IdentificationNetwork Data FlowHandling Network Communication in ProcessingClient ClassServer ClassSharing Data Across ApplicationsUnderstanding Protocols in NetworkingUsing the ofxNetwork Add-onCreating Networks with the ArduinoInitializing the Ethernet LibraryCreating a Client ConnectionCreating a Server ConnectionWireless Internet on the ArduinoCommunicating with BluetoothUsing Bluetooth in ProcessingInstalling Bluetooth on Linux and WindowsInstalling Bluetooth on Mac OS XUsing the bluetoothDesktop LibraryCommunicating Using MIDIReview
13. Graphics and OpenGL
What Does 3-D Have to Do with Interaction?Understanding 3-DWhat Is OpenGL?Working with 3-D in ProcessingOpenGL in ProcessingLighting in ProcessingControlling the Viewer’s PerspectiveMaking Custom Shapes in ProcessingUsing Coordinates and Transforms in ProcessingTransformations3-D in openFrameworksDrawing in 3-DTransformations in openFrameworksLighting in OpenGLBlending Modes in OpenGLCreating 3-D Objects in oFUsing Textures and Shading in ProcessingUsing Another Way of ShadingWhat Does GLSL Look Like?Vertex ShadersGeometry ShaderFragment ShaderVariables Inside ShadersUsing ofShaderUsing Shaders in ProcessingWhat to Do NextReview
14. Motion and Gestures
Computer VisionInterfaces Without ControlsExample CV ProjectsOpenCVUsing Blobs and TrackingStarting with ofxOpenCVDetecting Features with oFUsing OpenCV in ProcessingFeature Tracking in ProcessingUsing Blob Tracking with PhysicsExploring Further in OpenCVDetecting GesturesUsing ezGestures in ProcessingUsing Gestures in oFCapturing iOS gestures with oFTouch with oFTuioreacTIVisionCCVWhat’s NextUsing the Microsoft KinectProcessingopenFrameworksReview
15. Movement and Location
Using Movement As and In InteractionUsing Software-Based Serial PortsUnderstanding and Using GPSStoring DataLogging GPS Data to an ArduinoUsing the breadcrumbs LibraryImplementing Hardware-Based LoggingSending GPS DataGetting Location on a Mobile DeviceOn the iPhoneOn an Android PhoneWhat to Do NextReview
16. Spaces and Environments
Using Architecture and SpaceSensing Environmental DataUsing an XBee with ArduinoCreating a Simple TestConfiguring the XBee ModuleAddressing in the XBeeXBee Library for ProcessingPlacing Objects in 2-DUsing the X10 ProtocolSetting Up an RFID SensorReading Heat and HumidityDetermine Position of an ObjectWhat’s NextReview
17. Further Resources
What’s Next?Software ToolsARToolKitPureDataMax/MSPvvvvFlashConstruction ProcessesArtificial IntelligenceNeural netsPathfindingGenetic algorithmsArtificial lifePhysicsChipmunkBox2DOther Processing physics librariesofAddonsHardware PlatformsPhidgetsRobotshop RoverFritzingAVRARMPICBibliographyInteraction DesignProgrammingHardwareArtConclusion
Index
About the Author
Colophon
Copyright

Content preview from Programming Interactivity, 2nd Edition

Programming Interactivity

Joshua Noble

Beijing • Cambridge • Farnham • Köln • Sebastopol • Tokyo

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Beginning C++ Game Programming - Second Edition

Publisher Resources

ISBN: 9781449321482Errata Page

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Programming Interactivity, 2nd Edition

by Joshua Noble