1984
Spatial Computing Development Studio
I work with clients to build the spatial computing future
My work focuses on Swift, ARKit, RealityKit, Reality Composer Pro, and SwiftUI to build for visionOS, iOS, and macOS
Contact
Reach out to talk tech or hire me for AR dev, product, or strategy
Work
Twin is a visionOS and iOS app that uses photogrammetry to create
custom 3D models of your stuff for use in Vision Pro's spatial computing world.
Twin implements Shader Graph Materials that enable you to remix & filter the textures of
your stuff in real-time, creating brand new colorways and new versions
of your things that are impossible in the real world.
Twin uses:
- RealityKit
- SwiftData
- Reality Composer Pro
- Object Capture
- Shader Graph Materials
- RevenueCat
- RealityView
Project Type: 1984 product
Download Watch a Demo
Minimap Level 2 uses two iPhones to display a real-time spatial map.
This second level of the prototype understands the structure of a room,
segments a human from video frames, and updates the 3D position of that frame
in real-time.
Minimap Level 2 uses:
- RoomPlan
- SwiftData
- RealityKit Postprocessing
- ARKit
- VideoToolbox
- TextureResource DrawableQueue
Project Type: 1984 internal research
Watch the Demo with Sound
Minimap is an ongoing internal research project exploring spatial mapping of
a location. This initial demo understands the structure of a room using RoomPlan
and paints object textures using ARKit & RealityKit.
Minimap uses:
- RoomPlan
- Metal Shaders
- RealityKit
- ARKit
- SwiftUI
Project Type: 1984 internal research
Watch the Demo with Sound
Reality Synthesizer is an open-source, augmented reality app that visualizes
MIDI notes played on a paired synthesizer. The MIDI notes are interpreted by
Metal shaders to product augmented reality visualizations. Reality Synthesizer
utilizes LiDAR capabilities introduced in iOS 15.4.
Reality Synthesizer uses:
- LiDAR
- Metal Shaders
- AVFoundation
- AudioKit
- Linnstrument Helper
Project Type: Open-source
Get the Code Watch the Demo with Sound
Rock Paper Checkmate is an augmented reality auto-chess game played
against a computer by playing Rock Paper Scissors. Rock Paper Checkmate includes
people occlusion with depth, a custom machine learning model, and recognizes hand
gestures shown to the camera so anyone can play augmented reality auto-chess.
Rock Paper Checkmate uses:
- ARKit 5
- RealityKit 2 and Reality Composer
- Create ML for Hand Pose Classification
- SwiftUI
- Vision Framework for Human Hand Pose Estimations
Project Type: 1984 product
Primer helps you visualize your home with new
wallpaper, tiling, and paint. Primer utilizes Core Animation to display
intuitive, animated, augmented reality tooltips to visually onboard users.
Primer uses:
- ARKit 3
- Core Animation
- Person Segmentation with Depth
Project Type: Client work for Primer
Acquired by Shopify
WebXR Viewer is an open-source, augmented reality, WebXR browser for iOS.
WebXR Viewer has a fine-grained AR permissioning system that puts privacy & ethical design first
and is built on Metal to render WebXR websites at 60 fps.
WebXR Viewer uses:
- ARKit 2
- WebXR
- Metal
- SceneKit
Project Type: Open-source client work for Mozilla
Get the Latest Code DownloadiScape
1984 developed innovative AR interactions and controls for iScape's collaborative landscaping app.
iScape utilizes shared world maps, persistent worlds, 3D models, and the novel ability to create
custom geometry for visualizing AR textures in the user's world.
My work on iScape was featured by HBO, Axios, and Apple at both WWDC 2019 & in the App Store.
iScape uses:
- ARKit 2
- SceneKit
- AR World Maps
- Collaborative, Multi-User Sessions
Project Type: Client work for iScape
Watch a Demo Video DownloadWriting
I write about visionOS over here now – September 2023 and beyondLimitations of RealityKit 1.0 – June 2020
Building with RealityKit – February 2020
Developing an Augmented Reality Browser – January 2020