AR Quick Look Notes WWDC 2018

AR Quick Look
https://developer.apple.com/videos/play/wwdc2018/603/

Preview 3D content in AR
Deeply integrated within the operating system.

available on iOS 12 on AR compatible devices

new 3D file format USDZ - invites you to 3D view your content and see what it looks like in your world.

AR Quick look handles
- Plane Detection
- Translation gestures
- object scaling
- contact shadows
- rotation manipulation
- object placement with device movement

Other Components to the Experience:
- Realistic rendering
- AR onboarding
- peek and pop
- environmental texturing
- AR snapshots
- haptics
- Lighting
- 100% scale viewing
- Skeletal animation
- Transform animation
- Hit-testing
- File sharing
- VoiceOver
- Switch Control

Apps that have adopted AR Quick Look:
-Files
-Mail
-Messages
-Notes
-News
-Safari (plus new HTML markup for Quick Look)
-Your apps

What is a ’USDZ’ file?
- New file format for distributing 3D models
- packages models and textures into a single file for efficient delivery of 3D content.
- Based on Pixar’s open-source USD format  (Universal Scene Description)
- Supported on iOS and macOS
- usdz_converter tool ships with Xcode 10 and allows you to convert 3D models into USDZ files

Integration AR Quick Look
- Apps 
- Websites in safari - complementing reading and shopping experience - made possible with a new HTML markup - get a badge that tells the user that it is a USDZ file
- new markup:
- “<a rel=“ar” href=“model.usdz”>
-        <img src=“model-preview.jpg”>
- </a>”

Quicklook
- About previewing documents
- Framework for previewing file formats
- control over transitions and presentation modes
- secure and private

Where can you get USDZ content?


-Albedo (base color)
-Metallic (conductor or insulator)
-Roughness (rough or shiny)
-Normal (surface details)
-Ambient occlusion (internal shadows)
-Emissive (emits light into the world, special case - does the object glow with the lights off)

USDZ_Converter
command line tool that converts 3d models to .usdz format

Ships w/ Xcode 10
Maps PBR texture to meshes and sub meshes

input formats
- obj files
- single-frame Alembic (ABC) file
- or USD file (USDA or USDC)

Anatomy of a ‘usdz’ file
a .usdz file is an uncompressed zip archive
first file in the archive is a .usdc file (model animation, material definitions)
remaining files (if needed) are texture or image files
https://graphics.pixar.com/usd/ <— open specification

Creating USDZ from command line
// Call usdz_converter with scrum.
xcrum usdz_converter RetroTV.oj RetroTB.usdz