Research and development activities that include LiDAR laser scanning, photogrammetry 3D modelling, virtual reality capture with 360 Video, and augmented reality experiences
Motion capture of live performance such as dancers and musicians for Augmented Reality applications
The 3D Render Test showcases the process of capturing a live dance performance with a single camera, extracting Motion Capture data using Deep Motion software, and applying the Motion Capture data to 3D avatar versions of the dancers, based on scans using Polycam, for a final 3D animated render of the dance performance. This 3D render data from the animation can be used for Augmented Reality applications or for mixed uses in Virtual Reality 3D viewing.
Featured dancers in this sample are: Erin McAndrews, Deanne Service, Alyssa Service.
Software Utilized in this production: Polycam for Mac iOS using an iPad Pro for Photogrammetry and LiDAR Scanning of Performers and Performance Space, Deep Motion for Mac OS for Motion Capture data capture, Blender for 3D Animation and rendering of 3D test.
360 Video Virtual Reality capture for virtualization of live performances and live music concerts
Captured using a 360 Video Camera (GoPro Fusion) and a 180 Degree Lens on a Blackmagic Pocket Cinema Camera, the footage can be converted into a 360 Video experience.
Software used for the creation of 360 Video samples: Mistika VR for Mac OS for stitching, Avid Media Composer for Editing of 360 Video.
3D scanning and laser scanning of art to create 3D models for Augmented Reality applications such as exhibition and previewing
Utilizing a portable iPad Pro and Polycam software, media artist Tom Strnad captured both LiDAR laser scans and Photogrammetry photo captures in 3D of the dimensional art. It was discovered that for small to medium sized dimensional art, Photogrammetry is the best solution for offering a 3D model of the artwork and for Augmented Reality applications.
Test A showcases the ceramic and pottery based dimensional artwork by artist Anke Lex. The scans were taken at the artists' studio and were captured in available sunlight. The video showcases the Polycam Photogrammetry capture and the resulting Augmented Reality placement of the works inside a home for possible gallery viewing or testing of placement by a client.
Test B features metal dimensional sculptures by artist, Michael Pocock. The video showcases the Photogrammetry 3D capture using Polycam and the application or Augmented Reality to place the pieces in a garden setting for AR based testing of placement for these dimensional artworks or for virtual gallery display outdoors.
Software used for dimensional art virtualization: Polycam for Mac iOS using iPad Pro, Adobe Aero for Augmented Reality application, Blender for finalizing 3D models (OBJ files).
Capturing Performance: A Step-By-Step guide to 3D Scans and Motion Capture to capture a performance for Augmented Reality presentations.
Capturing 360 Video: A Step-By-Step guide to capturing a live performance using 360 Video Cameras or Fisheye Lens and creating a VR 360 Video experience.
LEAD ARTIST BIO
Tom Strnad is a honours graduate of York University's Film & Video Program with a specialization in Production with over 20 years of filmmaking experience. Tom's films have screened around the world including festival premieres at SXSW, TIFF, VIFF, FIPA and CINEQUEST. Tom is a recipient of funding and grants from Telefilm Canada, Ontario Creates, Canada Council for the Arts, Ontario Arts Council and the National Film Board of Canada. Tom is a lead digital strategist for the South Georgian Bay Media Association Inc. and actively teaches digital media arts throughout his home region of Grey County, Ontario.
PROJECT PARTNERS
We acknowledge the support of the Canada Council for the Arts