3D generative modeling research (text to mesh) - implemented latent diffusion in PyTorch, trained on ShapeNet, objaverse and hairstyle latents
Publication to product (hypersearch) multimodal (CLIP) search for 3D game assets - shipped in Unity Asset Management Cloud
3D neural flow field hair groom generation from monocular video (ZivaHuman character configurator collab with Weta Wigs) - submitted to SIGGRAPH 2024
ML Graphics Research & Development
JangaFx
Exploratory R&D for 3D fluid simulation (differentiable sparse eulerian fluids)
Neural flipbooks and upscaling for real-time vfx, trained various prototypical differentiable optimization pipelines
Neural rendering / compression
Research Scientist
NYU Future Reality Lab
Full Body Avatar reconstruction from machine learning + pressure image driven shoe insoles + VR HMDs (pytorch)
Developed a distributed network communication + avatar / procedural character framework, deployed work on inside out tracked co-located / distributed VR experiences for several people simultaneously per instance at SIGGRAPH, Unity, Facebook Oculus, Verizon, Bose Research, Brooklyn R-Lab - in addition to being used for several years by NYU’s CREATE lab for interdisciplinary multi-user educational VR research [link]
Technical director for SIGGRAPH 2020 submission “The Outpost” - led a team of 9 people to develop a scalable social VR experience to “hang out” with remote friends as procedural robots, real-time spatial audio streaming
Chief Technology Officer
AutoToon
NYU Future Reality Lab spin-off startup
Data driven motion controllers for Social VR (pytorch)
C++ stack, Unity + Unreal Engine bindings for procedural characters, avatars, objects, motion capture streams
Education
MS Computer Science
New York University - Courant Institute
tutor/grader: Introduction to Python (graduate level) fall 2017 (~40 students)
BS Computer Science
Purdue University - West Lafayette
teaching assistant: software engineering fall 2015, spring 2016, fall 2016 (300+ students)