Projects include Interactive Simulation of Deformable Objects such as water, gas, soft tissue, etc., Depth and Thermal Fusion for Security and Authentication, and Gait Signature and Analysis for Security.
In simulation, animation, and game design, user control of complex deformable objects requires a set of intuitive tools to articulate and manipulate complex behaviors of 3D models driven by computational dynamics. From tools that provide intuitive behavioral modeling to reconstructing structural behaviors of real-world objects, this research explores unique solutions for managing and interacting with complex numerical simulations through the development of computer aided design software, physical modeling techniques, and new design interfaces for interactive simulations.
Projects include Non-Contact Breathing for sleep apnea (currently funded by NSF for 4 years), Non-contact Breathing analysis for Cardiology and ICU, Retinal Imaging, and Post-Stroke Rehabilitation.
Respiratory analysis aids in monitoring the implicit physiological indicators that can help diagnose and treat numerous pulmonary diseases. In this research we explore non-contact solutions monitoring patient respiratory behaviors that minimize the intrusive nature of current tube-based breathing monitors. The objective of this research is to provide non-invasive respiratory monitoring through sensor networks (including radar, thermal-, depth-, and infrared-imaging) to closely monitor breathing rate, tidal volume, and abnormal respiratory behaviors.
4D Scanning & Printing:
Projects include accurate scanning of 3D static structure and 4D deforming soft structure.
Building on the well-established field of 3D scanning, we explore the complex behavioral dynamics of real-world objects for physically-driven simulations through 4D dynamics scanning. Dynamic behaviors of real-world 3D objects are recorded over time and replicated through 3D printed materials. This allows for the rapid transfer of dynamic material designs and the ability to reproduce visual and behavioral characteristics of real-world objects. The objective of this research is to replicate and simulate the behaviors of real world objects for interactive simulations, virtual- and mixed-reality applications.
Virtual Reality & Augmented Reality:
Projects include VR for immersive storytelling, post-stroke rehab, mild Traumatic Brian Injuries (mTBI) analysis, and resilience for nurses.
Recent advances in VR and AR have shown that the technology is a fundamental part of modern immersive interactive systems for dynamic and engaging user experience. One of the Comcast Media and Technology Center’s main thrusts is to develop natural and intuitive interaction techniques through precise tracking and registration, advanced computer vision, realistic rendering and dynamic simulation, and human factor studies. Those core technologies are currently applied for and experimented in various fields including medicine, E-learning and training, entertainment, and manufacturing.
Student projects 2017-18:
- Robotics capstone project on robot navigation and obstacle avoidance
VR capstone project on hand gesture prototyping
Non-Contact Breathing Behavior Analysis through CO2 visualization
VR insole: Post Stroke Rehabilitation
VR based diagnosis for mTBI