Integrated Platform for Hyperspectral 3D Photogrammetry for Biomedical Applications

       The goal of the project is to design and manufacture a hand-portable platform that applies hyperspectral 3D photogrammetry for a biomedical purpose. The project integrates the platform with both software and hardware. Specifically, this platform utilizes NVIDIA Jetson TX2 and Raspberry Pi3 as a central controller, connect and control 3 Raspberry Pi0s through hot spot ethernet. Each Raspberry Pi0 connects and controls one LED light ring and one Noir V2 Infrared Camera. LED light rings and infrared light sets are used to control light conditions when collecting image data from Raspberry Pi0 cameras. Image data can be automatically transferred from Raspberry Pi0 to the central controller in order to synthesis the 3D model. We use NVIDIA Jetson TX2 as our graphics processing unit to run Alice Vision Meshroom, which is an open-source 3D photogrammetry software for building 3D models. Also, we can polish and modify models by using Blender. Currently, we have successfully using Meshroom and Blender to construct and modify 3D objects in different sizes based on the pictures we took. Also, we can connect 3 Pi0s to the central controller and control cameras to take pictures under visible light condition then transfer image data back to TX2 automatically. By the end of this quarter, we can deliver and demonstrate a prototype for use on human faces and lay the groundwork for future development.