Potential applications
Here we outline some hypothetical applications. Please let us know if you
would like to collaborate on any of the following points or on your own idea.
General
- indirect diagnostics
- parameter estimation
- data annotation
- 6d localization
- inverse kinematics
Self-driving cars
- Detection of partially occluded road signs
- Accurate 6D localization of traffic actors on footage of surveillance cameras for generating synthetic training inputs from drivers’ perspective
- Predicting out-of-control car dynamics due to collisions/skids by inferring (from multiple sequential images) physical parameters such as velocity, angular velocity, mass, center of mass, state of breaks and acceleration/friction for each wheel, etc.
- Making physics-informed action plans for cars in out-of-control scenarios
- Tracking drivers' eyes for highlighting regions that influence decisions
Medicine
- Determining tumor shape and size from multimodal inputs
- Inferring orthopedic parameters from patient videos
Agriculture
- Identifying shape and volume of fruits and vegetables to advise on optimal harvesting time
Robotics
- Identifying shapes of fragile/heavy objects for optimal picking and placement
- Individual picking of fruits and vegetables
Health and wellbeing
- Estimating the volume of food in a meal for calorie measurement via phone camera input
- Measuring body parameters for health monitoring
- Measuring body parameters for virtual fitting of clothes
Security
- Characterization of body and/or gait to identify individuals in CCTV footage without a visible face