Intake video of conversation between patient and provider
Separate the video into three modalities - frames, audio, transcript and extract features
Analyze features for each modality using neural networks and proprietary algorithms
Use advanced fusion techniques to predict level of mental illness (score, severity)
Provide insights about overall mental state
So how does it work?
Aiberry’s end-to-end architecture and processing pipeline is hosted in the AWS cloud. The entire process from video intake to insight is automated and the results are available immediately.