Research Problems Categorized by Quadrant for Data Management at Scale
As noted above, care providers spend a great deal of time in documenting their interactions with patients. Automated capture of patient-provider interactions would release such time for more productive uses and help to ensure more complete and more timely patient records.
A comprehensive environment for capturing interactions would necessarily be multimodal, involving ways of capturing and interpreting visual images and conversations. Rather than one general-purpose environment, capture environments would likely be specialized to different settings—such as hospital room (e.g., nurse/patient), emergency room (e.g., ER physician/patient), routine consultation (primary care provider/patient), and specialist consultation (e.g., cardiologist or surgeon and patient).
Some of the important dimensions in this problem domain include:
Real-time transcription and interpretation of the dialog between patient and provider. Individual voices must be identified as being associated with the provider or the patient. The transcript must be parsed unambiguously, irrelevant information identified and ignored, and relevant information interpreted.
Summarization of physical interactions between patient and provider based on the interpretation of images recorded by various cameras in the patient care room. In a hospital room, the system must be able to distinguish