Real-Time Patient Data Pipeline for Enhanced Clinical Decision-Making

As a growing SME in the healthcare sector, we face the challenge of integrating diverse data streams from various medical devices, electronic health records (EHRs), and patient portals. We require a sophisticated real-time data pipeline that can handle high-velocity data, ensure data observability, and facilitate seamless data mesh architecture. The project involves setting up an end-to-end data pipeline using Apache Kafka for event streaming, Apache Spark for real-time analytics, and orchestrating workflows with Airflow. The data will be stored and managed in Snowflake, ensuring scalability and security. Additionally, data transformation will be managed through dbt, providing robust data governance. The successful implementation of this system is crucial in improving our clinical decision-making processes, ultimately leading to better patient outcomes. We are looking for a professional who can deliver this project within 12-16 weeks, with a budget range of $25,000-$75,000.