Real-time Patient Data Pipeline Optimization for Enhanced Healthcare Delivery

As a forward-thinking digital health company, we are committed to revolutionizing healthcare delivery through data-driven insights. We are looking for a data engineering expert to enhance our current patient data pipeline infrastructure. The project aims to establish a real-time data processing pipeline that seamlessly integrates patient data from multiple sources into a cohesive system. Key technologies will include Apache Kafka for event streaming, Spark for real-time analytics, and Airflow for orchestrating complex workflows. We also aim to implement dbt for data transformations and leverage Snowflake or BigQuery for data warehousing. The goal is to create a system that not only processes and stores data efficiently but also provides real-time insights that can directly impact patient care. The freelancer will work closely with our internal data science and IT teams to ensure the solution aligns with our strategic objectives and regulatory requirements.