Implementing Real-Time Data Infrastructure for Enhanced Donor Engagement

As a growing charity organization, we are committed to improving our fundraising capabilities through data-driven insights. We require a skilled data engineer to design and implement a robust real-time data infrastructure. The project involves setting up an architecture that can handle streaming data from different sources such as social media, online donations, and event registrations in real-time. The goal is to create a dynamic platform capable of providing actionable insights to our marketing and outreach teams. Key responsibilities include integrating Apache Kafka for event streaming, utilizing Spark for real-time processing, and leveraging Airflow for orchestrating complex data workflows. We also aim to utilize dbt for transforming the data in our Snowflake or BigQuery warehouse to ensure it is ready for analysis. The successful implementation will enable personalized donor interactions and campaign optimizations, ultimately leading to increased donor engagement and retention. The project is designed to be completed within 4-6 weeks, with a budget ranging from $5,000 to $25,000.