Real-time Analytics Pipeline Development for Enhanced HR Decision-Making

As a scale-up company in the Human Resources sector, we are focused on improving our operational efficiencies and strategic decision-making through real-time data insights. We are looking to build a robust data engineering solution that will integrate a real-time analytics pipeline to streamline our data processes. This project includes designing a scalable data architecture leveraging Apache Kafka for event streaming, Spark for data processing, and Snowflake for data warehousing. Additionally, the solution will include Airflow for workflow automation and dbt for data transformation. This system will support the integration of various data sources, providing real-time analytics and insights across HR functions like recruitment, employee engagement, and performance management. The project is critical to enhancing our competitive edge in the market by enabling faster, more informed HR decisions. The ideal candidate will have a strong background in data engineering, with experience in deploying and managing data pipelines in cloud environments. This project is time-sensitive, with a completion target of 8-12 weeks.