Real-Time Data Pipeline Development for Enhanced Player Engagement

We are a dynamic startup in the Gaming & Esports industry, poised to revolutionize player engagement through cutting-edge data engineering. Our mission is to build a real-time data pipeline that empowers our game developers and marketers with instantaneous insights into player behavior and game performance. The freelancer will be responsible for designing and implementing a system that captures, processes, and visualizes data from multiple game servers using technologies such as Apache Kafka for event streaming, Spark for distributed processing, and Snowflake or BigQuery for data warehousing. The solution should ensure low latency to support features like personalized game recommendations and real-time modulations of game difficulty. Additionally, the setup must include data observability practices to maintain accuracy and reliability. We are working on a tight timeline of 4-6 weeks, requiring a high level of expertise and efficiency.