Real-Time Athlete Performance Data Pipeline Development

As a sports analytics startup, we aim to revolutionize how coaches and teams access and utilize performance data. We are looking to develop a robust data pipeline that seamlessly integrates real-time data feeds from wearable devices and other monitoring tools used by athletes. The project involves designing a scalable and reliable architecture using Apache Kafka for event streaming, Spark for real-time analytics, and Snowflake or BigQuery for data warehousing. Additionally, Airflow will be used for orchestration, and dbt for data transformation and modeling. The successful candidate will work closely with our data science team to ensure data quality and observability, enabling accurate insights and predictions. This project is critical as it allows teams to make informed decisions on-the-fly, ultimately leading to enhanced performance outcomes.