Real-time Data Pipeline Development for Enhanced Inventory Management

As a growing player in the food and beverage industry, our company faces the challenge of efficiently managing inventory across various locations. Delays in data processing and inventory updates lead to overstocking or stockouts, affecting our revenue and customer satisfaction. To address this, we require the development of a real-time data pipeline that integrates our point-of-sale systems with a centralized data repository. By leveraging technologies like Apache Kafka for event streaming, Spark for real-time analytics, and Airflow for orchestration, the pipeline will provide our team with immediate inventory insights. We also plan to implement data observability tools to ensure data quality and reliability. The goal is to facilitate timely inventory adjustments, reduce waste, and enhance operational efficiency. Applicants must be experienced with modern data engineering tools, including dbt, Snowflake, and BigQuery, to ensure a scalable and robust solution.