Real-Time Waste Management Data Platform Development

Our startup aims to revolutionize the waste management industry by leveraging advanced data engineering solutions to improve operational efficiency and sustainability. We are seeking an experienced data engineer to develop a real-time data platform that integrates multiple data sources involved in waste collection, processing, and recycling. The project involves setting up an event streaming architecture using Apache Kafka, implementing a data mesh approach for distributed data ownership, and utilizing technologies like Spark and Airflow for data processing workflows. Additionally, the platform will employ MLOps practices to integrate machine learning models for predictive analytics on collection routes and processing schedules. By implementing data observability tools, we aim to ensure high data quality and reliability. The solution will empower waste management operators with real-time insights, improving decision-making and reducing resource wastage.