Key Responsibilities:

• Data Ingestion and Processing: Develop and maintain robust data pipelines to ingest, process, and transform data from various sources into actionable insights.

• Data Modeling: Design and implement data models, schemas, and databases that support data analytics and reporting requirements.

• Optimization: Identify and implement optimizations to improve the performance, scalability, and reliability of data processing pipelines and storage systems.

• Data Quality: Ensure data quality and integrity by implementing data validation and cleansing processes.

• Integration: Collaborate with cross-functional teams to integrate data engineering solutions into business applications and analytics platforms.

• Monitoring and Maintenance: Monitor data pipelines and proactively address any issues or bottlenecks to ensure uninterrupted data flow.

• Documentation: Maintain comprehensive documentation of data engineering processes, workflows, and best practices.

• Security: Implement data security measures and adhere to data privacy regulations to protect sensitive information.

• Stay Current: Keep up-to-date with industry trends and emerging technologies in big data and data engineering to recommend and implement improvements.