รายละเอียดงาน- Design, build, and optimize data pipelines for ingestion, transformation, and storage.
- Develop and maintain real-time and batch processing pipelines using Spark, Kafka, and Airflow.
- Implement data lake and warehouse solutions using MinIO and ClickHouse.
- Ensure data integrity, security, and governance across all layers of the data architecture.
- Collaborate with analytics and business teams to ensure the data infrastructure supports business needs.
- Optimize data models for performance, scalability, and maintainability.
- Troubleshoot and resolve performance issues across data processing and storage systems.
- Leading and mentoring junior data engineers and team members.