รายละเอียดงาน•Design, develop, and maintain robust and scalable data pipelines and ETL processes using Python, Apache Airflow, and Spark.
•Build and maintain microservices and applications using C# .NET and .NET Core for efficient data processing and integration.
•Manage and optimize databases including MS SQL, PostgreSQL, MySQL, and object storage solutions like Minio.
•Implement and maintain CI/CD pipelines using GitLab, ensuring automated, reliable, and efficient code deployments.
•Work on a Kubernetes platform for container orchestration, ensuring high availability and scalability of the deployed data solutions.
•Manage, monitor, and troubleshoot infrastructure running on Linux (Ubuntu) servers, ensuring system reliability and performance.
•Collaborate with cross-functional teams, including data scientists, software engineers, and DevOps, to ensure seamless integration of data solutions with business requirements.
•Contribute to the development and optimization of data models, ensuring data integrity and performance.
•Perform regular performance tuning, query optimization, and data management activities across various database systems.