รายละเอียดงานThe Data Engineer will be responsible for designing, developing, and maintaining data infrastructure and pipelines that support data processing, storage, and retrieval. This role involves working closely with data scientists, analysts, and business stakeholders to ensure data accessibility and reliability for analysis and decision-making. And ensuring regulatory compliance. The ideal candidate will have a strong background in data engineering, with expertise in data pipeline development, data warehousing, and big data technologies.
1.ETL Development and Management.
2.Data Infrastructure Design and Maintenance.
3.Database Management and Optimization.
4.Data Security and Quality Assurance.
5.Work with data analysts, scientists, and engineers and Integrate data solutions with other applications.
6.Data Governance and Compliance.
7.Performance and Cost Optimization.
8.Continuous Improvement and Innovation.
Required Technical skills
Programming Languages: Proficiency in Python, Javascript, Java, Scala, or similar languages.
SQL Proficiency: Advanced SQL skills for data querying, manipulation, and optimization.
Data Warehousing: Knowledge of data warehousing concepts and solutions.
Data Integration: Skills in integrating data from diverse sources using APIs, data streams, and batch processes.