Data Engineer
ClosedEngineering Amazon Web Services (AWS) Python SQL
Khu vực
Tổng quan về công việc và trách nhiệm
We are seeking a Data Engineer (Presenior - Senior) to develop a scalable, production-ready data pipeline for ESG Social reporting. This role focuses on processing a high volume of small CSV/XLSX files with inconsistent schemas, ensuring data quality, traceability, and reliability in an AWS environment. - Ingest and validate semi-structured CSV/XLSX files from Amazon S3 - Clean, normalize, and transform data using Python (Pandas) - Handle schema drift, extra/missing columns, and encoding discrepancies - Track file-level data completeness and implement data lineage - Persist cleaned datasets into PostgreSQL or Amazon Redshift - Orchestrate ETL workflows using Airflow, AWS Glue, or Step Functions - Build logging, monitoring, and robust error-handling mechanisms
Kỹ năng và kinh nghiệm tối thiểu
- 1.5+ years of experience with Python and Pandas for ETL - Proficiency with AWS services: S3, Glue, Lambda, Step Functions - Solid understanding of workflow orchestration tools (Airflow or AWS-native) - Experience managing schema evolution and data validation - Proficient in writing queries and managing data in PostgreSQL or Redshift - Strong software engineering principles: modularity, testing, version control
Tại sao ứng viên nên làm ở đây
OPPORTUNITIES AND CHALLENGES: - Opportunity to work in a professional, modern and energizing setting. - Challenging projects, possibilities, cutting-edge technology, and problems. - An open and dynamic working atmosphere that promotes the interchange of ideas, while also empowering you to work and create in your own style. Each employee's talent and accomplishments are valued, and outstanding employees are recognized and rewarded on a yearly basis. - Opportunities for capacity development, as well as assistance with professional certification expenses, are available to those who work in the field (1 million - 5 million). - Some advanced certifications will cover the full cost of studying and taking the exam. ATTRACTIVE REWARDING POLICY AND WORK-LIFE BALANCE: - Income: Fixed salary (upto 50M/ negociate) + other bonus - Review salary 1-2 times/year, with the possibility of an unexpected salary rise based on capacity an infinite number of times per year - Bonuses for the 13th month of employment, project bonuses, and company, Tet holiday, September 2, company birthday, ... - Holiday travel mode (package 5-7 million/person), team building (2-3 times/year). - Full participation in social insurance, as well as a yearly health checkup at a reputable hospital. External insurance with the company's essential workers. - Comprehensive visit policy for personnel and relatives: birthday, marriage, childbirth, illness, etc. - The football club, cycling car, badminton, ... are just a few of the sports and cultural activities available.
Ưu tiên có kỹ năng và kinh nghiệm
- Bonus: Familiarity with ESG data or reporting standards
Báo cáo cho
Manager
Quá trình phỏng vấn
1-2 rounds with Hiring Manager
Công việc đã hoàn thành (8)
