Data Engineer
Engineering Data Engineer
Mức lương
Khu vực
Tổng quan về công việc và trách nhiệm
- Strategically explore and obtain data and information from various sources within the ecosystem and external partners into VNPAY’s core platform - Strategically explore and obtain data and information from various sources within the ecosystem and external partners into VNPAY’s core platform - Ensure data assets are organized and stored most efficiently for mining purposes - Design, build and maintain optimized data pipelines and ETL/ELT solutions as business support tools in providing analysis and real-time analytics platform for critical decision making. - Proactively collaborate with data users to understand data requirements, build and deploy optimized data solutions - Evaluate current complex data architecture in the organization and identify mandatory improvements - Define strategies for data infrastructure to fulfill data analytic and utilization needs of the organization - Manage and drive the upgrades to systems and storage to accommodate business and product requirements for data operations - Design and deliver data infrastructure and functionalities with the most suitable technologies for data analysts, data scientists, and other business roles to monetize data and fulfill the strategy of VNPAY
Kỹ năng và kinh nghiệm tối thiểu
- Good at 1 of these 3 programming languages: Java, Scala, Python - Worked with bigdata eco-system: Hadoop, Spark, Kafka, Nifi, Airflow, Flink, Kafka, Hive, Delta Lake - Worked with NOSQL databases: Mongo, Redis and SQL databases: oracle, Postgres - Worked with Docker, Kubernetes, Google Bigquery, Cassandra is a plus - Basic knowledge of searching and sorting algorithms. - Deep experiences in optimizing ETL tasks, designing and building dimensional data models - Understanding of Information Security principles to ensure compliantly - Experience working in Agile teams to lead successful innovative projects with a cross-functional team - Experience architecting, coding, and delivering high-performance microservices and/or delivering solutions serving millions of users
Tại sao ứng viên nên làm ở đây
- Negotiable salary according to qualification + Performance Bonus - Free breakfast, Lunch allowance, Beauty allowance - Performance review each year and salary adjustment based on job performance - Healthcare: Annual health check-up, Premium Health Insurance for Employee and Family - Comfortable working conditions - Good career growth opportunities with interesting and challenging projects; - Outdoor activities with company support: sports clubs, team building, year end party - Time work: Mon - Fri (8:30 - 17:30)
Ưu tiên có kỹ năng và kinh nghiệm
- Workded with HyperLogLog algorithm is a plus
Ứng tuyển vào công việc này
Công việc đã hoàn thành (8)
