Data Analyst Engineering ETL SQL Data Processing
Responsibilities: - Design, build, and maintain scalable data pipelines for real-time and historical data processing. - Set up and optimize databases, data warehouses, and ETL processes to manage large-scale time-series data from sensors (energy consumption, temperature, humidity, occupancy) and external sources (weather, utility data). - Experience in handling and processing large data input volumes (1000s of rows per second) - Collaborate across Product, Customer Success, Installation, and Tech Support to align data architecture with business needs and ensure data quality. - Implement monitoring and logging systems to ensure pipeline reliability and quickly troubleshoot issues. - Work with data scientists to streamline data access, facilitate experimentation, and support predictive model deployment.
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. - 5+ years of experience as a Data Engineer, with a proven track record in building and scaling data infrastructure. - Experience managing time-series data is a must. - Expert knowledge in SQL (Postgres), PL/pgSQL, DBT. - Ability to read and optimize query plans - Strong skills in data pipeline and ETL design, with experience in tools like Metaflow, Airflow, and TimescaleDB. - Proficiency in Python, and familiarity with data manipulation frameworks. - Familiarity with data warehousing principles
At SensorFlow, we’re made up of dreamers, achievers, and visionaries whose passion and belief in a greater cause drive us to do more and push the boundaries of innovation every day. If you want to work with fun-loving and diverse personalities in an environment that prioritizes your learning, development, and autonomy, then SensorFlow is the perfect place for you. We also have amazing benefits that include a generous annual leaves, medical coverage, birthday leave, fitness benefits, and Flexi benefits. *Total compensation package will include fixed salary + incentive (according to company's performance)
How long is the remote working period? After the remote period, will the role require working onsite, and if so, where would the office be located? Also, does the company currently have an office in Vietnam?
Only remote in the Phillipines