Senior Data Engineer
Senior Data Engineer
April 30, 2019 | Database/Data Engineering/Data Analytics | 1 positions in Phnom Penh
This role will be responsible for building and maintaining the software infrastructure that enables computation over large data sets.
- Create, optimize and maintain optimal data collection, flow and pipeline for data science POCs and industrialized solutions
- Assemble, cleanse, integrate and transform large, complex data sets into model ready data
- Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Cloudera ‘big data’ technologies
- Build data cleansing, management and visualization tools that provide actionable insights into data features that might be relevant for POCs and industrialized solutions
- Create data tools for Data Science and other analytics team members that assist them in building and optimizing POCs and industrialized solutions
- Work with stakeholders including Data Scientists, Data Architects, commercial and other stakeholders to assist with data-related technical issues and support their data infrastructure needs
- Graduate with a bachelor or master degree in Computer Science, Information Technology or with work experience with knowledge required by this position
- 3 years of working experience working in a data engineering
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets is required.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement is required.
- Experience of setup and manage on Cloudera technologies
- Experience of using Big data tools such as: Hadoop, Sqoop. Flume, Web HDFS, Spark, Impala, Hive, Solr, etc.
- Experience with Unix Shell scripts, Phyton, PL/SQL
In the same region
Be the next Smart Hero