Senior Data Engineer

February 28, 2023 | Database/Data Engineering/Data Analytics | 1 positions in Phnom Penh

Job responsibilities

This role will be responsible for building and maintaining the software infrastructure that enables computation over large data sets.

• Create, optimize and maintain optimal data collection, flow and pipeline for data science POCs and industrialized solutions
• Assemble, cleanse, integrate and transform large, complex data sets into model ready data
• Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Cloudera ‘big data’ technologies
• Build data cleansing, management and visualization tools that provide actionable insights into data features that might be relevant for POCs and industrialized solutions
• Create data tools for Data Science and other analytics team members that assist them in building and optimizing POCs and industrialized solutions
• Work with stakeholders including Data Scientists, Data Architects, commercial and other stakeholders to assist with data-related technical issues and support their data infrastructure needs
• Work with data and analytics experts to strive for greater functionality in our data systems

Job requirements

• 3 years of working experience working in a data engineering
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets is required.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement is required.
• Experience of setup and manage on Cloudera technologies
• Experience of using Big data tools such as: Hadoop, Sqoop. Flume, Web HDFS, Spark, Impala, Hive, Solr, etc.
• Experience with Unix Shell scripts, Phyton, PL/SQL
• Experience of UNIX, Linux and Windows platform
• End to End Technical View (Intermediate): Knowledge and ability to understand the telecommunications industry, the end to end architecture, value chain, systems and inter-connect/inter-operation including process flows from customer to service in support of service delivery and the services from the customer demands to the delivery, in the context of your domain of expertise.
• IT Governance (Intermediate): Knowledge and ability to define, update, and implement the company information system management and audit policy
• Process Improvement (Intermediate): Knowledge and ability to understand business processes, improve internal Service Level Agreements (SLAs) and methods to make the unit more efficient
• Business Support Systems (Foundational): Knowledge and ability to operate and maintain the company's various business support systems including convergence billing system, charging system, VAS system and CRM system
• Architecture Design (Intermediate): Knowledge and ability to set or select standards, patterns and practices for the development of software applications
• Database Design (Expert): Knowledge and ability to specify, design, implement and maintain solutions for storage and access to both structured and unstructured information, in support of business information needs.
• Release Management (Intermediate): Knowledge and ability to manage processes, systems and functions to package, build, test and deploy changes and updates (which are bounded as releases) into a live environment, establishing or continuing the specified Ser-vice, to enable controlled and effective handover to Operations and the user community.