DATA ENGINEER

Deskripsi Pekerjaan

Improve the existing layer of data quality modules into a separate data quality engine which identifies, communicates and tracks data quality issues in an automated fashion
Develop the backend and front end of data quality dashboards which provides insights into the availability and quality of incoming data
Develop connectors for the data pipeline to enable connection with data source and data sink of different technologies to handle batch & streaming data and output batched data into data lake
Working closely with the data engineering lead to research and identify new technologies to improve the existing pipeline
Integrate new data management technologies and software engineering tools into existing structures to improve the performance of data storage, retrieval and security.
Ensure systems meet business requirements and industry practices
Design, building and integration of data from various resources, and big data management
Designing of Relational databases and managing of various staging environments.
Familiar with SQL queries on the data to make sure it is easily accessible, works smoothly.
Ability to deep dive into data or technical issues to come up with effective solutions., excellent in technical communication and working directly with stakeholders.

Laporkan!
Lowongan ini mencurigakan?
Loker Premium


Persyaratan

University degree in Computers or relevant diploma.
Professional certification will be added advantage.
Fresh graduates are available to apply.
1-2 years or more experience as Data Engineer
Familiar in Python programming with data frames / pandas.
Hands-on experience with Spark, RDDs, large Datasets, Dataframes, Spark SQL, NoSQL
Experience on ETL jobs from various databases using custom programming and tools. Knowledge on cloud based ETL jobs will be added advantage.
Experience with Hadoop will be added advantage.
Familiar using scripting languages like shell / bash.
Experience with Database Design, Management and Administration.
Knowledge on Data Governance tools like Apache Atlas, Ranger will be added advantage.
Strong knowledge of SQL.
Experience with offline storage, threading, and performance tuning will be added advantage.
Ability to understand business requirements and translate them into technical requirements.
Good understanding of cloud services and scalable infrastructure will be added advantage.
Exposure in virtualization/ dockerization will be added advantage.



via Facebook via Twitter via LinkedIn via Pinterest

Lowongan Kerja DATA ENGINEER | Lowongan Kerja PT. DATTEL MITRA ASIA | Lowongan Kerja Jakarta Pusat

Loker DATA ENGINEER | Loker PT. DATTEL MITRA ASIA | Gaji PT. DATTEL MITRA ASIA | Loker Jakarta Pusat
Tingkatkan Karir Anda Bersama w3loker.com

Lowongan Kerja Lainnya

  • 1
    Lowongan Kerja PHP Developer
    PHP Developer
    PT Adicipta Carsani Ekakarya

    Saati ini kami membuka lowongan kerja untuk mengisi posisi sebagi PHP Developer

    Full-time

    Rp. Nego


    Lihat

  • 2
    Lowongan Kerja IT SUPPORT
    IT SUPPORT
    PT. Karyawaja Ekamulia

    Menguasai jaringan LAN / WAN, Mikrotik Menguasai Hardware komputer, Instalasi OS & Software Mampu bekerja sama dengan tim Jujur & beretikad baik Memilik pengalaman 2-3 Tahun di bidang yang sama Pendidikan minimal D3 / SMK Bersedia untuk beker...

    Full-time

    Rp. Nego


    Lihat

  • 3
    Lowongan Kerja IT OPERATION SPECIALIST
    IT OPERATION SPECIALIST
    PT. Lufax Technology Indonesia

    Responsible for operation management of Indonesia company to ensure the stable operation of company's systems and business: manage and review local external service using status, set up and manage local info security rules; set up business operation ...

    Full-time

    Rp. Nego


    Lihat