Associate Data Engineer
BitHealth
Tanggal: 3 minggu yang lalu
Kota: Tangerang, Banten
Jenis kontrak: Penuh waktu
Responsibilities
We are looking for a Junior Data Engineer to join our team in building a data lake using Microsoft Data Fabric. This role involves ingesting, processing, and optimizing data pipelines from multiple sources, ensuring data integrity and performance. The ideal candidate should have experience with big data solutions, cloud environments, and data pipeline automation.
We are looking for a Junior Data Engineer to join our team in building a data lake using Microsoft Data Fabric. This role involves ingesting, processing, and optimizing data pipelines from multiple sources, ensuring data integrity and performance. The ideal candidate should have experience with big data solutions, cloud environments, and data pipeline automation.
- Design, develop, and maintain a scalable Data Lake architecture using Microsoft Data Fabric.
- Build and optimize ETL workflows using Apache Spark for structured and unstructured data.
- Integrate and manage data sources from SQL Server for efficient data ingestion.
- Ensure data integrity, performance, and security across the data pipeline.
- Collaborate with data scientists, analysts, and business teams to provide clean and structured data.
- Implement best practices for data modeling, processing, and performance tuning.
- Automate data pipeline monitoring and troubleshooting to improve system reliability
- Strong problem-solving and analytical skills.
- Ability to work in a collaborative team environment.
- 0-2 years of experience in data engineering or a similar role.
- Strong understanding of SQL Server or other RDBMS.
- Proficiency in Python or Scala for data processing and automation.
- Experience working with Microsoft Data Fabric or similar data lake solutions.
- Hands-on experience with Apache Spark for ETL processing.
- Experience with CI/CD pipelines and workflow orchestration tools.
- Solid understanding of cloud-based data architectures (Azure/AWS/GCP).
Cara melamar
Untuk melamar pekerjaan ini, Anda perlu otorisasi di situs web kami. Jika Anda belum memiliki akun, silakan daftar.
Posting CVPekerjaan serupa
Jr. Product Development Executive
Siegwerk Druckfarben AG & Co. KGaA,
Tangerang, Banten
2 hari yang lalu
What You can expect as - Jr. Product Development Executive.
Support new innovative projects sourced from BU, Marketing and literatures.
Participate in the meeting and forum for BIO base materials, CE activities globally, in order to generate the project pipeline.
Elaborate R&D project documentation (brief, objective and approach), so as to better define and communicate the project content in the...
Server
Marriott International, Inc,
Tangerang, Banten
1 minggu yang lalu
Additional Information Job Number25158266 Job CategoryFood and Beverage & Culinary LocationSheraton Jakarta Soekarno Hatta Airport, Kawasan Bandara Soekarno-Hatta, Jalan Prof Dr Ir Sedyatmo KM 02, Kota Tangerang, Banten, Indonesia, 15126 ScheduleFull Time Located Remotely?N Position Type Non-Management
Explore nuestro enorme universo
Lo invitamos a unirse a nuestra familia global y diversa. No importa si es nuevo en la industria hotelera...
Software Accounting Tester
PT Global Urban Esensial,
Tangerang, Banten
1 minggu yang lalu
Handle GPOS Lite (POS System for Apotek)
Coordinate with the tech team to ensure the POS features run smoothly and accurately
Assist tech team in conducting end-to-end quality assurance testing for client feature requests.
Identify, document, and report bugs, errors, and inconsistencies found during testing.
Collaborate with developers, product managers, and stakeholders to resolve issues and improve system quality.
Ensure...