Associate Data Engineer
BitHealth
Tanggal: 8 jam yang lalu
Kota: Tangerang, Banten
Jenis kontrak: Penuh waktu
Responsibilities
We are looking for a Junior Data Engineer to join our team in building a data lake using Microsoft Data Fabric. This role involves ingesting, processing, and optimizing data pipelines from multiple sources, ensuring data integrity and performance. The ideal candidate should have experience with big data solutions, cloud environments, and data pipeline automation.
We are looking for a Junior Data Engineer to join our team in building a data lake using Microsoft Data Fabric. This role involves ingesting, processing, and optimizing data pipelines from multiple sources, ensuring data integrity and performance. The ideal candidate should have experience with big data solutions, cloud environments, and data pipeline automation.
- Design, develop, and maintain a scalable Data Lake architecture using Microsoft Data Fabric.
- Build and optimize ETL workflows using Apache Spark for structured and unstructured data.
- Integrate and manage data sources from SQL Server for efficient data ingestion.
- Ensure data integrity, performance, and security across the data pipeline.
- Collaborate with data scientists, analysts, and business teams to provide clean and structured data.
- Implement best practices for data modeling, processing, and performance tuning.
- Automate data pipeline monitoring and troubleshooting to improve system reliability
- Strong problem-solving and analytical skills.
- Ability to work in a collaborative team environment.
- 0-2 years of experience in data engineering or a similar role.
- Strong understanding of SQL Server or other RDBMS.
- Proficiency in Python or Scala for data processing and automation.
- Experience working with Microsoft Data Fabric or similar data lake solutions.
- Hands-on experience with Apache Spark for ETL processing.
- Experience with CI/CD pipelines and workflow orchestration tools.
- Solid understanding of cloud-based data architectures (Azure/AWS/GCP).
Cara melamar
Untuk melamar pekerjaan ini, Anda perlu otorisasi di situs web kami. Jika Anda belum memiliki akun, silakan daftar.
Posting CVPekerjaan serupa
IT Infrastructure DevOps
PT GTech Digital Asia,
Tangerang, Banten
1 minggu yang lalu
Design, implement, and maintain scalable, resilient, and secure IT infrastructure solutions. Manage cloud infrastructure on platforms such as AWS, Azure, or Google Cloud.Monitor and maintain systems to ensure they remain operational and secure.Implement comprehensive monitoring and alerting solutions to ensure system health and performance.Integrate testing, security, and compliance checks into the CI/CD pipelines.Minimum QualificationsBachelor's degree in IT or computer science.more...
Sales Offline Supervisor (Modern Channel)
Delamibrands,
Tangerang, Banten
2 minggu yang lalu
ResponsibilitiesJOYLAB a passionate Beauty Brand about Positive-Vibe, that believe that all kind of JOY comes from within, to have a happy heart and generous smile. JOYLAB aims to deliver latest global trend of Skincare & Skin-Enhancer Makeup products to spark the beauty within you. JOYLAB is working step-by-step to bring more positivity and better outlook in life, by choosing ‘greener’...
B&W CMI Lead Greater Asia & Indonesia
Unilever,
Tangerang, Banten
2 minggu yang lalu
Unilever is currently hiring for B&W CMI Lead Indonesiabased in Grha Unilever, IndonesiaAbout UnileverWith 3.4 billion people in over 190 countries using our products every day, Unilever is a business that makes a real impact on the world. Work on brands that are loved and improve the lives of our consumers and the communities around us. We are driven by...
