A renowned insurance firm is looking for a junior data/ ETL engineer with insurance industry background to work on regional projects
Responsibilities: - Peform the Extract, Transform, and Load (ETL) process for data pipelines
- Construct ETL job pipelines using ETL tools
- Manage ETL job scheduling and optimize data load
- Identify gaps in the ETL pipeline and execute data normalization to enhance data processing
- Gain extensive exposure to various database technologies and automation
- Design, create, document, and implement comprehensive data pipelines and integration processes, encompassing both batch and real-time data processing
- Perform data analysis, profiling, cleansing, lineage, mapping, and transformation
- Develop ETL/ELT jobs, workflows, and deploy data solutions
- Monitor and suggest improvements for data quality, reliability, efficiency, and cleanliness
- Optimize and fine-tune ETL/ELT processes
- Recommend and implement best practices in data management and data lifecycle processes
- Prepare test data and support the creation and execution of test plans.
- Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors, and business stakeholders to comprehend data requirements and implement data solutions
- Provide ongoing support for data issues and change requests, documenting all investigations, findings, recommendations, and resolutions
Requirements:
- Over 2 years of work experience in the insurance or finance industry
- Knowledge of IBM DataStage or equivalent ETL software
- Strong communication skills to effectively communicate and present technical information in a clear and unambiguous manner
- Familiarity with ETL/ELT frameworks, data warehousing concepts, data management frameworks, and data lifecycle processes
- Experienced in handling and processing diverse data types (structured, semi-structured, and unstructured)
- Thorough understanding of various database technologies (RDBMS, NoSQL, and columnar)
- Profound comprehension of programming languages such as Python
- Strong ability to work independently and collaborate with diverse teams in a multi-stakeholder environment