Core Responsibilities
- Platform Architecture & Development
- Design and implement data platform components, ensuring high availability, scalability, and performance.
- Evaluate and integrate appropriate technology stacks, frameworks, and AWS cloud services for data ingestion, storage, and processing.
- Data Platform Operations & Automation
- Build and optimize ETL/ELT pipelines for structured and unstructured data using tools like AWS Glue, Informatica IDMC, Spark, and Python.
- Automate workflows using Airflow to reduce manual interventions and improve operational efficiency.
- Manage Tech debt effectively by using available resources & time.
- Governance & Compliance
- Implement automation for role-based access controls, audit logging, and data masking to meet regulatory and security requirements.
- Collaborate with governance teams to embed metadata, lineage, and data quality controls across the platform.
- Release & Change Management
- Participate in CAB meetings, assess IT changes, and manage risk for platform upgrades and deployments.
- Maintain documentation for runbooks, SOPs, and escalation paths.
- Performance Tuning & Monitoring
- Develop monitoring models for legacy and modern platforms.
- Conduct root cause analysis for data ingestion failures and optimize platform performance.
- Collaboration & Leadership
- Provide technical guidance and coaching to engineering teams.
- Partner with product owners and architects to align platform capabilities with business needs.
Required Skills & Tools
- Cloud Platforms: AWS (mandatory), Azure or Ali Cloud (plus).
- Data Technologies: Spark, Redshift, Glue, Cloud Watch, Informatica IDMC, Kafka, DMS.
- Programming: Python, Airflow, Glue Workflow, SQL.
- DevOps & CI/CD: Jenkins, Git, containerization (Docker/Kubernetes).
- Governance Tools: Starburst(Good to have), Apache Ranger, Microsoft Purview.
- Soft Skills: Strong stakeholder management, communication, and ability to work in Agile environments.
Qualifications:
- 8-10 years of experience in data/platform management or data engineering roles, in the financial services industry,
- Minimum 2-3 years of experience in insurance industry is strongly preferred.
- Fluent in English and Cantonese, with strong communication and stakeholder management skills.
- Hands-on experience with cloud platforms (AWS, Ali Cloud, Azure) and data platform engineering.
- Familiarity with Cloud Operations & Practices.
Please apply or share your CV to s.yeung@gravitasgroup.com
