Data Engineer
Standard Chartered
- Guangzhou, Guangdong
- Permanent
- Full-time
- Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data lake on Amazon S3.
- Implement data validation and quality checks to ensure the accuracy and consistency of data throughout the ETL process.
- Utilize Amazon Athena for ad-hoc querying and analysis of data stored in Amazon S3, optimizing query performance and efficiency.
- Develop and maintain automated workflows using Apache Airflow to schedule and orchestrate data processing tasks, ensuring timely and reliable data delivery.
- Write clean and efficient Python code to support data transformation, integration, and data engineering tasks.
- Collaborate with senior data engineers to design and evolve the data architecture, ensuring scalability and performance of the data infrastructure.
- Maintain comprehensive documentation of data pipelines, workflows, and processes for future reference.
- Identify and resolve data pipeline issues, performance bottlenecks, and data quality concerns in a timely manner.
- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide data engineering support.
- Display exemplary conduct and live by the Group’s Values and Code of Conduct.
- Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
- Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
- Lead the team to achieve the outcomes set out in the Bank’s Conduct Principles: [Fair Outcomes for Clients; Effective Financial Markets; Financial Crime Compliance; The Right Environment.] *
- Exercise authorities delegated by the Board of Directors and act in accordance with Articles of Association.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Strong knowledge of Amazon S3, Amazon Athena, and Apache Airflow.
- Proficiency in Python programming for data manipulation and scripting.
- Basic understanding of data modelling, SQL and database concepts.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and teamwork abilities.
- Eagerness to learn and adapt to new technologies and tools.
- Experience with cloud platforms like AWS.
- Familiarity with distributed computing frameworks (e.g. Apache Spark).
- Knowledge of data warehousing concepts.
- Previous experience with data visualization tools (e.g. Tableau, Power BI).
- Previous experience with ML.
- Previous experience with Terraform.
- Data Pipeline Development
- Data Quality Assurance
- Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
- Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
- Be better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term
- Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations
- Time-off including annual, parental / maternity (20 weeks), sabbatical (12 weeks maximum) and volunteering leave (3 days), along with with minimum global standards for annual and public holiday, which is combined to 30 days minimum
- Flexible working options based around home and office locations, with flexible working patterns
- Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
- A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning
- Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.