
Senior Software Engineer
- Xi'an, Shaanxi
- Contract
- Full-time
- Design, develop, and maintain scalable data pipelines and ETL processes on GCP.
- Build and optimize data storage solutions using GCP services like BigQuery, Cloud Storage, and Cloud SQL.
- Collaborate with stakeholders to understand data requirements and deliver solutions.
- Implement CI/CD pipelines for data workflows using DevOps tools and practices.
- Monitor and troubleshoot data pipelines to ensure reliability and performance.
- Ensure data security, compliance, and governance standards are met.
- Automate infrastructure provisioning and deployment using Infrastructure-as-Code (IaC) tools like Terraform.
- Optimize data processing workflows for cost efficiency and scalability.
- Strong experience with GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage, etc.).
- Proficiency in programming languages like Python, Java, or Scala.
- Hands-on experience with DevOps tools (e.g., Jenkins, Git, Docker, Kubernetes).
- Knowledge of Infrastructure-as-Code (IaC) tools like Terraform or Cloud Deployment Manager.
- Experience with data pipeline orchestration tools (e.g., Apache Airflow, Cloud Composer).
- Strong SQL skills for querying and transforming data.
- Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.