Job description
Responsibilities
1. Plan and manage the overall big data technology system and data engineering team, building a stable, efficient, and scalable data infrastructure.
2. Design enterprise-level data warehouse architecture, including offline data warehouses, real-time data warehouses, data marts, and data development platforms.
3. Oversee core processes such as data collection, cleaning, modeling, ETL, data scheduling, and data services to enhance data development efficiency and quality.
4. Establish a comprehensive data governance framework, including data standards, metadata management, data lineage, data quality, and data access management.
5. Promote the construction of real-time computing and streaming data processing capabilities to meet data processing needs in high concurrency and multiple business scenarios.
6. Deeply understand business requirements from trading, risk control, product, operations, and finance, translating them into reusable data platform capabilities.
7. Drive optimization of big data technology architecture, continuously improving system performance, stability, and resource utilization efficiency.
8. Responsible for talent development, technical management, and project delivery within the data engineering team.
Requirements
1. Bachelor's degree or above in Computer Science, Software Engineering, Mathematics, or related fields.
2. Over 8 years of experience in big data, data warehousing, or data engineering, with experience in building large data platforms.
3. Proven team management experience, with a background in managing large data engineering teams preferred.
4. Proficient in data warehouse architecture design, data modeling, ETL development, and data governance.
5. Familiar with relevant technology stacks such as Hadoop, Spark, Flink, Kafka, Hive, ClickHouse, Doris, and StarRocks.
6. Knowledgeable in offline and real-time computing systems, with architectural experience in high concurrency and large-scale data processing platforms.
7. Strong technical planning, cross-departmental collaboration, and business understanding skills.
8. Experience in building data platforms for fintech, internet finance, payment platforms, securities, or crypto exchanges is preferred.