职位&公司对比

职位详情

• 上海
• 3-5年
• 本科

• Python
• Hadoop
• Spark
• Python
• SQL
• MapReduce

1. Expert experience with mainstream RDBMS like MySQL(mandatory), PostgreSQL, Oracle and NoSQL suckanzhunh as Redis, HBase; 2. Familiar with the distributed database architecture, ability to design the OLTP with high availability, scalability and performance; solid hands-on experience with distributed DB products in mabossinstream Cloud environment like AliCloud DRDS or GCP spanner; 3. Extensive experience in big data acquisition, pre-processing, storage, and cleansing technologies including Hadoop (HDFS, MapReduce, Yarn,..), Kafka, Sqoop, Spark, Flink and etc; 4. Experience with programming languages: Java, Python or Shell; 5. Knowledge of Graph Database like Neo4j is a plus Responsibility: 1. Responsible for designing, building, testing and maintaining data systems, making sure the data structure, ingestion and processing systems, supporting digital product teams’ requirements and user needs; 2. Responsible for implementing methods to improve data reliability, efficiency and quality; 3. Act as technical expert in regard to integration and connectivity methods, protocols, 4. security and practices for data management systems; 5. Responsible for designing and creating the optimal data pipeline; 6. Work closely wit直聘h data architects/scientists and other stakeholders on future data handling technologies, including input on risks, costs, benefits