上海知息科技有限公司

上海 ·IT/互联网 ·100-499人

Data Platform Engineer (Shanghai)

25-35K·13薪

上海

5-10年

本科

全职

职位描述
Job Description / General Message
The data platform software engineer in SmartNews plays a key role of accelerating the products/business developments. Great efforts are paid on building a highly efficient and flexible data platform for analytical, operational and machine learning purposes. To serve the internal users from analytics and product-dev teams, the goal and mission of data platform team is to create high-level, easy-to-use data services for simplifying the accessing, integration and consolidation of various data sets, and also building the platforms for executing tasks processing massive data in scales of TB per day.

工作职责及整体介绍
数据平台研发工程师在加速SmartNews产品和业务发展中起着关键性作用。我们致力于为数据分析、运营管理及机器学习等部门建立超高效及高灵活度的数据平台,协助并支持公司内部数据分析、产品研发部门。数据平台团队的目标和使命是为简化多种数据集的使用、整合、合并以及为日均TB级数据处理创建高效、易用的数据平台。

任职资格
• 计算机科学、软件工程及其他相关专业,本科或硕士学历,5年以上相关工作经验
• 扎实的计算机基础,熟悉构建高效、高扩展性的数据结构及算法
• 精通并行编程、分布式编程及数据处理,数据存储系统,如MapReduce, BigTable
• 熟悉现代数据库技术,尤其是NoSQL数据库(如HBase, DynamoDB/Cassandra or Druid等),并参与过上述数据库应用的开发或功能扩展
• 能够部署及适配超复杂大量数据流(ETLs 或Pipelines), 熟悉数据处理工具
• 具备良好的识别、设计通用框架和模块的能力
• 具备绘制开发人员能理解的项目计划及准确、详细的设计规划的能力
• 优先录用熟悉Hadoop、Spark、Hive、Presto、Storm 或Flink,并且能够使用上述数据系统架构大量、快速开发数据处理管道
• 精通已下至少一种编程语言,如Java,Scala,或Python; 熟悉敏捷开发及测试管理
• 具有流利英语及日语能力的优先
公司介绍
Our Mission
News should be for everyone. But not when your internet is spotty or when it's in a filter bubble. That’s why we created SmartNews.
Our mission is to discover and deliver quality stories to the world. To accomplish this:
We are a machine learning company.
News should be impartial, trending and trustworthy. Our algorithms evaluate millions of articles, social signals and human interactions to deliver the top 0.01% of stories that matter most, right now.

Our Values
Three keywords below are SmartNews Core Values. All of our employees always believe in them.
1. For the Common Good
2. Be the Owner
3. Have Appreciation

We believe in technology
How do you deliver the world’s most important information to the people who need it automatically, in real-time? How do you determine what makes a quality story or what people want to read? This is a problem both on a planetary and individual scale, and requires many different disciplines to solve.
上海静安区WeWork2层302室