05 / 11
Job Summary/Role: The Big data developer team works closely with the manufacturing functions in all relative data fields, such as, 1) connecting and automating the data pipeline from MFG file servers, API, RDB, etc., 2) building structurally data warehouse and data market for flexible application or dashboard, and 3) also handling data cleansing and data governance. In order to accelerate the development of application/analysis, Big data developer will be the individual contributor with strong experience in the technologies of Big Data, Data warehouse, SQL and NoSQL etc. Also Big data developer will also work closely with data analysts/data scientists to solve the real MFG cases. Responsibility: • Collaborate with users, data analysts, data scientists to develop flowcharts, layouts and documents to identify solutions. • Architect on real MFG needs and translate requirements into technical needs. • Identify and understand the data sources that are relevant for analysis, and implement efficient data engineering functions (including data ingestion, cleaning, ETL, integration, etc.) • Consolidate the requirements and using data engineering skills to design a robust Data Mart. • Participate in design, architecture review and deployment of Big data and data warehouse solutions. • Design for automation and monitoring mechanism in a continuous integration environment. • Bring new data technology with POC to solve existing data challenges. • With high performance and comprehensive SQL to process data in relational databases (or Map/Reduce style querying for NoSQL databases). • Work closely with user/IT/data science team to design and develop scalable data pipeline or end-to-end analytical workflow. • Provide direction, training, and guidance to less experienced team members.
05 / 11
Title: 雲端數據工程師 Key Responsibilities: 參與雲端數據架構發展規劃,設計資料處理、儲存、分析架構,以符合數據科學、數據分析、行銷應用等發展。 負責地端數據轉換雲端 ETL Pipeline 開發維運與專案推動。 負責雲端數據平台穩定及架構精進,以利數據應用發展。 負責雲端數據應用服務平台之監控/問題解決/維運升級。 落實團隊人事管理,培育人才以提升團隊工作績效與專業能力。 Requirements: 具備5年以上數據平台/數據分析/資料倉儲專案管理或開發之經驗 具備大型專案規劃與管理能力,展現主動積極特質、勇於接受挑戰、反應敏捷,並具高抗壓性及責任感,能有效進行跨部門溝通與資源協調 優秀的團隊領導能力,具備卓越的溝通協調與管理技巧 具備系統、網路、資料庫、企業資料倉儲、ETL工具(Trinity尤佳/Perl尤佳/SSIS)與應用程式服務操作及管理能力。 熟悉報表、圖表之展示及分析工具(Cognos/Tableau尤佳)。
