【研究發展處】Big Data Engineer 資料工程師 / Senior Big Data Engineer 資深資料工程師

現觀科技發展產品 CovMo近20年作為橫跨美洲、歐洲、亞洲、中東等跨國22間巨頭電信企業專用之 SaaS Solution，功能包含用戶定位及手機網路訊號分析，而 Big Data Team專職於 OLAP維運及效能調教，SQL Tuning、Dashboard Visualization，並與產品開發團隊進行資料探勘及研究。 [工作內容] 1.開發大數據系統資料處理平台 2.串流資料平行處理程序開發,熟悉分散式運算,平行運算 3.解決大量資料處理時所衍生的效能,擴充與維護維運資料庫 •使用Clickhouse、MySQL/MariaDB 4.具有大數據資料解析程式開發能力 • 會有大量的Database Report，需要用SQL/Bash及Python產生 • 使用Grafana做產品資料視覺化 5.與其他系統開發工作團隊配合 6.能獨立作業,抗壓性高 [JOB DESCRIPTION]: · Maintain and optimize Clickhouse/MySQL databases performance. · Integrate datasets to provide business insight through SQL process and real-time dashboard. · Standardize the process of data collection, storage, transformation, distribution, and usage. · Coordinate with other department to utilize potential data asset towards business strategy. · Redesign DB architecture for a thousand billions data maintenance. · Develop stored proc to generate database reports. · Maintain developed MapReduce system in MySQL database. · Research a new approach to improve data pipeline. [QUALIFICATIONS]: · Knowledge of database installation process · Experience with CentOS / Ubuntu packaging · Knowledge of relevant database clients · Knowledge of mapReduce · Knowledge or experience of working basic OS and Networking database related issues. · Knowledge/experience in administration and troubleshooting for one or more of the following: · Experience performing basic optimization of database · Have an understanding of database migrations [WORKING AT BIG DATA TEAM]: · Experience with data mining, database management and flow control. · Do something meaningful; Be a part of the future of telecom technology. · Work with international colleagues. · Great career development opportunities in a growing company. #保14