Senior Technologist, Office of CTO

• Aug 2023 - Present

Senior Solutions Engineer

• Apr 2022 - Present

1) Help customers stabilize Pulsar clusters in hybrid clouds2) Help customers build SRE practices with Pulsar clusters.3) Help customers migrate Kafkat/RabbitMQ to StreamNative Cloud.4) Teach customers to operate pulsar on K8S platforms.

Senior Solutions Engineer

• Jan 2021 - Mar 2022

As a professional service engineer, I helped customers adopt cloud-native data platforms by: 1) Migrating Postgres, MySQL, MS-SQL, Oracle, etc. to Yugabytedb. 2) Designing data pipelines in K8S with gitops and argocd. 3) Deploying yugabytedb on multiple gke clusters using terraform and ansible. 4) Securing yugabytedb with LDAP (authentication/authorization), TLS (end to end encryption) and non-root/sudo operations. As a professional service engineer, I helped customers adopt cloud-native data platforms by: 1) Migrating Postgres, MySQL, MS-SQL, Oracle, etc. to Yugabytedb. 2) Designing data pipelines in K8S with gitops and argocd. 3) Deploying yugabytedb on multiple gke clusters using terraform and ansible. 4) Securing yugabytedb with LDAP (authentication/authorization), TLS (end to end encryption) and non-root/sudo operations.

Advisory Data Engineer

• Jan 2020 - Jan 2021

As a lead database reliability engineer, I help customers build "PRODUCTION" systems by: 1. Showing what a production system means (defining service objectives, managing risks, and designing operational visibility) 2. Demonstrating what if a disaster happens and how to avoid system down(Designing, implementing, and testing backup/recovery strategy) 3. Preventing data leakage (Deploying end to end security for data protection, compliance, and audits) 4. Designing hybrid cloud strategy (Estimating data migration cost cross hybrid clouds) 5. Managing data product releases (Implementing data CICD) Show less

Advisory Data Engineer

• Mar 2017 - Dec 2019

As an advisory data engineer, I helped customers build modern data platforms by1) Deploying enterprise data lake using Pivotal Hadoop/Hortonworks Hadoop on the public and private on-prem cloud with Isilon, direct-attached storage, and SAN2) Enabling data lineage, security, strong authentication with AD/LDAP Kerberos integration.3) Building BI dashboard using Hadoop SQL engine, Greenplum MPP data warehouse, and Spark.4) Bontinuing support on 2nd-day operations

Senior Data Engineer

• Jun 2014 - Mar 2017

As a senior data engineer (pre-sales), I helped customers architect IoT data platforms for real-time streaming and batch workloads by:1. Building the Hadoop cluster from white-box Linux bare metal servers (the hard way).2. Building data flow using Spring Cloud Dataflow with Spring Integration/Batch. 3. Delivering services/executing proof of concepts on Hadoop MapReduce, Hive, Spark, Greenplum, and Hawq.4. Enabling end-to-end data encryption among dataflows, SQL engines, and storages Show less

Field Engineer

• Jan 2014 - May 2014

After 6-8 months of shadowing and learning, I ran a couple of PoC and helped my sales counterpart win some deals. Most of the tech stuff is Hadoop based, like Mapreduce, java debugging, JVM remote debugging and stack tracing, a lot of OS/network configuring and troubleshooting.

Associate Field Engineer

• Mar 2013 - Dec 2013

This is my first full-time job. In this period, I flew around different cities looking for my mentors when I shifted my role from academic to the real world. I shamelessly asked my mentors to shadow their actions in the fields. Not much to talk about; just trying to learn as fast as I can.

PHD Student

• Jul 2011 - Jul 2014

Dissertation: Deception Deterrent Framework. Online Deception detection in mafia game dataset using Perl/Java/Hadoop/NLP. Dissertation: Deception Deterrent Framework. Online Deception detection in mafia game dataset using Perl/Java/Hadoop/NLP.

Engineer

• Apr 2012 - Dec 2012

1. Created a mobile targeting platform for SMB using Android, jQuery, OpenLayers, Servlet, Geoserver, and PostgreSQL/PostGIS. 2. Created a timezone transformation Restful Web Services. 3. Spatial-temporal and social network analysis on 4square/Twitter and Gowalla dataset using R and Hadoop. 1. Created a mobile targeting platform for SMB using Android, jQuery, OpenLayers, Servlet, Geoserver, and PostgreSQL/PostGIS. 2. Created a timezone transformation Restful Web Services. 3. Spatial-temporal and social network analysis on 4square/Twitter and Gowalla dataset using R and Hadoop.

Research/Teaching Assistant

• Jul 2005 - Jul 2011

Taught or Assisted in the following courses: • IS247 Computer Programming II (Java/ Data Structure/ Algorithms) Lecturer Spring 2011, Fall 2010 • IS387 Information Architecture for the Web Teaching Assistant Spring 2010, Fall 2009 • IS634 Structured System Analysis and Design Lecturer Spring 2009 • IS101 Introduction to Information Systems Lab Lecturer Fall 2008, Spring 2008 • Online Deception and Detection Research Assistant Fall 2005 – Fall 2007 Designed a web crawler to retrieve chat-room user data on a Chinese website using Perl/Regular Expression and Java. Created store procedure to process and clean data in PostgreSQL database. Used natural language processing (NLP) tools to parse language cues. Used data mining techniques in Weka and SPSS to analyze data and find valid language cues for deception detection. Show less

Project Manager

• Jun 2003 - Jul 2004

1. Designed and implemented as part of a team OnCar GPS Device using MFC on Windows CE platform. 2. Designed a WebGIS application using PostgreSQL, PostGIS, and JSP/servlet. 3. Worked successfully as part of a team to develop an E-GPS prototype to improve accuracy of GPS land scaling. 1. Designed and implemented as part of a team OnCar GPS Device using MFC on Windows CE platform. 2. Designed a WebGIS application using PostgreSQL, PostGIS, and JSP/servlet. 3. Worked successfully as part of a team to develop an E-GPS prototype to improve accuracy of GPS land scaling.

System Analyst/Designer

• Jul 2002 - Jun 2003

1. Acquired user requirements for Digital Content Management System in National Archives Administration (Taiwan) and constructed Web-tier of this System using Struts. 1. Acquired user requirements for Digital Content Management System in National Archives Administration (Taiwan) and constructed Web-tier of this System using Struts.

System Administrator

• Jul 2000 - Jul 2002

1. Performed mail (Postfix, sendmail), DNS (BIND), and web (Apache) server support for MIS department. Support tasks involved work with Solaris and Linux servers. 1. Performed mail (Postfix, sendmail), DNS (BIND), and web (Apache) server support for MIS department. Support tasks involved work with Solaris and Linux servers.