Senior Data Engineer

• Feb 2022 - Present

Senior Consultant - Big Data

• Jan 2020 - Feb 2022

• Work with Product Managers on client facing projects. Gather business requirements and build NoSQL database clusters and design performance-optimized data models. • Recognized 3 times by management and my peers for client partnership and service delivery. • Designed and deployed an Elastic Stack cluster on OCP cloud (using Docker, Udeploy and other DevOps tools) for a data security project. • Work with the clients to translate business specific KPIs into Kibana dashboards. • Scripted an automated backup and restore process for production Cassandra clusters to restore data during write failures and for disaster recovery. • Identified and resolved connectivity issues and errors on Logstash servers that were causing data integrity issues. • Perform config tuning to alleviate performance issues and errors in Cassandra & Elasticsearch clusters.

Big Data Engineer

• May 2019 - Jan 2020

• Led a team of 4 Data Engineers and owned the data solution end to end. • Created project roadmaps, milestones, and assigned tasks to data team and held weekly team huddles. • Architected and developed an Elastic Stack cluster of 30 nodes- with Elastic Search, Logstash, Kibana and File beat for a centralized log monitoring project. • Implemented improvements to Cassandra data models for reducing query response times. • Used Kibana to create visualizations and dashboards to show business specific email deliverability and marketing metrics and error logs and reduced query response time from 5+ hours (SQL queries) to 30 seconds. • Provisioned nodes on GCP set up VPC peering and deployed the Elastic stack & Cassandra clusters. • Set up monitoring for the clusters using GCP’s Stack driver and Kibana’s Stack monitoring. • Collaborated with Product Managers and Customer Success Managers to understand client requirements and translated those business requirements to build data models and clusters by leveraging big data technologies.

Big Data Engineer

• Oct 2016 - Mar 2019

• Worked as Cassandra admin-architect, manage over 35 clusters in Production, QA, Dev. • Achieved the ACE Award for my initiative in collaborating with application teams and revising data models to make the clusters 40% more efficient. • Migrated 20 Cassandra clusters running on-prem to AWS with zero downtime. • Cluster planning – Identified software and hardware configurations based on project requirements. • Built, configured and deployed data technologies using multiple tools - Chef, AWS, GIT, Cron, Rundeck, Shell Scripts, Dev Center, Zabbix, Kibana. • Evaluated and consolidated existing cluster resources to save over 20% of the yearly operational costs. • Worked with over 10 application teams for Cassandra data modelling and worked on query tuning. • Proactively tuned cluster parameters to achieve 40% more throughput and performance. • Developed, deployed and maintained Chef Automation scripts that reduced the upgrade time of a cluster from 8 hours to 1 hour. • Automated Cassandra maintenance processes - repairs, backups, alerts. • Worked closely with Datos IO and Talena to conduct POCs and implement NOSQL backup tools in 10 Prod clusters. • Evaluated and researched new technologies to fill existing technology gaps.

Intern

• May 2013 - Jul 2013

Team Member

• Nov 2010 - Jul 2011