Sudipta De
Delivery Director at Unify Consulting- Claim this Profile
Click to upgrade to our gold package
for the full feature experience.
Topline Score
Bio
Experience
-
Unify Consulting
-
United States
-
Business Consulting and Services
-
300 - 400 Employee
-
Delivery Director
-
Jan 2022 - Present
San Francisco Bay Area / San Jose, California, United States
-
-
Practice Manager
-
Nov 2020 - Dec 2021
San Francisco Bay Area / San Jose, California, United States • Near real-time replication from multiple RDBMS source to Snowflake including automated Data Drifting • Event based JSON data ingestion from Yodlee (API) into Snowflake • Dataflow automation: converting semi-structured to structured using Snowflake task & stream • Evaluation, measure, and various level of performance tuning for long running queries in Snowflake • Row/Column Level Security – Snowflake RBAC implementation for static & dynamic data masking • Automated RBAC with… Show more • Near real-time replication from multiple RDBMS source to Snowflake including automated Data Drifting • Event based JSON data ingestion from Yodlee (API) into Snowflake • Dataflow automation: converting semi-structured to structured using Snowflake task & stream • Evaluation, measure, and various level of performance tuning for long running queries in Snowflake • Row/Column Level Security – Snowflake RBAC implementation for static & dynamic data masking • Automated RBAC with pre-defined roles hierarchy; helps lightning-fast user onboarding into Snowflake • Configure & Integrate StreamSets data pipeline with Azure Data Lake Storage & Snowflake • Design, Integrate Web Interface with Snowflake using Rest End Point • Design & Integrate CI/CD with Azure Dev-Ops with Airflow, SchemaChange & DBT • Implement automated snowflake access key & passcode rotation: primary and secondary keys
-
-
-
Zensar Technologies
-
India
-
IT Services and IT Consulting
-
700 & Above Employee
-
Data Architect
-
Dec 2019 - Nov 2020
San Jose, California, United States • Responsible for integrating source applications with CockroachDB, designing/implementing supply chain data warehouse in Snowflake, and developing ETL platform in Python. • Conduct batch and incremental data sink from CockroachDB to Snowflake and Elasticsearch. • Designed and implemented multi-broker/region Kafka cluster setup and performed real time data sink into Elasticsearch using kSQL/kStream and Spark Streaming
-
-
Data Architect
-
Sep 2019 - Mar 2020
San Jose, California, United States • Led Hadoop (in-premises) DataLake migration into Snowflake. • Analyzed and estimated module-wise storage and cluster size. • Designed and implemented security and access control measures, as well as real time data ingestion in Cisco Cloud using Kafka. • Architected integration of ETL platform with Spark-2.4.x & Kubernetes in Cisco Cloud
-
-
Senior Data Engineer
-
Jan 2016 - Dec 2019
San Jose, California, United States • Designed to build Enterprise Data Lake (centralized data warehouse) in Hadoop. • Designed Spark read-write in Elastic Search for real-time metrics integrated with Spark Streaming. • Developed Rest-API interface Web-Portal for real time reporting for Sales/Marketing departments.
-
-
Technical PM
-
Jul 2009 - Dec 2015
San Jose, California, USA • Client meeting, resolved escalations • Manage multiple support and development projects • Create Project Plan, drive multiple releases • Resource Allocation - offshore and onsite team • Identified and analyzed root-cause of issues from customer reported issue tracker. • Reported defects and prioritized bug-fixes on a monthly basis.
-
-
Senior Technical Lead
-
Jul 2006 - Jun 2009
San Jose, California, United States • Led support and maintenance team • Addressed customer issues on priority • Identified top issues and severity of defects and impact. • Reviewed functional and technical documents for every monthly and quarterly release.
-
-
Education
-
Jadavpur University
Master of Science (M.Sc.), Computational and Applied Mathematics