Puviarasu Senthilkumar
Senior Software Engineer at PeerIslands- Claim this Profile
Click to upgrade to our gold package
for the full feature experience.
Topline Score
Bio
Credentials
-
MongoDB Professional Services: Certified Partner, Developer
MongoDBJun, 2023- Nov, 2024 -
MongoDB Certified Developer, Associate (C100DEV)
MongoDBSep, 2021- Nov, 2024 -
Microsoft Certified: Azure Data Engineer Associate
MicrosoftSep, 2020- Nov, 2024 -
CCA Spark and Hadoop Developer
ClouderaJul, 2020- Nov, 2024 -
CKAD: Certified Kubernetes Application Developer
The Linux FoundationSep, 2022- Nov, 2024 -
Databricks Certified Associate Developer for Apache Spark 3.0
DatabricksOct, 2022- Nov, 2024
Experience
-
PeerIslands
-
United States
-
IT Services and IT Consulting
-
1 - 100 Employee
-
Senior Software Engineer
-
Aug 2023 - Present
-
-
Software Associate
-
Oct 2021 - Jul 2023
Developing and maintaining configurable data pipelines for Healthcare clients using Azure Databricks, MongoDB, Scala.
-
-
-
Bosch Global Software Technologies
-
India
-
Software Development
-
700 & Above Employee
-
Senior Software Engineer
-
Jun 2017 - Sep 2021
As a Senior Software Engineer at Robert Bosch Engineering and Business Solutions, I played a pivotal role in developing a batch solution initially for Manufacturing Execution System (MES) and transforming the batch to streaming solution. Here's how I contributed to this impactful project: 🚀 Project Overview: - Reduced latency and improved data completeness and performance of the existing MES Batch solution by implementing Spark Structured Streaming. - Enabled near real-time visualization of the production process, enhancing decision-making capabilities. - Developed a generic solution that caters to multiple production plants globally. 🌟 Key Achievements: - Migrated multiple pipelines across different manufacturing plants, with ongoing migration efforts in other locations. - Converted MES batch logic into Spark Structured Streaming jobs, leveraging Spark 2.4.0 and Cloudera CDH6. - Designed and implemented Spark Structured Streaming pipelines tailored for MES data. - Created MES Batch jobs to efficiently merge small files, optimizing data processing. - Tuned the performance of continuous Spark jobs to ensure data processing within desired time intervals. - Adopted a functional programming style in Scala for streamlined development. - Rolled out and maintained pipelines in multiple plants, ensuring seamless operations. - Generalized the solution to make it compatible with different clusters, enhancing scalability. - Developed Linux shell scripts and Python scripts for automated deployment and scheduling of Spark jobs in clusters. - Crafted Hive views with custom logic to meet specific plant requirements. - Implemented automated scripts to refresh Impala data, keeping it up to date. Show less
-
-
-
Cognizant
-
United States
-
IT Services and IT Consulting
-
700 & Above Employee
-
Associate
-
Apr 2013 - May 2017
During my tenure as a Software Developer at Cognizant Technology Solutions, I contributed to a range of projects aimed at optimizing data transfer, analytics, and application integration. Here's an overview of my responsibilities and contribution across these projects: 🚀 Project Portfolio: Project 3: Bulk Transfer Tool Enhancement Description: Developed a solution to transfer vast volumes of data between the Alfresco system and independent user machines worldwide, utilizing various applications. Contributions: - Conducted an in-depth analysis of the existing system's performance. - Explored alternative approaches to enhance the current implementation. - Implemented enhancements and performed unit testing with JUnit. - Ensured periodic Jenkins builds and maintained code quality control. Project 2: Global Analytics and Reporting Description: Designed and implemented a system to perform analytics on logs generated from data and cache servers across the globe, presenting the results in graphical formats. Contributions: - Created complex ElasticSearch queries and aggregations in Java for efficient data analysis. - Developed Spring RESTful web services to support the user interface. - Conducted unit testing with JUnit and seamlessly integrated services with the UI. - Oversaw periodic Jenkins builds to ensure code quality and reliability. Project 1: International Player Management System Description: Integrated a web-based application for managing international baseball players and trainers within the organization. Contributions: - Developed dynamic UI widgets using jQuery to enhance user experience. - Implemented business logic in Java and exposed it as Jersey RESTful web services. - Facilitated seamless integration of services with the user interface. - Maintained database integrity through periodic Liquibase builds and upheld code quality control via Jenkins builds. Show less
-
-
Education
-
Bannari Amman Institute of Technology
Bachelor of Engineering - BE, Computer Science