Dharani Y.

Python Data Engineer at Blackstraw.ai
  • Claim this Profile
Contact Information
Location
CA

Topline Score

Bio

Generated by
Topline AI

0

/5.0
/ Based on 0 ratings
  • (0)
  • (0)
  • (0)
  • (0)
  • (0)

Filter reviews by:

No reviews to display There are currently no reviews available.

0

/5.0
/ Based on 0 ratings
  • (0)
  • (0)
  • (0)
  • (0)
  • (0)

Filter reviews by:

No reviews to display There are currently no reviews available.
You need to have a working account to view this content. Click here to join now

Experience

    • United States
    • IT Services and IT Consulting
    • 100 - 200 Employee
    • Python Data Engineer
      • Dec 2021 - Present
    • Canada
    • Human Resources Services
    • 1 - 100 Employee
    • Python Developer
      • Oct 2021 - Dec 2021
    • United States
    • Restaurants
    • Senior Python Developer
      • May 2020 - Sep 2021

      Project Description: This project provides sustainable, leading-edge solutions to the federal clients. Flags application is converting the batch jobs into airflow jobs on Linux. Responsibilities: • Understanding the business requirements, developing the application by using Python, Airflow. • Writing the code, testing the code, and deploying the code regularly. • Building the data pipelines by using Apache airflow and converting the batch scripts to airflow DAGs and to the code which can run on Linux. • Working on the MS SQL database queries and SSIS jobs. Scheduling the data pipelines and SSIS jobs by using airflow scheduler. • Validating the errors in the DAGs code and fixing them. Working on the file mover program to move the files between the source and destination by using Spybot and create a log entry for the completion of files. • These logs are stored in the Kafka message broker. Responsible for debugging and troubleshooting the airflow DAGs code. • Involving in the hardening of the code and enhancements of the data pipelines. Working on the databases connections and performing queries on the data. • Working on the conversion of C#.net EXE applications that runs on windows to airflow DAGs that uses .NET core in Linux. • Writing the code for the logs, error handing in the project. Writing the test cases to cover the code coverage fully by using Pytest, unit test. • Involving in the unit testing, integration testing, regression testing and UAT testing. • Attending the meetings to share the knowledge and progress of the work. • Building the data pipeline containers and images in the docker and running the pipelines by using docker instances through airflow CLI. Environment: Python, Airflow, MSSQL, Kafka, Data pipelines, Pytest, SSIS jobs, Docker, Bamboo, Batch, .NET applications, Linux.

    • 1 - 100 Employee
    • Python Developer
      • Jan 2019 - Apr 2020

      Project Description: Developed various internal projects. One of my primarily project was to develop an admin application through which they could track down detail of every single product exists in their company, this includes pricing, product details, related documentation and training material through a member login system and allow admin to include any new member. There were several other applications we developed for other departments, including company’s web, database etc. Responsibilities: • Prepared low level detail design document from Functional spec document. • Used Django configuration to manage URLs and application parameters. • Performed troubleshooting, fixed and deployed many Python bug fixes of the two main applications that were a main source of data for both customers and internal customer service team. • Involved in development of Web Services using SOAP for sending and getting data from the external interface in the JSON format. • Used Bootstrap as a mechanism to manage and organize the html page layout. • Worked on development and stored procedures on MongoDB. • Carried out various mathematical operations for calculation purpose using Python libraries NumPy and Scipy. Responsible for debugging the project monitored on JIRA (Agile). • Developed different shell scripts for initial validations. • Followed Scrum/Agile methodology. • Debugging and Troubleshooting production issues. Environment: Python, Django, Shell Scripting, LAMP, Tasty pie, REST, APIs, HTML5, AngularJS, MongoDB, Git, JIRA, NumPy and SciPy, JSON, SOAP

    • India
    • IT Services and IT Consulting
    • 700 & Above Employee
    • Python Developer
      • Jul 2018 - Jan 2019

      Project Description: Implemented an admin tool for report generation. The application allows admin to do different type of analysis like monthly sales, daily sales, sales per product, revenues generated per month and new customers. These reports included internal data analysis. Admin can download generated reports in csv formats. Implemented a REST API using tasty pie. Responsibilities: • Created Business Logic using Python. • Used Django framework for application development. • Created database using MySQL, wrote several queries and Django APIs to extract data from database. • Wrote scripts in Python for extracting data from HTML file. • Effectively communicated with the external vendors to resolve queries. • Developed rich user interface using CSS, HTML, Bootstrap, JavaScript, and jQuery. • Used Git for the version control. Environment: Python, Django, MySQL, Windows/Linux, HTML, CSS, Bootstrap, jQuery, JavaScript, Apache, REST API, Tasty pie.

    • India
    • Manufacturing
    • 700 & Above Employee
    • Python Developer
      • May 2016 - Jul 2018

      Project Description: Eaton is the international worldwide Manufacturing Product base organization which deals manufacturing hydraulics, turbines parts of Aircraft like Airbus 380 & electrical accessories. Project Responsibilities: • Extensively used Python Django Framework for developing backend of applications. Responsible for analyzing various cross-functional, multi-platform applications systems enforcing Python best practices and provide guidance in making long term architectural design decisions. • Involved in Developing a Restful service using Python Flask framework. • Actively involved in Initial software development life cycle (SDLC) of requirement gathering and in suggesting system configuration specifications during client interaction. • Analysis the logs data and filter required columns by Logstash configuration and send it to Elasticsearch. • Implementing admin sites to manage database information with FlaskAdmin, MySQL and SQLite. • Generated various graphs for business decision making using Python matplotlib library. • Tested various regular expression in URL Dispatchers in Django. • Improving preexisted client-based applications by introducing Django framework in backend • Developed frontends using HTML, CSS, JavaScript and jQuery. • Analyzed and Designed workflows based on business logic. • Designed user friendly Interface using Bootstrap framework. • Implemented AJAX to update necessary section of webpages and hence, avoiding the need for reloading the entire web page. • Wrote python code within the Hadoop framework to solve Natural Language Processing problems. • Environment: Python, Django, Ajax, HTML, CSS, JavaScript, and jQuery. PostgreSQL, GitHub, Heroku, MySQL and SQLite. Python matplotlib Flask, Tasty pie, REST API, JSON, Puppet, Bootstrap, RabbitMQ, puppet Restful service.

Education

  • Jawaharlal Nehru Technological University, Kakinada
    Master of Business Administration - MBA
    2014 - 2016
  • Acharya Nagarjuna University
    Bachelor of Computer Science - BSc
    2011 - 2014

Community

You need to have a working account to view this content. Click here to join now