Awais Irshad
Solutions Architect at Odyssey Solutions- Claim this Profile
Click to upgrade to our gold package
for the full feature experience.
Topline Score
Bio
Experience
-
Odyssey Solutions
-
United States
-
IT Services and IT Consulting
-
1 - 100 Employee
-
Solutions Architect
-
Oct 2022 - Present
We were tasked with integrating data from 9 different databases for a Qatar-based bank and consolidating structured data onto a single platform. The majority of the databases were based on PostgreSQL and Microsoft SQL Server, and the bank required real-time data capture for the SQL Server. To achieve real-time data processing, we implemented Transaction Log-based Change Data Capture (CDC) using the Debezium connector. This allowed us to capture data changes from the SQL Server and store them in Kafka topics within a cluster-based environment. As our objective was to leverage open-source technologies, we utilized MinIO to create a data lake as the target storage. In the second phase, we are conducting Proof of Concepts (POCs) where we fetch payloads triggered by MinIO and dump the data into the respective database. ***Multiverse DataLake Creation The aim is to establish a versatile data lake that caters to the power, energy, and agriculture sectors, enabling more accurate production forecasting aligned with requirements. This will aid businesses in enhancing their operations. The architecture involves the utilization of pipelines consisting of crawlers and generic lambdas implemented with PySpark. Here is a brief overview of our architecture: Crawlers retrieve data and store it in the S3 storage. This triggers the execution of generic lambdas, which pass the corresponding payload to an SQS (FIFO) queue. The queue subsequently transfers the data to the appropriate staging tables within the Greenplum data warehouse. Materialized views are then created on top of these staging tables, which APIs utilize for performing data analytics. Show less
-
-
-
Kavtech Solutions (Private) Ltd.
-
Pakistan
-
Information Technology & Services
-
1 - 100 Employee
-
Architect | Lead Data Optimization
-
Apr 2022 - Nov 2022
-
-
-
TRG - The Resource Group
-
United States
-
IT Services and IT Consulting
-
300 - 400 Employee
-
Principal Software Engineer
-
Mar 2018 - Apr 2022
Part of Ibex CX Customer Experience Management in Automobile Industry for Survey Analysis and Dealership Performance System (Toyota Canada international) Developed Whole Survey Life Cycle to track performance of Toyota and Lexus Canada Dealers. Automated Survey Tool to entertain requests from Several Clients. Historical Data Integration through Rest APIS and Migration From SQL Server to MongoDB using Pentaho for Toyota Canada . Part of Ibex CX Customer Experience Management in Automobile Industry for Survey Analysis and Dealership Performance System (Toyota Canada international) Developed Whole Survey Life Cycle to track performance of Toyota and Lexus Canada Dealers. Automated Survey Tool to entertain requests from Several Clients. Historical Data Integration through Rest APIS and Migration From SQL Server to MongoDB using Pentaho for Toyota Canada .
-
-
-
NETSOL Technologies Inc.
-
United States
-
IT Services and IT Consulting
-
700 & Above Employee
-
Database Analyst Sr Software Engineer
-
Mar 2015 - Feb 2018
Being a Sr /Software Engineer I am responsible for leading DataBase Team for Investec- UK Bank Client,Under my working tenure I have performed following responsibilities. • Testing, debugging, diagnosing and bugs fixation in System. • Consulting, gap analyzing and recommending alterations in system program needs. • Identifying technology limitations and deficiencies in existing systems. • Processes optimization, Configuration and development in accordance with Business needs. • Database Designing, Procedure writing , code maintenance to meet business requirements. • Gathering technical and functional specifications according to system compatibility and deliver it with clear business understanding. • Writing, updating and maintaining technical program, end user documentation and operational procedures . • Providing Guidance in developing strategies for Software Designing and financial evaluation. • Product Delivery within timelines by making user stories and following scrum meeting rules. Show less
-
-
-
Techlogix
-
United States
-
IT Services and IT Consulting
-
500 - 600 Employee
-
Critical Services Engineer
-
Nov 2012 - Dec 2013
Working on People Tools Software of PeopleSoft acquired by ORACLE. Working task is related to System and Server Configuration. Working on People Tools Software of PeopleSoft acquired by ORACLE. Working task is related to System and Server Configuration.
-
-
-
Al-Khawarizmi Institute of Computer Science (KICS), UET Lahore
-
Information Technology & Services
-
200 - 300 Employee
-
Assisstant R&D engineer
-
Sep 2012 - Dec 2012
Project was to create a virtualized enviroment for MIPS architecture using a virtual machine manager XEN hypervisor.It has been done already for X86 but not for MIPS. Contribution was to minimize the linux 2.6.32.13 kernel just for console purposes to run DOM0s and DOMUs. Make the kernel compatilbe by applying XEN-4.2.0 patches to run on OCTEON_CN57XX Board. Setting up a stable XEN DOM0 with linux 2.6.32.13 kernel for fedora17. Program the Xenefied compatible kernel and change the memeory architecture for handling the software based TLB handling. Successfull to handle the GRUB(bootloader) for switching hte DOMs. Tried to map the same features of mips with x86 architecture using OCTEON-SDK just like after BIOS and GRUB working in x86 xen architecture the code switches on START_XEN but in MIPS it switches on START_kernel. Show less
-
-
Education
-
UET
Bachelor of Science (BSc), Electrical engineering -
Board of Intermediate& SecondaryEducation
Matriculation -
Govt. Islamia College
F.S.c, Pre-Engg -
University ofEngineering &Technology (UET)
B.E, Electrical Engineering