Shailesh Siddheswaran
Senior Data Engineer
About
Shailesh Siddheswaran is a Senior Data Engineer specializing in scalable Spark RDD and DataFrame-based distributed data processing workflows. With over 3 years of experience, he excels in designing and implementing Medallion Architecture (Bronze, Silver, Gold) data platforms. He has a proven track record of building robust ingestion and transformation pipelines across multi-cloud environments. He is seeking challenging roles to leverage his expertise in big data and cloud technologies.
Experience
Senior Data Engineer
Aug 2025 – Present · 9 mosCognizant Technologies
- Designed and implemented end-to-end Medallion Architecture supporting multi-cloud analytics.
- Built scalable ingestion and transformation pipelines on AWS using PySpark and AWS Glue.
- Integrated Apache Kafka for real-time streaming ingestion into Bronze layer pipelines.
Senior Data Engineer
Jun 2022 – Aug 2025 · 3 yrs 2 mosDXC Technology
- Designed and implemented end-to-end Medallion Architecture supporting multi-cloud analytics.
- Built scalable ingestion and transformation pipelines on AWS using PySpark and AWS Glue.
- Integrated Apache Kafka for real-time streaming ingestion into Bronze layer pipelines.
Big Data Developer
Nov 2023 – Jul 2025 · 1 yr 8 mosLiberty Mutual Insurance
- Designed and implemented performance monitoring for Spark DataFrame workflows.
- Utilized Spark APIs and SQL for efficient data manipulation across various formats.
- Configured AWS EMR clusters for seamless data transfers and debugged performance issues.
Data Engineer
Jun 2022 – Oct 2023 · 1 yr 4 mosZurich Insurance
- Designed and deployed scalable data processing pipelines on Azure Databricks.
- Managed big data workflows using Kubernetes to orchestrate containerized PySpark jobs.
- Integrated Google BigQuery for advanced data analytics and strategic business decisions.
Skills
Operating Systems
Data Visualization
Big Data Technologies
DevOps & Orchestration
Programming & Scripting
Cloud Platforms & Services
Languages
Education & Certifications
Bachelor's Degree
Saveetha Engineering College · 2022
Higher Secondary Certificate
KRM Matric Higher Secondary School · 2018
Secondary School Certificate
The Elite English School · 2015