Swapnil Phulse
Data Engineering | Data Platform Development | DataOps | Unsupervised Learner @ MuchInLearning.com
- Role
- Lead Data Engineer at Thoughtworks
- Location
- Houston, TX, US
- LinkedIn followers
- 500 followers
About Swapnil Phulse
Opinionated, but not ideological about technologies. A knack for all things tech, especially their trade-offs. Time-tested skills to learn new things on the go.Hands-on experience with backend design/development/testing/productionization/delivery of large scale cross-functional enterprise data platforms Interested in any-and-all things related to cloud-native data platform development - Big Data(Batch/Realtime) workloads, Distributed Architecture, Cloud Networking and security,Data Platform development, Infrastructure automation, Workflow Engines, ETL Pipelines, CLI tooling, Data Governance, Data Quality, Microservice APIs(RESTfulDaily work drivers include, but not limited to->Programming Languages: Python, Scala, Java(basic), PL/SQL>Application Development: FastAPI, Django, Flask>Distributed Computing: Spark with Pyspark, Hive, Mapreduce, Sqoop, Hadoop, Kafka(basic)>Cloud Datawarehouses: Snowflake, Databricks, Bigquery>Schedulers: Dagster, Prefect, Airflow, Dell Boomi, Step functions, Cronjobs>Cloud platforms: AWS, Google Cloud>Containers: Docker, Docker-compose, Docker-swarm, Kubernetes>CI/CD: CircleCI, Github Actions>IAC: Terraform>Databases: MS SQL Server, Oracle, Postgres>Tools: VS Code, Intellij IDEA, Pycharm, SSMS, pgAdmin, Dbeaver, Git KrakenCloud stack expertise->Big Data / Analytics- S3- Glue (ETL, Glue Catalog)- EMR (running Spark jobs)- Lambda and ECS (for running data processing jobs)- Redshift- Athena- Lake Formation- Quicksight- Kinesis (real-time analytics)- DynamoDB- RDS- DMS>Other/supplementary services- IAM- CloudWatch- Secrets Manager- Terraform for deployment- VPCs- EKS- API GatewayCertifications-AWS Certified Data EngineerDatabricks Certified Data EngineerMisc interests-Web Development, Web Scraping, Cognitive Automation, Home-labbingI love architecting and building highly available, performant and scalable distributed systems. Industry experience with data modelling, data warehousing, and building ETL pipeline solutions. Built high activity server-side scalable APIs and backend processes. Spearheaded design and development of multiple data curation and consolidation platforms. WIP portfolio: s••••••••@gmail.com
Experience
Lead Data Engineer
May 2025 — Present · Houston, TX, US
Education
Rajarshi Shahu Mahavidyalaya
Higher secondary certification
2006 — 2008
Kripa Sadan High School
Matriculation
1996 — 2006
Texas A&M University
Master's degree, Management Information Systems
2015 — 2017
COEP Technological University
Bachelor of Technology (B.Tech.), Electrical, Electronics and Communications Engineering
2008 — 2012
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.