Shafay A.
Lead Data Engineer @Orion S.A.
Signup · Get unlimited contacts
WORK HISTORY
Lead Data Engineer @Orion S.A.
Berlin, DE
Built a scalable data platform using AWS, Serverless, Snowflake, and AWS Specific tools such as Lambda, Glue, S3, LakeFormation, Data Zones, enabling centralizedanalytics for manufacturing, operations, and finance teams.Led design and orchestration of end-to-end data pipelines with DBT and Airflow, including metadatadrivenarchitecture for data governance and lifecycle management.Collaborated cross-functionally with data scientists, analysts, and engineering teams to align datainfrastructure with business priorities and compliance standards.Enabled ML & GenAI initiatives by integrating Amazon Bedrock, LangChain, and Streamlit to deploy LLMpoweredAI agents and Q&A chatbots for internal automation.Optimized analytics use cases across supply chain and production workflows, directly contributing toincreased revenue through improved real-time insights.Key Tech: AWS (Lambda, Redshift, Glue, ECS, EKS, Bedrock, Q Business), Python, SQL, DBT, Terraform,Kubernetes, Airflow, Streamlit, HuggingFace, Diffusion Models.
EDUCATION
Government College University (GCU), Lahore
Bachelor's degree, Computer Science (hons)
Fazaia Inter College (FIC)
High School Diploma, Computer Science
Fauji foundation College Jhelum cantt
Foundation degree, Pre-Enginerring
Concordia University
Master's degree, Computer Science
ABOUT SHAFAY A.
I bring in the following certifications: DataBricks GenAi FundamentalsHashiCorp Certified Terraform Associate Airflow Certified /DAGAUTH GCP Cloud Engineer and Data Engineer Certificate (ACG)HashiCorp Infrastructure AutomationCertification AWS Certified Data Engineer AssociateAWS Certified Machine Learning SpecialistAWS Certified Machine Learning AssociateAWS Certified Solution Architect AWS Certified Cloud PractitionerSpecialization in Statistics and Deep Learning & Specialization in Python and Ex. Data Science(2016)I have extensive experience in leveraging a wide range of cloud and data-related services across Amazon Web Services (AWS) and Google Cloud Platform (GCP), alongside proficiency in infrastructure and data orchestration tools. On AWS, I am skilled in using Amazon EC2, S3, EBS, RDS, DynamoDB, and Redshift. My expertise includes machine learning with SageMaker, analytics with Athena, QuickSight, and EMR, as well as data warehousing with Redshift. I ensure robust security using IAM, KMS, and GuardDuty, and have experience with AWS Lambda, VPC, CloudFormation, Amazon Q for natural language querying, and Amazon Bedrock for generative AI applications.On GCP, I have significant experience with Compute Engine, Cloud Storage, Persistent Disk, Cloud SQL, Firestore, and BigQuery. I utilize AI Platform for machine learning and Dataflow and Dataproc for analytics. My security management skills include Cloud IAM, KMS, and Security Command Center.Additionally, I am proficient in using Terraform for infrastructure as code across both AWS and GCP, enabling automated and consistent infrastructure deployment. I have experience with Apache Airflow for orchestrating complex data workflows, DBT (Data Build Tool) for transforming data within data warehouses, and Fivetran for automated data integration. These skills enable me to effectively architect, deploy, and manage comprehensive cloud and data solutions.Cloud: AWS, GCPTools: Airflow, BigQuery, Cloud Function, AWS Lambda, AWS RedshiftMicrosoft, PowerBi, SAP, dbtLanguages: python, SQL
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.