Sk Adnan Ali
Senior Data Engineer |LWD April | Spark (Scala & PySpark) | Hadoop | Hive | Cloudera | Big Data | Banking Domain | 4+ Years |
- Role
- System Engineer at Tata Consultancy Services
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About Sk Adnan Ali
Big Data Engineer with 4+ years of experience designing and delivering scalable, secure, and high-performance data solutions across banking and healthcare domains.Currently working with Tata Consultancy Services (TCS), supporting enterprise data platforms for global clients including Reserve Bank of India (RBI), Canadian Imperial Bank of Commerce (CIBC), and Walgreens Boots Alliance (WBA).Strong hands-on expertise in the Hadoop ecosystem, including Apache Spark (Scala & PySpark), Hive, Impala, Sqoop, and Cloudera administration. Experienced in building scalable ETL pipelines, optimizing large-scale data processing workloads, and managing distributed data platforms.Skilled across the full Software Development Life Cycle (SDLC), including development, testing, deployment, production support, performance tuning, and platform operations. Adept at solving complex data engineering challenges and delivering reliable solutions in highly regulated enterprise environments.Technical Skills: Apache Spark, Scala, PySpark, Hadoop, Hive, Impala, HDFS, Sqoop, HBase, Cloudera, SQL, ETL Development, Autosys, Control-M, Unix/Linux.Currently serving my notice period and open to Senior Data Engineer / Big Data Engineer opportunities.
Experience
System Engineer
Nov 2021 — Present · Bhubaneswar, IN
As a Data Engineer at the \"Big Five\" Bank of Canada, responsible for managing and optimizing data pipelines, ensuring data quality and reliability, and facilitating data usage for analytics. Key responsibilities include:Big Data Platform Management:Oversee infrastructure and operations of the Big Data platform, ensuring scalability, reliability, and security.Data Pipeline Development:Design and implement data pipelines for ingesting, processing, and transformingdata from diverse sources.Tool and Technology Utilization:Utilize SQL/HQL, Hadoop, Python, and Bash for automating data processing, optimizing storage, and implementing data quality checks.Cloud Migration:Lead migration of ETL data ingestion to Azure Cloud, ensuring smooth transition and minimal disruption.Team Leadership and Mentorship:Mentor and onboard new team members, providing guidance on best practices and fostering a collaborative work environment. In summary, this role requires technical leadership skills, and the ability to collaborate effectively across teams to drive impactful data initiatives.
Education
Biju Patnaik University of Technology, Odisha
Bachelor of Technology - BTech, Computer Software Engineering
Shanti Institute of Management & Studies - India
12th, Junior High/Intermediate/Middle School Education and Teaching
2015 — 2017
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.