Tejas Patil

About Tejas Patil

Enthusiastic Big Data Engineer | PySpark Developer | 5+ Years of Expertise in Delivering Scalable Big Data SolutionsWith 4 years of experience specializing in PySpark, Spark SQL, Hadoop, HDFS, Hive, and AWS, I am passionate about leveraging Big Data technologies to solve complex business problems. My focus is on Data Ingestion, Transformation, Quality Assurance, and Integration, processing large-scale datasets in production environments to deliver high-performance solutions. Key Skills & Expertise:• PySpark Development: Strong in developing and optimizing PySpark scripts, implementing complex business rules using Spark SQL and Dataframe APIs for high scalability.• Hadoop Ecosystem: Deep knowledge of HDFS, Hive, YARN, and cluster management, ensuring efficient resource utilization and reducing job runtimes.• AWS Integration: Extensive experience in handling large datasets on AWS, working with S3 and data services, and implementing ETL processes from S3 into Hadoop.• Performance Optimization: Expertise in analyzing job executions via Hadoop History Server, optimizing Spark jobs, and ensuring efficient resource use.• CI/CD Deployment: Proficient in Jenkins for CI/CD pipeline management, code migration, and job scheduling using tools like AutoSys to automate workflows.• Data Quality & Compliance: Hands-on experience in implementing audit layers and validating data integrity through PySpark, ensuring high-quality outputs.• SQL Mastery: Skilled in HiveQL, Spark SQL, and MySQL, with a focus on query optimization using techniques like partitioning, bucketing, and caching.Additional Expertise:• Cluster Management: Skilled in Hadoop cluster configuration and monitoring, ensuring high availability and resolving performance bottlenecks.• Version Control & Testing: Experience with Bitbucket for version control and Jenkins for smooth code deployment, ensuring high production efficiency.• Diverse Data Handling: Proficient in working with structured and semi-structured data (JSON, XML, Avro, Parquet), and streaming data.• Industry Knowledge: Domain expertise across BFSI, Retail, Telecommunications, and Data Operations.I\'m passionate about continuous improvement and innovation in the Big Data space. Whether it\'s streamlining processes, reducing operational costs, or optimizing system performance, I am always driven to deliver robust and scalable solutions. Let’s connect and discuss how I can help drive your data initiatives forward.

Experience

1. Application Analyst - Officer

   Citi

   Nov 2025 — Present · Chennai, IN

Education

• Bharati Vidyapeeth College of Engineering, Navi Mumbai

  Bachelor of Engineering - BE, Electronics and Telecommunications