Taj J.

About Taj J.

Lead Data Engineer with 10 years of experience building production data pipelines and analytics solutions. Currently holding an active TS/SCI clearance and AWS Solutions Architect Associate certification.Technical Expertise:• Data Engineering: Databricks, PySpark, Python, SQL, ETL/ELT pipelines, data lakehouse infrastructure, medallion architecture• Cloud & Infrastructure: AWS S3, StreamSets, Apache Spark• Databases: SQL Server, Oracle, PostgreSQL, T-SQL, PL/SQL, query optimization• Tools & Platforms: SSIS, SSRS, Tableau, Qlik Sense, Git, Agile/Scrum, JIRARecent Impact:• Led a team of 5 data engineers and developed 35+ production ELT pipelines in Databricks, implementing modern data lakehouse architecture with bronze/silver/gold layers• Designed modular, reusable pipeline frameworks reducing development time by 60% and ensuring consistent data quality patterns• Improved data reliability by implementing comprehensive quality checks, reducing duplicates by ~25%I specialize in transforming complex data from multiple sources (REST/SOAP APIs, nested JSON, fixed-width files, CSV) into analytics-ready datasets that enable data-driven decision-making.Clearance: Active TS/SCI (2023)Certifications: AWS Solutions Architect Associate (Valid through 10/2028)Feel free to reach out to T••••••••@gmail.com or here on LinkedIn.

Experience

1. Lead Data Engineer

   Booz Allen Hamilton

   Oct 2023 — Present · Crystal City, VA, US

   Modernized a legacy pipeline for Air Force financial reports by migrating Python-based transformations to PySpark SQL, implementing page-level parallelization and optimizing Apache Spark partition strategy and job cluster configuration—reducing processing time from 35 hours to under 5 minutes (420x improvement)• Designed Spark Structured Streaming pipeline with stateful deduplication and watermarking strategy to replace legacy batch processing, implementing file-level deduplication logic that unlocked 60M+ previously unprocessed records and eliminated future duplicate ingestion• Led technical direction for 5-engineer team supporting combatant command analytics, driving architecture decisions, code reviews, and cross-functional delivery with data scientists and business stakeholders• Delivered 30+ production Databricks pipelines (Python/PySpark/SQL) implementing ELT workflows within lakehouse medallion architecture (Bronze-to-Silver) with Delta Lake for DoD analytics

Education

• University of Maryland Global Campus

  Bachelor of Science - BS, Information Systems Management

  2018 — 2020

• Montgomery College

  Associate of Arts (A.A.), Information Systems

  2015 — 2017

• Northern Virginia Community College

  Business Information Technology Certificate, Information Technology

  2014 — 2015

Skills

• Customer Service
• Public Speaking
• Microsoft Office
• Access
• Cascading Style Sheets (Css)
• Microsoft Excel
• Html
• Joomla
• Team Leadership
• Javascript
• Networking
• Teamwork
• Sql
• Social Media
• Sql Server Integration Services (Ssis)
• Microsoft Access
• Research
• Transact-Sql (T-Sql)
• Css
• Leadership
• Microsoft Sql Server
• Cms
• Web Development
• Sql Server Management Studio