Arun Nair
Data Engineer - Aws-databricks @Capital Group
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer - Aws-databricks @Capital Group
London, GB
Data modelling, ETL pipeline design and development.
EDUCATION
NIIT, Bangaloore, India. (Bachelor degree in computer application development)
3 years, IT
Mahatma Gandhi University
B-com, Finance and Accounting practices
SKILLS
ABOUT ARUN NAIR
AWS Data Engineer (Contract only).A Technology-driven professional with around 20+ years of experience extensively in Data gathering, modeling, analysis, validation, and architecture/solution design to build next-generation analytics platforms with optimized solutions. I have worked in various applications using Data Collection/transformation/Analysis, batch, and real-time data processing.Security clearance status: SC level Security Cleared from Home Office (not active)Cloud & Big Data Technologies (AWS & Distributed Systems)Amazon Web Services (AWS): Glue, Athena, Lambda, Step Functions, S3, RDS, MSK, CloudWatch, KMS, SNS, SQS, Security Manager, CloudFormation, TerraformBig Data & Streaming: Databricks, Hadoop, Kafka (MSK & Confluent), Spark/PySpark, Storm, Samza, HBase, HDFS, Graph, Nifi, AirflowETL & Data Pipelines: DBT (Data Build Tool), AWS Glue, Airflow, Snowflake ETL Pipelines, Data CrawlersData Modeling & Transformation: Expertise in dimensional modeling, star schema, and Snowflake architecture for optimised analytics solutionsProgramming & ScriptingLanguages: Python, Spark/PySpark, JavaDatabases & Storage SystemsRelational Databases: Amazon RDS, PostgreSQL, MySQL, Oracle, PrestoDB, AthenaNoSQL Databases: CockroachDB (Cloud-native), JanusGraph (GraphDB), DynamoDB, HBaseWorkflow & Orchestration ToolsScheduling & Orchestration: Apache Airflow, Glue Workflow, Apache Nifi, OoziePlatform & InfrastructureCloud & Containerization: Amazon Web Services (AWS), Kubernetes, Docker, Cloudera (CDH), Hortonworks (HDP)Infrastructure as Code (IaC): Terraform, CloudFormation, HelmCI/CD & DevOpsBuild & Deployment Tools: Maven, Make, Helm, Jenkins, Git, GitHub Workflows, ArgoCD, CodeBuild Pipelines, GradleAgile & Software Development MethodologiesFrameworks & Best Practices: Agile (Scrum, Kanban, XP, TDD), Spring, Spring Integration FrameworkWith over 5+ years of experience in designing, building, and maintaining big data solutions in AWS10+ Years of experience work experience in Big Data or distributed computing applications.10+ Years of experience in Designing and implementing Big Data. Data Ingestion Application & real-time data processing.20+ years of experience End to End Application Development.Experienced in Java, J2EE Extensive knowledge in ETL - Data Collection, Data Modelling & Transformation, and Data Analysis.Cloud platform - AWSHands-on Experience in various Databases and management tools.Effective in working independently and collaboratively in teams.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.