Miguel Amaral
Data Engineer @Bioscript Group
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Bioscript Group
Macclesfield, GB
EDUCATION
Instituto Nacional de Pesquisas Espaciais
Post doctoral, Simulation of the Electromagnetic Properties for Radiation Absorbing Material
Instituto Nacional de Pesquisas Espaciais (INPE)
Master's Degree in Materials Engineering , Materiais
Instituto Nacional de Pesquisas Espaciais
PhD in Materials Engineering , Carbonaceous Materials and Radiation Absorbing Materials
Universidade de Taubaté
Degree in Physics, Física
ABOUT MIGUEL AMARAL
I am a Linux/Ubuntu user with over 15 years of experience in Python, specializing in data engineering, analysis, and cloud operations, particularly with AWS. My expertise includes building and optimizing data pipelines, ETL/ELT processes, and predictive modeling. I also excel in container orchestration, microservices, and API management, along with system integration, web scraping, and semantic search. My background includes generating insights and building scalable, reliable solutions, implementing AI-driven systems, creating dashboards, and automating tasks to support robust cloud-based environments.PROGRAMMING LANGUAGE- Python (15y exp)- Bash Script- JSCLOUD & INFRASTRUCTURE- Mongo Atlas (NoSQL)- Supabase (SQL)- AWS services- EC2 / Elastic IP / Route 53 - Bucket S3 - Athenas (SQL) - CloudWatch Events - RDS (SQL) - DynamoDB( NoSQL) - Lambda - Glue (ETL) - Boto3 (python library to connect to other services) - Redshit (data warehouse)IMAGE CLASSIFIER- Tensorflow/Keras (Transfer Learning)SEARCH & INFORMATION RETRIEVAL- Vector Search (Semantic Search)- Free Text search (Lexical Search)- Full text search with auto-complete (Flask + Elastic Search)- RAG Pipeline: Retriever-augmented generationCONTAINER ORCHESTRATION- Kubernetes- Rancher- LensDEVELOPMENT ENVIRONMENT- VSCode- Linux (Ubuntu)- Windows + WSL2WEB DEVELOPMENT- Flask- Django- Front-End Technologies: HTML, CSS, JavaScriptDATA ANALYSIS AND VISUALIZATION- numpy- pandas- matplotlib- Seaborn- plotly- Jupyter/JupyterHub- KibanasVERSION CONTROL - GitLab- GitHubMACHINE LEARNING & AI- scikit-learn- Tensorflow- OpenAI API (ChatGPT)- TransformersPARSING TEXT- Text Analysis: Regular expressions (re)- TransformersDATA ENGINEERING- Automation- Cron job- Docker/Docker Hub/Docker Compose- Kubernetes- Rancher- RabbitMQ- Nexus repository- Data management- testing- code versioningDATA PIPELINES- Apache Airflow- Dagster- Kedro- pipelines - ETLDATABASES (SQL & NoSQL)- PostgreSQL- MySQL- MongoDB- ChromaDB (vector DB)- Elastic Search (vector search and free text search)WEB SCRAPING- Scrapy- BeautifulSoup (bs4)- Selenium- Request SYSTEMS INTEGRATION & APIs- API Development: Flask, Django- RabbitMQ- IntegrationCONTINUOUS INTEGRATION / DEPLOYMENT- GitLab & GitHub (CI/CD)VISUALIZATION TOOLS- Lens (Kubernetes)- Lucid ChartREPOSITORY MANAGEMENT- Nexus repository
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.