Skip to content
View ayanhussain81's full-sized avatar

Block or report ayanhussain81

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ayanhussain81/README.md

πŸ‘‹ Hi, I'm Ayan Hussain

Data Engineer Β· AWS Community Builder Β· Mentor Β· Published Researcher

LinkedIn GitHub Twitter Email


πŸ§‘β€πŸ’» About Me

Data Engineer with 5 years of experience building high-scale, production-grade data solutions across pharma, healthcare, and finance. I specialize in designing ETL/ELT pipelines that process 1.5B+ files, architecting streaming systems, and enabling enterprise-grade analytics platforms.

Beyond engineering, I actively give back to the community β€” recognized as an AWS Community Builder, having mentored 500+ data engineering students, and serving as Technical Head of the AI Club at NEDUET. I'm also a published researcher in machine learning.

🏭  Industries     β†’  Pharmaceuticals Β· Healthcare Β· Finance Β· Capital Markets
☁️  Cloud          β†’  AWS (primary) Β· Azure
⚑  Specialties    β†’  Streaming Pipelines Β· Data Warehousing Β· CDC Β· IaC Β· ELT
πŸŽ“  Community      β†’  AWS Community Builder Β· 500+ Students Mentored

πŸ’Ό Professional Experience

Role Company Industry Period
Data Engineer Norstella Pharma & Healthcare Apr 2025 – Present
Data Engineer OfficeField Finance & Capital Markets Aug 2024 – Apr 2025
Data Engineer Speedylancer Data Extraction & Automation Sep 2022 – Jul 2024
Data Analyst Dolphin Analytics Stock Market Analytics Mar 2021 – Aug 2022

πŸ“Œ Full experience details on LinkedIn β†’


πŸ› οΈ Technical Skills

Languages & Query

Python SQL Shell

Data Engineering & Streaming

Apache Kafka Apache Airflow dbt Debezium PySpark

Cloud β€” AWS

AWS S3 Lambda Glue EC2 SageMaker

Redshift DynamoDB SQS SNS Step Functions ECR API Gateway

Cloud β€” Azure

Azure Databricks Azure Data Factory Synapse Analytics Azure Event Hubs Azure Data Lake

ADLS Gen2 Delta Lake Azure Stream Analytics Azure SQL

Data Warehousing & Databases

Snowflake PostgreSQL MongoDB

Infrastructure & DevOps

Terraform Docker Git Linux

BI & Visualization

Power BI Tableau


πŸ—οΈ Featured Projects

πŸ”Ή Tradeverse β€” Real-Time Market Analytics Platform

Finance Β· Streaming Β· AI Integration

End-to-end real-time stock and cryptocurrency analysis platform built from scratch. Designed ETL and streaming pipelines using Kafka and Airflow, and collaborated with AI teams to integrate ML models into live data flows for predictive analytics and market signals.

Kafka Airflow Snowflake Python AWS AI Integration


πŸ”Ή RealT β€” Scalable Customer Data Warehouse

Healthcare/Finance Β· Snowflake Β· AWS Glue Β· Snowpipe

Designed and implemented a production-grade Snowflake data warehouse transforming raw customer data into analytics-ready datasets with high query performance.

  • Ingested raw data into Amazon S3, transformed with AWS Glue PySpark
  • Automated real-time ingestion with Snowflake Snowpipe + AWS Lambda triggers
  • Delivered a fully centralized customer analytics layer

Snowflake AWS S3 AWS Glue PySpark Snowpipe AWS Lambda


πŸ”Ή AIverse β€” AI Model Marketplace

Cloud Β· SageMaker Β· Docker Β· API Gateway

End-to-end marketplace connecting AI model creators with users. Managed the full lifecycle from ideation to deployment.

  • Containerized ML model images and deployed on AWS SageMaker via Amazon ECR
  • Exposed models through AWS API Gateway + Lambda for seamless API-based access
  • Enabled scalable model deployment and monetization for AI creators

AWS SageMaker ECR Docker API Gateway Lambda Python


πŸ”Ή Netflix ELT Pipeline β€” dbt + Snowflake + AWS

Open Source Β· ELT Β· dbt Β· Terraform

End-to-end ELT stack loading Netflix titles and credits datasets into Snowflake via S3, then transforming with dbt. Full AWS infrastructure provisioned with Terraform.

  • Local CSV β†’ S3 β†’ Snowflake External Stage β†’ COPY INTO raw tables β†’ dbt models
  • 4-layer architecture: RAW β†’ STAGING β†’ INTERMEDIATE β†’ MARTS

dbt Snowflake AWS S3 Terraform Python


πŸ”Ή Olympics Data Analysis

Analytics Β· AWS Glue Β· Snowflake Β· BI

Orchestrated ETL workflows using AWS Glue and Snowflake to power advanced Olympic sports analytics. Delivered actionable insights that improved BI team decision-making by 40%.

AWS Glue Snowflake SQL Power BI


🏭 Industries

Industry Experience
Pharmaceuticals Clinical trial data pipelines, drug assessment master data, DAF frameworks at Norstella
Healthcare Medical report extraction, healthcare analytics, SCD Type 4 audit lineage
Finance & Capital Markets U.S. equities & crypto pipelines, OMS, real-time trade data at OfficeField
Market Intelligence News classification, financial intelligence data ingestion at Norstella

🌐 Community & Leadership

  • ☁️ AWS Community Builder β€” Recognized by Amazon Web Services for community contributions in cloud and data engineering
  • πŸ‘¨β€πŸ« Mentor to 500+ Students β€” Guided data engineering learners across courses, workshops, and 1:1 mentoring
  • πŸ€– Technical Head β€” Artificial Intelligence Club, NEDUET
  • πŸ‘₯ Member β€” AWS User Group Karachi

πŸ“š Certifications

Certificate Issuer Status
AWS Certified Cloud Practitioner Amazon Web Services βœ… Certified β€” Oct 2025
AWS Data Engineering Master Class Udemy βœ… Certified Dec 2024
Google Data Analytics Professional Certificate Coursera βœ… Certified June 2024
Certified Power BI & Tableau Data Analyst DataCamp βœ… Nov 2022

πŸ“– Research & Publications

"XGBoost and Random Forest Algorithms: An In-Depth Analysis"
Published in the Pakistan Journal of Scientific Research (PJOSR)
β†’ Read the Paper


πŸ† Achievements

  • πŸ₯ˆ Runner-Up β€” Envision'22 Data Science Competition, NEDUET (50+ participants)
  • πŸ₯‡ Provincial Winner β€” National Idea Bank 2023 (2,200+ applicants nationwide)
  • 🎀 Best Presenter β€” APICEE'23 (Presented to 10+ industry experts & academics)

"Turning raw data into powerful decisions β€” one pipeline at a time."

Pinned Loading

  1. snowflake-weather-warehouse snowflake-weather-warehouse Public

    Shell 1 4

  2. Automating-S3-to-Lambda-Triggers Automating-S3-to-Lambda-Triggers Public

    Step-by-Step Guide to Deploying and Optimizing Your First Lambda Function

    Python 2

  3. snowflake-data-ingestion snowflake-data-ingestion Public

    Examples of different ways to load data into Snowflake β€” using Web UI, SnowSQL CLI, S3 external stages, Storage Integrations, Snowpipe, and Time Travel.

    1 5

  4. Olympics-Data-ETL Olympics-Data-ETL Public

    Tokyo Olympic Azure Data Engineering Project

    Jupyter Notebook 1

  5. t20_score_predictor t20_score_predictor Public

    A XgBoost based Cricket Score Predictor

    Python 1

  6. Final-Year-Project-AIverse Final-Year-Project-AIverse Public

    JavaScript 1