Engineering

Data Engineering

Production-grade data pipelines, cloud warehouses, and healthcare data standardization built on Databricks, AWS, and Snowflake.

Data Engineering · Abacus Insights

Healthcare Data Standardization

Large-scale batch pipelines on Databricks + AWS to standardize US healthcare datasets across multiple payers using Medallion architecture with Delta Lake and Snowflake.

500K+claims processed daily

85%reduction in data quality issues

3-tierMedallion (Bronze/Silver/Gold)

DatabricksAWSDelta LakeMedallion ArchitectureSnowflake+5 more

View Project

Data Warehouse · Cedar Gate Technologies

Enterprise Data Warehouse

AWS Redshift DW storing 10M+ healthcare records annually. Improved query performance by 30% and reduced reporting delays by 70% through distribution key design, materialised views, and automated Glue/Airflow pipelines.

10M+records stored annually

30%query performance improvement

70%reduction in reporting delays

AWS RedshiftAWS GlueApache AirflowEventBridgeETL+3 more

View Project

More projects coming soon