ABOUT ME / ENGINEERING & LEADERSHIP

I build the systems.
And grow the teams.

I’m Edward Goo, an AI data engineering leader with a software engineering background. I build data organizations and turn fragmented data into structured, centralized foundations for applications, workflows, and AI agents.

5 → 50+Engineers in the organization I built and scaled
50%+Compute cost reduction through architecture improvements I drove
Petabyte scaleData processing supported by a unified platform I co-led

WHAT I’VE BUILT

RAG and retrieval systems

Production RAG, vectorization, and retrieval workflows that give AI agents the right context.

Master data management

A company-wide master database and reference data foundation for enterprise use cases.

Applied AI workflows

Entity extraction and agentic workflows that tag and classify transaction data at scale.

Central data platform

Shared infrastructure, ingestion frameworks, and processing for the whole organization.

Lakehouse architecture

Data delivery on open table formats, using Delta UniForm with Iceberg compatibility and Snowflake.

Governance and reliability

PII masking, secure data operations, and disaster recovery, built with security teams.

HOW I CONTRIBUTE

Technical depth.
Organizational reach.

From architecture to implementation.

I design and build the infrastructure behind data-intensive products: ingestion frameworks, distributed pipelines, reference data systems, and retrieval workflows.

  • Architected and implemented a company-wide master database and reference data initiative.
  • Built production entity-extraction, vectorization, and retrieval workflows for tagging and classification.
  • Engineered backend acquisition systems and cloud infrastructure using Python and AWS.

Teams that can build beyond me.

I pair technical ownership with the organizational work needed to make shared systems useful, maintainable, and widely adopted.

  • Built and scaled a data engineering organization while staying involved in architecture and implementation.
  • Hired and managed six technical managers.
  • Co-led a central data platform initiative spanning shared infrastructure, ingestion, and processing.

EXPERIENCE AT A GLANCE

2023 — Present

Head of Data Engineering

Building data organizations, shared platforms, ETL and AI-powered workflows, and cross-functional technical direction.

2022 — 2023

Senior Engineering Manager, ETL

Batch and streaming platforms, pipeline reliability, cost optimization, and the infrastructure for analytics and AI.

2017 — 2022

Engineering Manager & Team Lead

Backend and full-stack systems, web data acquisition, queueing infrastructure, and cloud operations.

My career began in accounting and finance. That background still shapes how I connect engineering decisions to business outcomes.

TECHNICAL TOOLKIT

Data & distributed systems

Spark · Databricks · Snowflake · dbt · Airflow · SQL

Backend & infrastructure

Python · AWS · Docker · Django · Redis · SQS

AI & retrieval

RAG · Vector databases · Entity extraction · Indexing · Query serving

OUTSIDE THE DAY JOB

Still curious.
Still building.

Goo Labs is where I explore ideas independently, in my own time. My personal experiments and writing are separate from my employer’s work.

Read my blogs ↗

Looking for technical leadership with hands-on depth?

Let’s talk