Completed
Insider Alpha
Real-time Insider Trading Analytics & Visualization
System Architecture Visual
Project Overview
A unified platform for tracking and analyzing insider trading activities. It provides deep insights into corporate insider moves, synchronized filtering across data views, and robust data orchestration.
Methodology & Architecture
1. Data Extraction & Loading
Using Meltano to orchestrate SEC and financial data ingestion into the warehouse.
2. Transformation
Applying dbt models for complex data modeling, role classification, and unified filtering.
3. Orchestration & API
Dagster-orchestrated pipelines surfacing insights through a high-performance FastAPI backend.
4. Visualization
Building a responsive Next.js dashboard for real-time monitoring and analytics.
Technologies Used
Meltano
dbt
Dagster
FastAPI
Next.js
Key Learnings
- Managing complex data pipelines with Dagster.
- Optimizing BigQuery for large financial datasets.
- Designing synchronized filtering systems for multi-view analytics.