Modern Data Pipeline Implementation with PaasupDIP: Subway User Statistics Analysis Project #2
Subway data pipeline automation project transitioning from Jupyter Notebook development environment to Airflow production environment. Implemented enhanced security using Kubernetes Secret and workflow construction based on scheduling through SparkKubernetesOperator.