PAASUP IDEAS

PAASUP IDEAS는 데이터 인텔리전스 기술과 트렌드, 실험 결과, 그리고 PAASUP DIP 활용 사례를 공유하는 기술 블로그입니다. 데이터 전문가들의 인사이트와 최신 정보를 만나보세요.

english

Modern Data Pipeline Implementation with Paasup DIP #4: Framework Application and ELT Monitoring Dashboard

Introduction In the previous posts of the PaasUp DIP modern data pipeline series (#1~3), we implemented data pipelines purely using open-source libraries (pyspark, delta-spark, boto3, etc.) without any framework. This was a crucial learning process for understanding basic principles and direct implementation. However, in actual production environments, framework adoption
9 min read