FOSS4GNA 2023 | EAGLE ITM Open Source Utility Outage Data Collect and Analysis - Aaron Myers

Aaron Myers, the group lead at GE Informatics Engineering Group, discusses the EAGLE ITM Open Source Utility Outage Data Collect and Analysis platform in this presentation. EAGLE Eye is the Department of Energy's operational platform for situational awareness of utility outages, covering about 93% of the US and territories. The platform transitioned from commercial off-the-shelf to open source, employing Docker, Java, Spring Boot, and Apache Airflow for scalability. The data collection process involves scraping 450 utility outage maps every 15 minutes, and the platform aims to enhance data collection efficiency using Apache Airflow.

Highlights

🌐 EAGLE Eye: DOE's platform for utility outage situational awareness, covering 93% of the US.

🔄 Transition: Shift from commercial off-the-shelf to open source for sustainability and modernization.

🖥️ Technology Stack: Docker, Java, Spring Boot, and Apache Airflow for scalable and efficient operations.

📊 Data Collection: Scraping 450 utility outage maps every 15 minutes for real-time updates.

🌐 Scalability: Introduction of Apache Airflow to orchestrate data collection and enhance scalability.

📈 Milestones: Achievements include a historic archive of outage data and modeling county customers.

⚖️ Energy Justice: Utilizing data trends to evaluate energy justice and identify deviations in utility behaviors.