Data Sources & Refresh Frequencies

Comprehensive overview of all data sources powering FloodWatch LK

46+
Total Data Sources
40+
API Endpoints
85-90%
Cache Hit Rate
5 min
Fastest Refresh

🌤️Weather & Climate Data

SourceCache/RefreshDescription
Backend API - All Weather30 minutesWeather data for all districts
Backend API - Forecasts30 minutes7-day forecast for all districts
OpenWeatherMap One Call API 3.030 minutesEarly warning system with hourly/daily forecasts
Frontend Refresh Intervals:
  • Dashboard: No auto-refresh (backend cache: 60 min)
  • Early Warning Page: 30 minutes
  • Flood Info Page: 30 minutes
  • Rivers Page: 5 minutes

🌊River & Flood Monitoring

SourceCache/RefreshDescription
SL Irrigation Department5 minutesRiver water levels (18 rivers, 100+ stations)
Navy Flood Monitoring System5 minutesReal-time river levels and flood alerts
RiverNet.lkManual linkLive river levels portal - External link
ArcGIS DashboardManual linkInteractive river monitoring dashboard - External link
Backend Irrigation API5 minutesProcessed river data with flood thresholds and alerts
Backend Flood Threat API5 minutesNational flood threat assessment and district analysis

📰News Sources

All news sources cached for 30 minutes with rate limiting (max 1 request per 30 min per source)

Local Sources

  • 🇱🇰SL Met Department
  • 🇱🇰NewsFirst.lk
  • 🇱🇰Newswire.lk

International Weather

  • 🇮🇳India Meteorological Dept (IMD)
  • 🌍BBC Weather
  • 🌍GDACS (Global Disaster Alert)
  • 🌍ReliefWeb

Disaster & Emergency News

  • 🏥WHO (World Health Organization)
  • 🇺🇳UN News
  • 🌍Al Jazeera
  • 🇺🇸U.S. Embassy Sri Lanka
11
Total News Sources

🌬️Wind Data

SourceUpdate FrequencyDescription
ICON (DWD Germany)Every 6 hoursWeather model - Forecast up to 78 hours
GFS (NOAA USA)Every 6 hoursWeather model - Forecast up to 384 hours (16 days)
ERA5 (ECMWF)DailyReanalysis model - Historical data (~5 day lag)
OpenWeatherReal-timeCurrent wind conditions only

🚨Intelligence & Alerts

SourceCache DurationDescription
SOS Reports (Internal DB)5 minutesEmergency SOS reports with priority analysis - Auto-refresh ✅
Emergency Facilities (OpenStreetMap)24 hoursHospitals, police, fire stations, shelters - Daily refresh ✅
Weather Alerts (WeatherAPI.com)15 minutesOfficial weather warnings and alerts - Auto-refresh ✅
Marine Conditions (Open-Meteo)30 minutesWave heights, sea temperatures, marine forecasts - Auto-refresh ✅
Traffic Incidents (TomTom)5 minutesRoad closures, accidents, flooding incidents - Auto-refresh ✅
Traffic Flow (HERE & TomTom)5 minutesReal-time traffic congestion and flow data - Auto-refresh ✅

📍Emergency Services

🏥
1,500+
Hospitals
👮
400+
Police Stations
🚒
100+
Fire Stations
🏠
200+
Shelters
Source: OpenStreetMap • Cache: 24 hours

Data Refresh Frequencies Summary

⚡ 5 minutes
  • • River levels
  • • Traffic incidents
  • • SOS reports
  • • Irrigation data
🔄 15 minutes
  • • Weather alerts
⏱️ 30 minutes
  • • Weather data
  • • News feeds
  • • Marine conditions
  • • Early warnings
🕐 6 hours
  • • ICON wind model
  • • GFS wind model
📅 24 hours
  • • Emergency facilities
  • • Intel dashboard
🗓️ Daily/Weekly
  • • ERA5 wind data
  • • Environmental data

📈Performance Optimization

120-150
API calls per hour (with caching)
1,000+
Without caching (avoided)
85-90%
Cache hit rate
200-500ms
Average response time

🔑API Keys Required

✅ OpenWeatherMap One Call API 3.0
✅ WeatherAPI.com
✅ TomTom Traffic API
✅ HERE Traffic API
✅ ECMWF ERA5 (CDS_API_KEY)
✅ Open-Meteo (no key required)