The Performance of the National Weather Service Heat Warning System against Ground Observations and Satellite Imagery

Deadly heat waves are increasing with climate change. Public forecasts andwarnings are a primary public health strategy for dealing with such extreme weather events; however, temperatures can vary widely within the administrative units used to issue warnings, particularly across urban landscapes. The emergence of more frequent and widely distributed sources of urban temperature data provide the opportunity to investigate the specificity of the current NationalWeather Service (NWS) warnings and to improve their accuracy and precision. In this work, temperatures fromdistributed publicweather stations,NWSheat advisories andwarnings, and land surface temperature imagery throughout two large metropolitan areas, Atlanta and Chicago, during the 2006–2012 summers are considered. We investigate the spatial variability of hazardous temperatures and their agreement against NWS advisories. Second, we examine the potential for thermal imagery to replicate National Weather Service heat warnings. Observations from weather stations exhibit varying degrees of agreement with NWS advisories. The level of agreement varied by station and was not found to be associated with the station’s proximate land cover. Air temperatures estimated from satellite imagery correspond with NWS Advisory status regionally and may enable creating more refined public warnings regarding hazardous temperatures and protective actions


Introduction
The potential for future extreme heat events that pose danger to human health is increasing with global climate change.As Hansen and colleagues at NASA's Goddard Institute for Space Studies put it, we have been loading the climate dice for the last 30 years, increasing the likelihood of meteorological events that used to occur once ever hundred years [1].Models and recent historical records echo this sentiment with data and the recent news that atmospheric CO 2 concentrations passed 400 ppm for the first time in 3 million years imply that these trends are likely to continue.Early and accurate warnings are a crucial component for adapting to more frequent hazardous heat events.
The frequency, duration, areal coverage, and intensity of heat waves are expected to increase for most populated places because of global climate change [2,3].Such events have caused major episodic mortality, including an estimated 70,000 excess deaths in Europe in 2003 [4] and more than 55,000 in Russia during July and August of 2010 [5,6].Heat wave characteristics like intensity and seasonality are also changing in ways that increase their potential hazard to health [7].In many places, early warning systems are a key, if not the primary, component of measures for avoiding heat related deaths and illness.In the United States the National Weather Service (NWS) issues these warnings.In this work we are concerned with the spatial resolution and specificity of the issued warnings.The predictions for urban areas, in particular, could be improved given that cities are typically hotter than surrounding areas, concentrate people, and demonstrate great variability in temperatures and population vulnerabilities.
(a) Adaptation Strategies.The relationship between heat and health is well understood and known to change over time as well as with location and population characteristics [8].

Advances in Meteorology
Future changes in climate will increase adverse health impacts [9,10].Adapting to changes in extreme heat events has largely followed three strategies: identifying vulnerable populations, ensuring access to mechanical cooling (air conditioning), and implementing early warning systems [11,12].
Several studies using large population datasets and several summers of data demonstrate a positive relationship between temperatures and excess all-cause mortality on days that are abnormally warm compared to long-term summer weather for the region [13][14][15].Public warning systems for heat are targeted toward managing such events.Response activities for heat events have been institutionalized as part of relatively recent efforts in some cities, including Chicago, Milwaukee, and Philadelphia following deadly heat waves in the early and mid 1990s [16,17].
Deadly heat events have led to greater attention on individual and population level factors affecting heat vulnerability [18].These include age, social isolation, housing type, income, and ethnicity [19,20].Adaptive capacity of individuals is also a key determinant in whether and to what degree hazards of climate change will result in adverse health effects [21].Understanding vulnerabilities to heat has led to efforts such as censuses of susceptible populations and doorto-door visits during heat events that have been shown to successfully reduce the related excess mortality [17,22].These approaches tend to be expensive to implement and rely on significant human resources for scaling up.
The most effective protection against hyperthermia in extreme weather is air conditioning (AC).The increased prevalence of this technology is one reason for declining heat-related mortality in the US despite increasing frequency of heat events [23].However, reliance on energy-intensive adaptation strategies like AC results in greater energy use and the production of waste heat.Thus such adaptation measures produce positive feedbacks on global climate change and can exacerbate the urban heat island effect [24].
The general public are familiar with warning systems for weather-related hazards including floods, tornados, winds, and severe storms.As an adaptation strategy, warnings are important for quickly reaching large numbers of people at low cost and providing targeted messaging that can help minimize damages.Heat warning systems have been shown to save lives during extreme heat [16], but heat waves have received less attention than other natural disasters, in part, due to the fact that there is less aftermath (particularly property damage).Even when the public is aware of warnings and climatic conditions, there is often far less awareness of what protective actions should be taken [25].
(b) The National Weather Service Warnings.Currently the NWS uses four products based on the heat index (HI), a metric combining temperature and relative humidity to describe heat stress and discomfort, to issue hazard notifications.Heat index values are forecast for three to seven days out and are based on an ensemble of model and human forecasts.Day three forecasts are based on gridded model output statistics (MOS) temperature and dew point temperature forecasts.Forecasts on days four through seven rely on minimum and maximum 24-hour temperatures and dew points at 00 and 12 UTC supplied by the Weather Prediction Center's (WPC) 5km resolution grid data products.Probabilities for heat index values exceeding thresholds are also provided in the form of color filled displays.Probabilities are informed by uncertainty information from an ensemble of modeled forecasts and follow a normal distribution around mean MOS or WPC values assessed on a regular 20-km resolution grid [26].
The NWS produces criteria for extreme weather and potentially hazardous conditions.
Excessive Heat Outlook may be issued 3 to 7 days prior to a heat episode requiring issuance of a heat warning, provided forecaster confidence is relatively high.
Excessive Heat Watch may be issued 12 to 48 hours prior to heat episode with a 50 percent chance or greater of daytime heat indices equal to or greater than 110 ∘ F for at least two consecutive days.
Heat Advisory is issued in the first and/or second period when there is an 80 percent chance or greater of daytime heat indices equal to or greater than 105 ∘ F (40.6 ∘ C) for at least two consecutive days.
Excessive Heat Warning is issued in the first and/or second period when there is an 80 percent or greater of daytime heat indices equal to or greater than 110 ∘ F (43.3 ∘ C) for at least two consecutive days.
These criteria can be modified for specific regions and cities as the local offices see fit.For example, the city of Chicago uses additional criteria related to nighttime low temperatures to trigger advisories.
The NWS's advisory guidelines are, by default, applied uniformly for different places across the country.In this respect they have not been representative of regional adaptation behaviors and practices.This leads to warnings and advisories in some areas that may be issued too frequently or not frequently enough and that misrepresent actual weatherrelated risks for people.In both cases the issuances may lead to skepticism and neglect for the NWS notifications and decrease their effectiveness.In recent years some areas, like the city of Chicago, have been more proactive about defining their own criteria not only for daytime high as well as nighttime low HI.Other cities, like Philadelphia, PA, has employed their own heat watch and warning systems [27].
Other concerns with the NWS advisories and warnings relate to urban areas where anthropogenic land cover modifications may elevate temperatures dangerously high even outside periods of regional extreme weather.Hazardous thermal conditions may also exist in small pockets of the urban landscape, which displays great variability in temperatures over space.The current NWS notification system is based on low resolution forecast model grids, relative to heterogeneity in urban landscapes and surface temperatures, and releases warnings and advisories at the county level.Because counties vary in size from place to place and may not completely contain major population centers, the NWS products could fail to provide specific warnings and meaningful guidance for large numbers of people.Even if the products are accurately predicting regional hot weather, detail to the spatial distribution of temperatures within the region could improve warnings, individual adaptation measures, and larger response efforts.
Previous work has examined whether the HI values used are indicative of health threats by comparing HI values and mortality for various locations [28].Like the NWS products the HI values are often collected at a single site and used to represent an entire region.Regionally representative combinations of temperature and humidity have also been compared with mortality and morbidity rates in places [29].The outcome of such studies has shown that HI can be a useful metric for informing decisions to protect public health in some locations.Alternatives based on weather classifications, like the Synoptic Spatial Classification (SSC), have also been examined for agreement with variability in mortality.The NWS system was compared against public perceptions of heat risk, a determining factor in whether precautionary actions are taken, and found to vary between regions and across age, income, gender, and ethnicities within regions [30].
(c) New Data Sources.In situ and remote sensors of temperature at or near the Earth's surface offer the potential to improve the current warning system by increasing its specificity, particularly with regard to location.These data sources are new and numerous.They provide data with greater spatial coverage, frequent revisit times, and low cost.Distributed weather stations may have a shorter history than reliable long term stations used in climatological studies but can effectively describe spatial patterns in temperatures across the urban landscape.Satellite data products like land surface temperature (LST) from the Moderate Resolution Imaging Spectroradiometer (MODIS) sensors offer 1 km spatial resolution data for areas around the globe up to four times daily [31].Such products are systematically processed to remove inconsistencies and distortions, as well as to calculate usable temperature outputs.While these data cannot currently offer predictive weather information, they are nonetheless useful for analyzing and describing spatial variation and patterns which, when combined with predictive models currently in use, can improve information to the public and the adaptive response.
(d) Investigations.In this work we consider temperatures from distributed public weather stations, NWS heat advisories and warnings, and land surface temperature imagery throughout two large metropolitan areas, Atlanta and Chicago, during the summers from 2006 to 2012.We first investigate the spatial variability in hazardous temperatures and agreement with advisories issued by the NWS, and second we examine the potential for a widely available thermal imagery product to replicate National Weather Service heat warnings.
Here we test two primary hypotheses.The first is that measured data from local stations will exhibit the conditions for heat warnings at the same time and place as NWS forecasted warnings.We expect to find that the NWS advisories miss some instances where hazardous heat conditions are met at locations within counties.We will examine some of the characteristics of such locations, should they exist.
Second, we examine specific days where there is some evidence of extreme heat in either the NWS or surface station records.These days help describe whether estimates of near surface air temperatures at subcounty resolutions can improve the identification of hazardous thermal conditions.We investigate estimates derived from LST collected by satellites coupled with station measurements.We expect to find that LST and station records are well correlated, particularly on NWS-determined advisory days.This would suggest that satellite data may provide a means of identifying hazardous heat conditions where stations do not exist and at scales finer that forecast models.The findings from these tests are expected to improve the existing national heat warning system by demonstrating the need for subcounty specification that the current system misses and by providing evidence for how existing data sources could be used to complement the current NWS system.

Study
Locations.This study focuses on two metropolitan areas in different climatic zones of the US: Atlanta, GA, and Chicago, IL (see Figure 1).Atlanta is an inland city in the southeastern US (centered near 84.37 W, 33.74 N).Atlanta's historic downtown and central city are located primarily in Fulton County.A portion of the city sits in DeKalb County east of Fulton.Three other counties (two north and one south of the city) were included in the analysis to cover the core of the metropolitan area: Clayton, Cobb, and Gwinnett.Chicago is in the midwest and sits on the large water body of Lake Michigan (centered near 87.63 W, 41.89 N).The city of Chicago sits within Cook County.Four surrounding counties (DuPage to the west, Lake, IL to the north, Will to the southwest, and Lake, IN to the southeast) were also included in the analysis of the Chicago Metro area.

Heat Advisory Data.
As for the historical record of heat warnings, we used NWS-issued Heat Advisories and Excessive Heat Warnings.Text records of the statements issued by NWS stations are archived and maintained by the National Oceanic and Atmospheric Administration's (NOAA) National Climatic Data Center (NCDC).The data are stored in the Hierarchical Data Storage System (HDSS), which includes a tape robotics system for data archived on tape.NCDC provides direct online access to these data through the HDSS Access System (HAS).Weather statements were issued from two NWS stations responsible for the Atlanta (KFFC, Peachtree City, Falcon, GA) and Chicago (KLOT, Lewis University, IL) Metropolitan Areas.Specifically, recorded Heat Advisories and Excessive Heat Warnings are contained in Non-Precipitation Watches, Warnings, Advisories Bulletins (bulletin ID WWUS7) and are accessible through the Service Records Retention System (SRRS) Text Products/Bulletin Selection interface (available at http://has .ncdc.noaa.gov/pls/plhas/HAS.StationYearSelect).Text file compilations of bulletins were obtained for May 1 to September 30 for the years 2006-2012.Individual text files were combed to identify mention of "HEAT" and were further examined to determine the day-county to which Heat Advisories or Excessive Heat Warnings applied.Stations within the ten counties were queried for hourly temperature and humidity data back to May 2006.Since the Weather Underground network is continuously expanding, stations used in the analysis may differ from those assembled when this paper is being read.
To control the quality of data and eliminate outliers, for each city, we removed observations beyond the range of mean ± five standard deviations.For each station, days with less than 16 hours valid hourly data and years with less than 75% valid daily data were also excluded to eliminate possible sampling bias.The hourly average temperature and relative humidity values were processed to calculate the HI based on algorithms provided by the NWS (http://www.hpc.ncep.noaa.gov/html/heatindexequation.shtml).To evaluate if stations experienced hazardous heat conditions, the NWS definition of Heat Advisory was used, such that if there are at least two consecutive days with at least one hourly HI greater than 105 ∘ F (40.6 ∘ C) in each day, these days were marked as heat wave days.

2.4.
Land Surface Temperature Imagery.The potential for regularly collected satellite data to provide more information on within-county variability in hazardous temperatures is examined through images from May through September 2011-2012 in the Atlanta and Chicago Metropolitan cores.
The daily 1 km land surface temperature (LST) data [32] from MODIS aboard the National Aeronautics and Space Administration (NASA) Earth Observing System (EOS) Aqua and Terra satellite, labeled as MYD11 A1 and MOD11 A1, were obtained from the Goddard Space Flight Center (http://ladsweb.nascom.nasa.gov).We extracted the LST parameter "LST Day 1 km" and "LST Night 1 km" at 1 × 1 km spatial resolution over Atlanta and Chicago.Retrievals with quality flags of "fair consistency" and "good consistency" were included in the following analyses.The 1 km monthly MODIS normalized difference vegetation index (NDVI) product (MOD13 A3) was obtained from the Goddard Space Flight Center (http://ladsweb.nascom.nasa.gov).
To integrate the air temperature measurements, spatial predictors, and LST retrievals, we projected all the data to the MODIS Sinusoidal Grid.Each Weather Underground station was assigned to the LST pixels of the same grid cell.The NDVI M J J A S M J J A S M J J A S M J J A S M J J A S MJ J A S M J J A S value, average elevation value, and percent impervious area value were constructed based on the same grid.
Following a published methodology [33] we developed a linear mixed effect model to estimate the daily average air temperature from LST retrievals.The model consisted of dayspecific random intercepts and random LST slopes as follows: where AT  ( ∘ F) is the measured air temperature in grid cell  on day ;  0 denotes the fixed intercept;   denotes the day-specific random intercept;  1-4 are the fixed slopes of LST, elev, impervPCT, and NDVI, respectively; V  is the day-specific random slope of LST; LST  is the land surface temperature retrieval in grid cell  on day ; impervPCT  is the percent of impervious area in grid cell ; NDVI  is the monthly NDVI value in grid cell  for the month in which day  falls; elev  (meters) is the mean elevation in grid cell ;   is the error term in grid cell  on day .
We also considered wind speed as a predictor in the model; however, preliminary results indicated that it was not significant and it was removed from the model.We used both daytime and nighttime LST retrievals from both Terra and Aqua satellite as the predictors and evaluated the model performance, respectively.The average night LST was selected as the predictor in the final model because it provides the highest accuracy and greatest coverage.The average nighttime LST is defined as the night LST from Aqua or the night LST from Terra if only one of them is available; if both Aqua and Terra night LSTs are available, the average night LST is the mean of these two values.Fivefold cross validation (CV) was used to validate our model performance.We randomly divided the data into a training dataset (80%) and a testing dataset (20%) and then made predictions for testing dataset using the model fitted from the training dataset.The model was trained and tested for five times by different training and testing datasets to ensure that each data point ends up in the testing dataset exactly once.This process was repeated for 1,000 times and the root meansquare prediction errors (RMSPE) and  2 were reported to estimate the model prediction precision.The RMSPE were calculated as follows: where  is the number of observations and   and   are the th predicted and observed value, respectively.2).In Atlanta, Heat Advisories were mostly applied to the five counties in the core metro area uniformly.That is, on days for which an advisory was issued it was applied to all counties.In only three instances Clayton county was issued a warning when other counties were not.In 2011 there were two Heat advisories in each month of July and August, and in 2012 there were four concurrent advisories that spanned June and July.In Chicago there was more variability in issuing NWS Advisories, particularly in July of 2011.In that month both Cook and DuPage Counties were issued six Advisories, Lake, Illinois had four, and both Lake, Indiana and Will County experienced eight.All five Chicago area counties experienced the same number of advisories in other months: one in August 2011, two in June 2012, and seven in July 2012.

Data
The majority of the Wunderground Stations are found on "developed" land cover of some type.Of Atlanta's 57 stations, most were located on high-, medium-, and low-intensity and open space developed land.Only 9 stations were located on land covers not considered developed (four evergreen forests, four deciduous forests, and one woody wetland).In Chicago 10 of the 137 (7.3%) stations were found on land covers other than some form of "developed."All of Cook county's 44 stations are found on low-, medium-, or high intensity developed land (see Tables 1 and 2).

Comparing NWS and Station Data.
To test the agreement of hazardous heat conditions at stations with the NWS Advisories, we treated the station measurements as the diagnostic gold standard against which the NWS notifications were compared.A false negative test, thus, describes an instance in which the daily heat index measured at the station met the criteria for a Heat Advisory without an official NWSissued Advisory.In both metro areas the average number of false negatives and false positives differed significantly from perfect agreement (see Tables 1 and 2).This was true for both 2011 and 2012 and across different land covers for which there were more than 10 examples.
The average number of false positives per station per year in Chicago (4.80)was much higher than the average number of false negatives (1.96), which was slightly less than the number of true positive days where stations and NWS notifications agreed (2.92), while in Atlanta, the average number of false positives (1.98) was much lower than the number of false negatives per station (5.28), both of which were greater than the days/year of station-NWS agreement (1.87).The results suggest that the NWS-issued Heat Advisories in Chicago covered many instances when hazardous conditions were never reached at stations, and in Atlanta the Advisories were more likely to miss instances of hazardous conditions at specific locations.Some stations in each metro area exhibited a high degree of disagreement between stations and the NWS (see Figure 3); however, no pattern related to land cover or location emerged to explain these variations.

Comparing Satellite Imagery and Temperatures.
Three specific categories of summer days were investigated more closely in each metro area using satellite data on LST.These categories were identified using the NWS Heat Advisory status and general trends among the metro's weather stations.In Atlanta, for example, on July 1, 2012 NWS issued a Heat Advisory for all five counties in the metro area and nearly all of the stations (87.7%) met the conditions for the Advisory.An NWS Advisory was also issued on June 29, 2012; however only about half (47.4%) of stations met Advisory conditions.In the third case, on July 25, 2012 just under half (48.3%) of the stations exhibited Advisory conditions but no NWS Heat Advisory was issued.In Chicago July 6, 2012 was a NWS Heat Advisory with agreement from 93.8% of stations.July 17, 2012 was another NWS Heat Advisory, but with only 42.1% of stations in agreement.Finally, July 2, 2012 was an example of several stations (49.6%) exhibiting Advisory conditions without a NWS-issued Advisory.
We examined these six days in detail using MODIS imagery to produce estimated daily mean air temperatures.Our mixed effects model with the average night LST as the predictor and average daily air temperature as the dependent variable fits the dataset well and provides high prediction precision.For the model fittings, the  2 is 0.71 and 0.74 in Chicago and Atlanta, respectively.For the fivefold CV, the  2 and RMSPE are 0.697 and 1.92 ∘ F in Chicago, respectively; and  2 and RMSPE are 0.711 and 1.75 ∘ F in Atlanta, respectively.We used this model to predict the mean daily temperature over Chicago and Atlanta on three typical days, respectively.
In both metro areas, the days on which there was high agreement between stations and NWS had higher estimated air temperatures (see Figures 4(a) and 4(b)).Even when there was daily disagreement among stations ((c)-(f)), the estimated temperatures on NWS Heat Advisory days ((c) and (d)) are higher than on days when there was no Advisory ((e) and (f)).The results support the merits of each dataset: the NWS Advisories appear to correspond to higher regional temperatures as estimated from LST, and station data help to identify specific locations of hazardous heat, particularly on days when no NWS Heat Advisory is issued.

Discussion
This work describes some fundamental characteristics of the NWS warning system for heat.The NWS system does well capturing regional weather movements which result in hazardously warm weather, and it delivers early information to large populations.This work highlights how the NWS lacks the spatial precision to inform more carefully targeted interventions which could save lives during regional heat events.The broad applicability of the NWS Heat Advisories and Warnings leads them to warn of the existence of hazardous heat conditions for places on summer days when such conditions are not present and to miss several instances of hazardous conditions in metro areas on days for which regional weather patterns may not trigger a warning.This work used relatively new and quickly growing datasets like unregulated and noncentralized weather stations as well as daily satellite imagery to demonstrate how the coverage and resolution of heat conditions within metro areas may be better represented and studied.
Moving forward, increased attention should be devoted to uncovering the drivers of non-NWS Advisory hot spots with urban areas.The existence and mechanisms of the urban heat island are well understood but largely considered only by research and science communities, rather than local planning entities [34].The existence of datasets, like those used in this study, present the opportunity for cities to understand and identify where and how local topography, climate, and demographics interact to create elevated climate-related health risks.One example of such practice already being adopted is with Chicago's Sustainability Office and their use of Landsat imagery to identify hotspots, which then serve as an inventory of priority locations for new green infrastructure investments (http://news.satimagingcorp.com/2006/10/chicagouses satellite images to determine citys true hot spots .html)[35].
The opportunities to improve the existing NWS early warning system are considerable, particularly given the

Advances in Meteorology
Table 1: Atlanta weather station details on the number of normal ("Norm") and Advisory ("Heat") days during the summer of 2011 and 2012.The total number of false positives (no station hazard with NWS advisory) and false negatives (station hazard with no NWS Advisory) is also provided to give an idea of the agreement between the station and the NWS Advisories for that county.growing number of networked weather stations within urban areas.The Wunderground network of stations is but one of several sites aggregating information from such distributed environmental monitoring systems.Weather Bug is another network which was used in the original study using MODIS data to generate a surface of estimated air temperatures [33].The ability of imagery to provide increased coverage and resolution for urban temperatures continues to be explored and improved [36].New processing techniques, such as those used here, which combine remotely sensed thermal data with in situ temperature readings offer the potential for cities to obtain recurring descriptions of intraurban temperature variation.Patterns that emerge from examining the urban thermal environmental over years could help improve public expenditures for reducing the urban heat island, for example, by increasing green space.These investments can be important parts of municipal strategies to combat climate change and improve quality of life through the multiple cobenefits that such strategies offer [37].

Metro
Warning systems for natural hazards have improved most for non-heat-related threats [38].For example, in 2007 the NWS has developed storm-based warnings for tornados as an alternative to countywide warnings.New data sources can improve precision of heat modeling and forecasting in metropolitan areas and may help with the reception of warning messages.This is particularly true as more of the public obtain weather information through interactive displays and interfaces.Compared with message delivery via radio, or static maps, meteorological information is increasingly made available on location-smart devices and with animated visualizations of weather conditions describing recent historic and near future weather conditions with improved precision [39,40].As users become used to this form of weather information, more specific forecasts of local heat can improve individual response and public trust of warnings [41].The location-and time-specific information available from such networks can also be paired with mobile technology to provide targeted warnings to subscribers within a certain distance of stations when they are exhibiting hazardous conditions.Mobile weather applications are already beginning to use location-aware devices' abilities to improve information delivery and some, such as Weather Underground's mobile app, allow users to provide "Hazard Reports" for their current location to crowdsource information on conditions such as power outages, road closures, and flooding.
In our analysis we found the estimated air temperatures produced from combining LST with station observations to capture the general patterns also described by the NWS warning classification, we do not find it to capture all of the heterogeneity in the weather station data.This may be due to the inability of LST-produced estimates to reflect the importance of humidity in determining human health Table 2: Chicago weather station details on the number of normal ("Norm") and Advisory ("Heat") days during the summer of 2011 and 2012.The total number of false positives (no station hazard with NWS Advisory) and false negatives (station hazard with no NWS Advisory) is also provided to give an idea of the agreement between the station and the NWS Advisories for that county.risk, as is accomplished with a heat index-like factor.In all cases (the six days examined) there was no significant difference in estimated mean temperature between pixels with stations exhibiting Advisory-like conditions and for those with stations measuring heat index values below 105 ∘ F. This perhaps suggests the importance of investigating methods for estimating heat index from satellite imagery sources, for validating the station measurements more thoroughly, and for examining the importance of local drivers of humidity.

Metro
We acknowledge that this analysis relies on measurements from weather station data that have not been as closely quality controlled as those from other long-standing weather stations that are part of large national and global networks.We limited our analysis because we believed the 2011-2012 Wunderground weather station data to be more complete than earlier years we investigated.For Atlanta, the fraction of daily observations exhibiting hazardous conditions was similar between the 7-year (4.3%) and the 2-year (4.9%) datasets.For Chicago the fractions were more divergent, 2.1% for 2006-2012 and 3.3% for only 2011 and 2012; however, we noticed that the 2006-2010 contained less hazardous heat weather in all datasets (NWS and Wunderground).Though we collected data from a number of years that were not used in the analysis, we expect that our findings are not anomalous in their description of the agreement between NWS and weather station measurements.

Conclusion
Records from individual weather stations show that the conditions for hazardous heat exposures exist for many locations within counties, even when the forecasted conditions do not call for issued warnings applied to the county.Further analysis of larger, long term datasets is needed to produce a more robust understanding of the interaction of regional weather and local land cover conditions that combine to produce hazardous conditions at specific locations within counties.These factors likely change with time of year and metro area being considered.

Figure 1 :
Figure 1: The five-county study areas of Chicago (a) and Atlanta (b) are shown.Weather stations (including the airport stations) are shown with dotted circles.

2. 3 .
Weather Station Data.Measurements from weather stations serve as diagnostics of whether or not a hazardous heat event actually occurred for a given location and day.Two data sources were used for weather station data.First, temperature and humidity data from NCDC's Surface Data, Hourly Global (DS3505) data were obtained for Atlanta Hartsfield International Airport (USW00013874) and Chicago O'hare International Airport (USW00094846) from the NCDC website (http://www.ncdc.noaa.gov/cdo-web/datasets/).Second, Weather Underground, a commercial weather service provider, established a personal weather station network, which they use to inform their BestForecast system.The Weather Underground network allows individuals to share real-time weather information recorded by personal weather stations.The measurement intervals range between 1 and 60 minutes and differ by station.Temperature ( ∘ F) and relative humidity (%) from 64 stations in five counties in the Atlanta metro area and 144 stations in five counties in the Chicago metro area (see Figure1) were obtained from the Weather Underground website (http://www.wunderground.com/accessed in Sep-Oct 2013).

Figure 2 :
Figure 2: Recorded National Weather Service Heat Advisories are shown (black) for May-September 2006-2012 by county.Annual county totals are also shown.

Figure 3 :
Figure 3: Stations are presented by the number of false positive and negative instances in 2011 and 2012.The National Land Cover Dataset's (NLCD) 2011 land cover classification scheme is included.A false negative means station conditions exceeded Heat Advisory Criteria with no such Advisory issued from NWS.A false positive is when Heat Advisory conditions at the station were not met despite NWS issuing an advisory.

Figure 4 :
Figure 4: Air temperatures modeled from Land Surface Temperature data from MODIS satellites are shown with station-measured heat index data with varying levels of agreement between NWS Heat Advisory status and station conditions.
14scriptions.Among records from the airport and Weather Underground weather stations from May-September 2006-2012 there are 26,943 and 70,312 valid station-day data records in total for Atlanta and Chicago, respectively, and 1,172 and 1,499 station days were marked as heat wave days.This is 4.3% of daily observations meeting Heat Advisory conditions in Atlanta and 2.14% in Chicago.In the years 2011 and 2012 there was far less missing data among stations.In these years there were14,086 and 34,347 observations with 694 (4.9%) and 1,143 (3.3%) station days exceeded Heat Advisory criteria.Both 2011 and 2012 featured several NWS Heat Advisories in the two metro regions.Several years prior featured no NWS-issued Heat Advisories for the core metro counties.In Atlanta 2006, 2008, and 2009 had no Advisories, and in the Chicago counties 2006-2008 were without Heat Advisories (see Figure
*Stations within each county are sorted by number of false negatives.
*Stations within each county are sorted by number of false positives.