- API
TRMM (TMPA-RT) Near Real-Time Precipitation L3 1 day 0.25 degree x 0.25 degree V7 (TRMM_3B42RT_Daily) at GES DISC
data.nasa.gov | Last Updated 2022-01-17T05:59:46.000ZTMPA (3B42RT_Daily) dataset have been discontinued as of Dec. 31, 2019, and users are strongly encouraged to shift to the successor IMERG dataset (doi: 10.5067/GPM/IMERGDE/DAY/06; 10.5067/GPM/IMERGDL/DAY/06). This daily accumulated precipitation product is generated from the Near Real-Time 3-hourly TRMM Multi-Satellite Precipitation Analysis TMPA (3B42RT). It is produced at the NASA GES DISC, as a value added product. Simple summation of valid retrievals in a grid cell is applied for the data day. The result is given in (mm). Although the grid is from 60S to 60N, the high latitudes (beyond 50S/N) near real-time retrievals are considered very unreliable and thus are screened out from the daily accumulations. The beginning and ending time for every daily granule are listed in the file global attributes, and are taken correspondingly from the first and the last 3-hourly granules participating in the aggregation. Thus the time period covered by one daily granule amounts to 24 hours, which can be inspected in the file global attributes. Counts of valid retrievals for the day are provided for every variable, making it possible to compute conditional and unconditional mean precipitation for grid cells where less than 8 retrievals for the day are available. Efforts have been made to make the format of this derived product as similar as possible to the new Global Precipitation Measurement CF-compliant file format. The latency of this derived daily product is about 7 hours after the UTC day is closed. Users should be mindful that the price for the short latency of these data is the reduced quality as compared to the research quality product. The information provided here on the TRMM mission, and on the original 3-hr 3B42 product, remain relevant for this derived product. Note, however, this product is in netCDF-4 format. The following describes the derivation in more details. The daily accumulation is derived by summing *valid* retrievals in a grid cell for the data day. Since the 3-hourly source data are in mm/hr, a factor of 3 is applied to the sum. Thus, for every grid cell we have Pdaily = 3 * SUM{Pi * 1[Pi valid]}, i=[1,Nf] Pdaily_cnt = SUM{1[Pi valid]} where: Pdaily - Daily accumulation (mm) Pi - 3-hourly input, in (mm/hr) Nf - Number of 3-hourly files per day, Nf=8 1[.] - Indicator function; 1 when Pi is valid, 0 otherwise Pdaily_cnt - Number of valid retrievals in a grid cell per day. Grid cells for which Pdaily_cnt=0, are set to fill value in the Daily files. Note that Pi=0 is a valid value. On occasion, the 3-hourly source data have fill values for Pi in a very few grid cells. The total accumulation for such grid cells is still issued, inspite of the likelihood that thus resulting accumulation has a larger uncertainty in representing the "true" daily total. These events are easily detectable using "counts" variables that contain Pdaily_cnt, whereby users can screen out any grid cells for which Pdaily_cnt less than Nf. There are various ways the accumulated daily error could be estimated from the source 3-hourly error. In this release, the daily error provided in the data files is calculated as follows. First, squared 3-hourly errors are summed, and then square root of the sum is taken. Similarly to the precipitation, a factor of 3 is finally applied: Perr_daily = 3 * { SUM[ (Perr_i * 1[Perr_i valid])^2 ] }^0.5 , i=[1,Nf] Ncnt_err = SUM( 1[Perr_i valid] ) where: Perr_daily - Magnitude of the daily accumulated error power, (mm) Ncnt_err - The counts for the error variable Thus computed Perr_daily represents the worst case scenario that assumes the error in the 3-hourly source data, which is given in mm/hr, is accumulating within the 3-hourly period of the source data and then during the day. These values, however, can easily be conveted to root mean square error estimate of the rainfall rate: rms_err = { (Perr_daily/3) ^2 / Ncnt
- API
MODIS Airborne Simulator (MAS) Measurements Taken Onboard the NASA ER-2 During the TOGA COARE Intensive Observing Period.
data.nasa.gov | Last Updated 2022-01-17T05:38:03.000ZThe MODIS Airborne Simulator (MAS) Measurements, taken onboard the NASA ER-2 during the TOGA COARE Intensive Observing Period, are available upon request from NASA LAADS. Browse products are available at https://ladsweb.modaps.eosdis.nasa.gov/missions-and-measurements/mas/. The ER-2 navigation data are available from the same site in sub directory nasa_er2/nav. Browse imagery of the data may be viewed from the MAS Homepage at: https://mas.arc.nasa.gov/data/deploy_html/toga_home.html. MAS Level 1B data are available on 8500 density 8mm tape from TOGA COARE User Services at the Goddard DAAC. Each tape contains all the flight lines for one MAS flight (one day). The number of flight lines varies, but is generally between 10 and 20. The volume of data varies, but is generally 1 to 3 gigabytes per flight. Detailed instructions for reading MAS tapes is contained in MAS_Usr_Guide.ps. To obtain the data on tape, contact the DAAC User Services Office. For help with NASA TOGA COARE data residing at the GSFC DAAC, contact Pat Hrubiak at hrubiak@daac.gsfc.nasa.gov. BACK GROUND: TOGA COARE was a multidisciplinary, international research effort that investigated the scientific phenomena associated with the interaction between the atmosphere and the ocean in the warm pool region of the western Pacific. The field experiment phase of the program took place from 1 November 1992 through 28 February 1993 and involved the deployment of oceanographic ships and buoys, several ship and land based Doppler radars, multiple low and high level aircraft equipped with Doppler radar and other airborne sensors, as well as a variety of surface based instruments for in situ observations. The NASA component of TOGA COARE, while contributing directly to over all COARE objectives, emphasized scientific objectives associated with the Tropical Rainfall Measuring Mission (TRMM) and NASA's cloud and radiation program. AIRCRAFT INFORMATION: The NASA ER-2 is a high altitude, single pilot aircraft based at Ames Research Center, Moffett Field, CA, and deployed globally in support of a variety of atmospheric research projects. It has a maximum altitude of 70,000 feet (21 km), a range of 3000 nautical miles, a maximum flight duration of 8 hours (nominal 6.5 hours) and a top speed of 410 knots true air speed. The aircraft accommodates about 2700 pounds (1200 kg) of payload. For the TOGA COARE campaign, the ER-2 payload consisted of a variety of radiometers, a lidar, a conductivity probe and a camera. FLIGHT INFORMATION: The following table relates MAS data files to ER-2 and DC-8 flight numbers and to the UTC dates for the 13 mission flights of the NASA/TOGA COARE campaign and 2 additional flights of the ER-2 on which MAS data was acquired. The objectives (Obj) column is included for the convenience of the user; the mission objective defaulted to radiation (Rad) unless convection (Con) was forecast in the target area. Date (UTC) ER-2 Flight DC-8 Flight MAS TapeID Obj-Jan 11-12 93-053 93-01-06 93-053 RadJan 17-18 93-054 93-01-07 93-054 Con Jan 18-19 93-055 93-01-08 93-055 Con Jan 25-26 93-056 93-01-09 93-056 RadJan 28-29 93-057 93-057 Jan 31-Feb 1 93-058 93-01-10 93-058 Rad Feb 2 93-059 93-059 Feb 4 93-060 93-01-11 93-060 Con Feb 6 93-01-12 Con Feb 7 93-061 93-061 Feb 8-9 93-062 93-01-13 93-062 Con Feb 10-11 93-063 93-01-14 93-063 Con Feb 17-18 93-01-15 93-064 Con Feb 19-20 93-064 93-064 Feb 20-21 93-065 93-01-16 93-065 Con Feb 22-23 93-066 93-01-17 Con Feb 23-24 93-067 93-01-18 Rad. INSTRUMENT INFORMATION: The MODIS Airborne Simulator is a visible/infrared imaging radiometer that was mounted, for this campaign, in the right aft wing pod of the ER-2 aircraft. Through cross track scanning to the aircraft direction of flight, the MAS instrument builds a continuous sequence image of the atmosphere surface features under the aircraft. Wavelength channels of the instrument are selected for specific cloud and surface remote sensing applications. Also the channels are th
- API
Optimal Alarm Systems
data.nasa.gov | Last Updated 2020-01-29T03:25:13.000ZAn optimal alarm system is simply an optimal level-crossing predictor that can be designed to elicit the fewest false alarms for a fixed detection probability. It currently use Kalman filtering for dynamic systems to provide a layer of predictive capability for the forecasting of adverse events. Predicted Kalman filter future process values and a fixed critical threshold can be used to construct a candidate level-crossing event over a predetermined prediction window. Due to the fact that the alarm regions for an optimal level-crossing predictor cannot be expressed in closed form, one of our aims has been to investigate approximations for the design of an optimal alarm system. Approximations to this sort of alarm region are required for the most computationally efficient generation of a ROC curve or other similar alarm system design metrics. Algorithms based upon the optimal alarm system concept also require models that appeal to a variety of data mining and machine learning techniques. As such, we have investigated a serial architecture which was used to preprocess a full feature space by using SVR (Support Vector Regression), implicitly reducing it to a univariate signal while retaining salient dynamic characteristics (see AIAA attachment below). This step was required due to current technical constraints, and is performed by using the residual generated by SVR (or potentially any regression algorithm) that has properties which are favorable for use as training data to learn the parameters of a linear dynamical system. Future development will lift these restrictions so as to allow for exposure to a broader class of models such as a switched multi-input/output linear dynamical system in isolation based upon heterogeneous (both discrete and continuous) data, obviating the need for the use of a preprocessing regression algorithm in serial. However, the use of a preprocessing multi-input/output nonlinear regression algorithm in serial with a multi-input/output linear dynamical system will allow for the characterization of underlying static nonlinearities to be investigated as well. We will even investigate the use of non-parametric methods such as Gaussian process regression and particle filtering in isolation to lift the linear and Gaussian assumptions which may be invalid for many applications. Future work will also involve improvement of approximations inherent in use of the optimal alarm system of optimal level-crossing predictor. We will also perform more rigorous testing and validation of the alarm systems discussed by using standard machine learning techniques and consider more complex, yet practically meaningful critical level-crossing events. Finally, a more detailed investigation of model fidelity with respect to available data and metrics has been conducted (see attachment below). As such, future work on modeling will involve the investigation of necessary improvements in initialization techniques and data transformations for a more feasible fit to the assumed model structure. Additionally, we will explore the integration of physics-based and data-driven methods in a Bayesian context, by using a more informative prior.
- API
CORONA Satellite Photographs from the U.S. Geological Survey
data.nasa.gov | Last Updated 2022-01-17T05:16:00.000ZThe first generation of U.S. photo intelligence satellites collected more than 860,000 images of the Earth’s surface between 1960 and 1972. The classified military satellite systems code-named CORONA, ARGON, and LANYARD acquired photographic images from space and returned the film to Earth for processing and analysis. The images were originally used for reconnaissance and to produce maps for U.S. intelligence agencies. In 1992, an Environmental Task Force evaluated the application of early satellite data for environmental studies. Since the CORONA, ARGON, and LANYARD data were no longer critical to national security and could be of historical value for global change research, the images were declassified by Executive Order 12951 in 1995. The first successful CORONA mission was launched from Vandenberg Air Force Base in 1960. The satellite acquired photographs with a telescopic camera system and loaded the exposed film into recovery capsules. The capsules or buckets were de-orbited and retrieved by aircraft while the capsules parachuted to earth. The exposed film was developed and the images were analyzed for a range of military applications. The intelligence community used Keyhole (KH) designators to describe system characteristics and accomplishments. The CORONA systems were designated KH-1, KH-2, KH-3, KH-4, KH-4A, and KH-4B. The ARGON systems used the designator KH-5 and the LANYARD systems used KH-6. Mission numbers were a means for indexing the imagery and associated collateral data. A variety of camera systems were used with the satellites. Early systems (KH-1, KH-2, KH-3, and KH-6) carried a single panoramic camera or a single frame camera (KH-5). The later systems (KH-4, KH-4A, and KH-4B) carried two panoramic cameras with a separation angle of 30° with one camera looking forward and the other looking aft. The original film and technical mission-related documents are maintained by the National Archives and Records Administration (NARA). Duplicate film sources held in the USGS EROS Center archive are used to produce digital copies of the imagery. Mathematical calculations based on camera operation and satellite path were used to approximate image coordinates. Since the accuracy of the coordinates varies according to the precision of information used for the derivation, users should inspect the preview image to verify that the area of interest is contained in the selected frame. Users should also note that the images have not been georeferenced.
- API
VIIRS/SNPP Cloud Properties 6-min L2 Swath 750m
data.nasa.gov | Last Updated 2024-06-24T13:04:12.000ZThe VIIRS/SNPP Cloud Properties 6-min L2 Swath 750m product is designed to facilitate continuity in cloud properties between the MODIS (Moderate Resolution Imaging Spectroradiometer) on the Aqua and Terra platforms and the series of VIIRS (Visible Infrared Imaging Radiometer Suite) instruments, beginning with the Suomi NPP spacecraft. The VIIRS Cloud Properties product consists of cloud optical and physical parameters. These parameters are derived using observations in visible through infrared spectral channels. VIIRS infrared channel radiances are primarily used to derive cloud top temperature, cloud top height, effective emissivity, an infrared cloud phase product (ice vs. water, opaque vs. non-opaque) and cloud fraction under both daytime and nighttime conditions. The VIIRS solar reflectance channels are primarily used to derive cloud optical thickness, particle effective radius, water path, and to inform the phase used in the optical retrievals. The VIIRS Cloud Properties product is a Level-2 product generated at 750 m (at nadir) spatial resolution. The current version-1.1 of the Level-2 CLDPROP product collection is corrected to address an issue with the cloud optical properties’ thermodynamic phase that caused erroneous liquid water cloud phase results.
- API
VIIRS/NOAA20 Cloud Properties 6-min L2 Swath 750m
data.nasa.gov | Last Updated 2024-06-10T13:04:26.000ZThe VIIRS/NOAA20 Cloud Properties 6-min L2 Swath 750m product is a continuity product similar to its counterpart product from the Suomi National Polar-orbiting Partnership (SNPP) VIIRS. Judiciously leveraging a common set of spectral channels, they help sustain the long-term records of both MODIS and VIIRS heritages. A commonly applicable algorithm to both MODIS and VIIRS inputs is the hallmark of this continuity approach. CLDPROP_L2_VIIRS_NOAA20 is the shortname for the NOAA20 VIIRS incarnation of the orbital swath-based Cloud Properties continuity product. For more information, visit product page at: https://ladsweb.modaps.eosdis.nasa.gov/missions-and-measurements/products/CLDPROP_L2_VIIRS_NOAA20
- API
Probabilistic Model-Based Diagnosis for Electrical Power Systems
data.nasa.gov | Last Updated 2020-01-29T02:07:39.000ZWe present in this article a case study of the probabilistic approach to model-based diagnosis. Here, the diagnosed system is a real-world electrical power system, namely the Advanced Diagnostic and Prognostic Testbed (ADAPT) located at the NASA Ames Research Center. Our probabilistic approach is formally well-founded, and based on Bayesian networks and arithmetic circuits. We pay special attention to meeting two of the main challenges model development and real-time reasoning often associated with real-world application of model-based diagnosis technologies. To address the challenge of model development, we develop a systematic approach to representing electrical power systems as Bayesian networks, supported by an easy-touse specication language. To address the real-time reasoning challenge, we compile Bayesian networks into arithmetic circuits. Arithmetic circuit evaluation supports real-time diagnosis by being predictable and fast. In experiments with the ADAPT Bayesian network, which contains 503 discrete nodes and 579 edges and produces accurate results, the time taken to compute the most probable explanation using arithmetic circuits has a mean of 0.2625 milliseconds and a standard deviation of 0.2028 milliseconds. In comparative experiments, we found that while the variable elimination and join tree propagation algorithms also perform very well in the ADAPT setting, arithmetic circuit evaluation was an order of magnitude or more faster. **Reference:** O. J. Mengshoel, M. Chavira, K. Cascio, S. Poll, A. Darwiche, and S. Uckun. "Probabilistic Model-Based Diagnosis: An Electrical Power System Case Study”. Accepted to IEEE Transactions on Systems, Man, and Cybernetics, Part A, 2009.
- API
SIAM 2007 Text Mining Competition dataset
data.nasa.gov | Last Updated 2020-01-29T04:25:03.000Z**Subject Area:** Text Mining **Description:** This is the dataset used for the SIAM 2007 Text Mining competition. This competition focused on developing text mining algorithms for document classification. The documents in question were aviation safety reports that documented one or more problems that occurred during certain flights. The goal was to label the documents with respect to the types of problems that were described. This is a subset of the Aviation Safety Reporting System (ASRS) dataset, which is publicly available. **How Data Was Acquired:** The data for this competition came from human generated reports on incidents that occurred during a flight. **Sample Rates, Parameter Description, and Format:** There is one document per incident. The datasets are in raw text format. All documents for each set will be contained in a single file. Each row in this file corresponds to a single document. The first characters on each line of the file are the document number and a tilde separats the document number from the text itself. **Anomalies/Faults:** This is a document category classification problem.
- API
MISR Level 3 FIRSTLOOK Global Land product in netCDF format covering a day V002
data.nasa.gov | Last Updated 2023-01-19T22:32:40.000ZThis file contains the MISR Level 3 FIRSTLOOK Component Global Land product in netCDF format covering a day
- API
MODIS/Aqua Calibrated Radiances 5-Min L1B Swath 500m - NRT
data.nasa.gov | Last Updated 2023-07-24T13:04:42.000ZThe 500 meter MODIS Level 1B Near Real Time (NRT) data set contains calibrated and geolocated at-aperture radiances for 7 discrete bands located in the 0.45 to 2.20 micron region of the electromagnetic spectrum. These data are generated from the MODIS Level 1A scans of raw radiance and in the process converted to geophysical units of W/(m^2 um sr). In addition, the Earth Bi-directional Reflectance Distribution Function (BRDF) may be determined for these solar reflective bands through knowledge of the solar irradiance (e.g., determined from MODIS solar diffuser data, and from the target illumination geometry). Additional data are provided including quality flags, error estimates and calibration data. Visible, shortwave infrared, and near infrared measurements are only made during the daytime, while radiances for the thermal infrared region (bands 20-25, 27-36) are measured continuously. Channel locations for the MODIS 500 meter data are as follows: Band Center Wavelength (um) Primary Use ---- ---------------------- ----------- 1 0.620 - 0.670 Land/Cloud Boundaries 2 0.841 - 0.876 Land/Cloud Boundaries 3 0.459 - 0.479 Land/Cloud Properties 4 0.545 - 0.565 Land/Cloud Properties 5 1.230 - 1.250 Land/Cloud Properties 6 1.628 - 1.652 Land/Cloud Properties 7 2.105 - 2.155 Land/Cloud Properties Channels 1 and 2 have 250 m resolution, channels 3 through 7 have 500 m resolution. However, for the MODIS L1B 500 m product, the 250 m band radiance data and their associated uncertainties have been aggregated to 500 m resolution. Thus the entire channel data set has been co-registered to the same spatial scale in the 500 m product. Separate L1B products are available for the 250 m resolution channels (MYD02QKM) and 1 km resolution channels (MYD021KM). For the latter product, the 250 m and 500 m channel data (bands 1 through 7) have been aggregated into equivalent 1 km pixel values. Spatial resolution for pixels at nadir is 500 km, degrading to 2.4 km in the along-scan direction at the scan extremes. However, thanks to the overlapping of consecutive swaths and respectively pixels there, the resulting resolution at the scan extremes is about 1 km. A 55 degree scanning pattern at the EOS orbit of 705 km results in a 2330 km orbital swath width and provides global coverage every one to two days. A single MODIS Level 1B 500 m granule will contain a scene built from 203 scans sampled 2708 times in the cross-track direction, corresponding to approximately 5 minutes worth of data; thus 288 granules will be produced per day. Since an individual MODIS scan will contain 20 along-track spatial elements for the 500 m channels, the scene will be composed of (2708 x 4060) pixels, resulting in a spatial coverage of (2330 km x 2040 km). Due to the MODIS scan geometry, there will be increasing scan overlap beyond about 20 degrees scan angle. To summarize, the MODIS L1B 500 m data product consists of: 1. Calibrated radiances, uncertainties and number of samples for (2) 250 m reflected solar bands aggregated to 500 m resolution 2. Calibrated radiances and uncertainties for (5) 500 m reflected solar bands 3. Geolocation for 1km pixels, that must be interpolated to get 500 m pixel locations. For the relationship of 1km pixels to 500m pixels, see the Geolocation ATBD http://modis.gsfc.nasa.gov/data/atbd/atbd_mod28_v3.pdf . 4. Calibration data for all channels (scale and offset) 5. Comprehensive set of file-level metadata summarizing the spatial, temporal and parameter attributes of the data, as well as auxiliary information pertaining to instrument status and data quality characterization The MODIS L1B 500 m data are stored in the Earth Observing System Hierarchical Data Format (HDF-EOS) which is an extension of HDF as developed by the National Center for Supercomputer Applications (NCSA) at the University of Illinois. A ty