Regional Data Center

SFEI is the regional data center for the San Francisco Estuary and its watersheds. The Institute manages various types of water quality, tissue, wetlands, historical, and spatial data. Our data upload and access tools are listed below. A future goal is to develop new tools that will integrate, analyze, and model different types of data and to explore new ideas for displaying meaningful ecological information.

Bay Area Trash Tracker

Password-protected tool for municipal staff in the San Francisco Bay Area to research available trash capture devices, access contract resources, and add maintenance event information.

California Environmental Data Exchange Network (CEDEN)

Access statewide water quality and tissue data through simple and advanced web query interfaces.

California Rapid Assessment Method (CRAM)

Upload and view data on the health of wetlands and riparian habitats.

California Wetlands Portal

Access statewide information on the quantity and quality of California wetlands and upload documents to the file library for wetland projects.

Central Valley Monitoring Directory

Upload, view, and download program and metadata information on current water quality monitoring efforts in the Central Valley watershed.

Data Checker

Check and upload SWAMP comparable data to SFEI's regional data center.

EcoAtlas Information System

View historical and modern habitats of the San Francisco Bay Baylands.

Geoportal -- coming soon!

Search metadata on base layers. This password-protected tool will be accessible to external users in the future.

Historical Ecology Coast Survey Maps

View and download historical maps of the San Francisco Bay produced by the United States Coast Survey (USCS) and several related resources developed by SFEI to support their use in the region.

My Water Quality Portals

Access California water quality monitoring data and assessment information organized into four question-driven themes. SFEI provides data and contributes in the development of several of the portals.

South Bay Salt Ponds Restoration Project

Search the metadata server for information on the largest tidal restoration project on the West Coast.

Web Query Tool

Use user-defined queries to dynamically map and download water quality and tissue data from several projects, including the Regional Monitoring Program and Fish Monitoring Program.

What is a Regional Data Center?

There are seven core services a Regional Data Center (RDC) provides. However, depending upon the resources and technical expertise available, not all of these services will be performed by each RDC. The tools described below may not be the same at all of the RDCs, since an RDC may modify a tool to meet internal or stakeholder needs.

1. Upload and check data

The service of uploading and checking data involves providing an online place for data generators to upload data to the RDC, checking that standard formats, codes, and quality assurance and control standards have been used in a dataset, and then loading results into a database or data mart. Tool development includes web-based data checkers and data-loading and QA/QC review queries.

2. Store and manage data

The service of storing and managing data includes the storage of data in a standard format (e.g., SWAMP v.2.5, star schema, project-specific database, Excel files, geodatabase), updating these data as errors are identified and procedures are modified (e.g., revising codes and adding/deleting fields), maintaining metadata, documentation, and promulgating data standards.

3. Exchange data

The service of exchanging data focuses on the back-end aspects required to exchange data with CEDEN and other systems in an automatic or semi-automatic way and the configuration and maintenance of servers, software, and documentation to facilitate this exchange.

4. Access data

The service of accessing data focuses on end-user interaction with the system, including user-defined queries, data download functionality, and visualization tools, such as dynamically generating charts and maps of environmental conditions, stressors, or management responses to undesirable conditions.

5. Coordinate and transfer technology

The service of coordinating and transferring technology involves working with the Monitoring Council, theme-based workgroups, and other RDCs to design, coordinate, and transfer tool development (e.g., providing code for tools, assisting with code modification, documenting code, establishing version control, sharing technical expertise and advise, troubleshooting).

6. Integrate data

The service of data integration is to integrate, analyze, and model data to produce a categorical answer to ecologically relevant management questions. This service explores new ideas for displaying meaningful ecological information in ways that environmental managers and the interested public can understand, and different approaches for answering theme-based questions and determining which datasets are relevant for formulating answers.

7. Audit data

While each project will perform a thorough QA/QC review of their data, an independent audit will also be performed to ensure the quality and accuracy of results being reported. Outcomes from these audits will be incorporated into the RDC database and used to flag and classify the data for different uses.

Data Handling

The information on this page is provided to help viewers to better understand the data download from the SFEI Contaminant Data Download and Display tool, including the type of data available and how data are presented and handled by SFEI. If you have questions or comments, please contact cristina@sfei.org.

Back to CD3

Table of Contents for CD3 Downloads

Matrix Definitions: provides definitions used to identify the test material and matrix

Qualifier Definitions: provides information that should be considered when interpreting test results.

Data can be downloaded with all qualifiers or with a subset of primary qualifiers.

Results-Cross tab: data provided in a cross tabulated Excel worksheet

Results-Flat file: data provided in a flat file Excel worksheet

Viewing results

A CD3 download is provided as an Excel file, within which are separate worksheets containing the results in cross-tabulated and flat file formats. The flat file format is especially suitable for import into other software platforms, such as Access or SAS, for further analyses. A key to matrix and qualifiers is also included.

All qualifiers or only the "primary" qualifiers may be selected for display in the CD3 download. Primary qualifiers are DO, DOXXX, ND, NR, NRS, NRT, R, and SL. The primary qualifier SL is used to identify a significant toxicity test, for more information on the specific statistical comparison(s) conducted use the "Show All Qualifiers" option.

Information for percent solids, percent moisture, and percent lipids are reported only in the flat file Excel worksheet.

Notes Specific to RMP Data

The results provided by CD3 may differ slightly from those previously reported in the RMP Annual Reports and static data tables, due in part to ongoing updates to the dataset, standardization of the qualifiers reported, changes in the handling of replicate samples, and changes in the method used to sum the dissolved and particulate water fractions.

Missing Data: Measurements vary by year and test material, but typically include a suite of contaminants (metals and organics) and ancillary data. Missing data are either not available (e.g., parameters were not measured in every year), or the data are being reanalyzed and will be made available at a later date. Missing data and changes in target RMP parameters are listed in the RMP Annual Monitoring Results reports.

SSC/TSS: Beginning in 2002, the water quality measurement total suspended solids (TSS) was replaced by the parameter suspended sediment concentration (SSC).
Organic Sums: Organic group sums, for example "Sum of PCBs (SFEI)", are calculated by SFEI based on the target analytes for an analyte group; the exact number and the group constituents may vary over the years.

Metal Data: All metals from 1993 to 2008 are reported as near totals. Beginning in 2009, water and tissue trace metals (Ag, Al, Cd, Cu, Fe, Pb, Mn, Ni, and Zn) are reported as total concentrations. Chemical analyses of sediment samples is generally performed on the <2mm fraction.

MDLs: While every effort is made to obtain the method detection limit (MDL) value from the labs, if none is available, other detection limits may be provided (e.g., instrument detection limit, sample detection limit, reporting limit). However, all detection/reporting limits are stored in the MDL field. Although some MDL values may appear truncated in the cross-tabulated output (e.g., 0.00), full results are provided in the flat file Excel worksheet.

Tissue Reference Sites: Two reference station codes (T-0 and T-1) are included in the tissue results for some years. T-0 indicates that the reference bivalve was analyzed before being deployed. T-1 indicates that the reference bivalve was analyzed after being deployed.

RMP Sampling Strategy: From 1993-2001 RMP sampling sites for water, sediment and bivalve tissue were at fixed locations throughout the Estuary. Starting in 2002 the RMP changed to a random sampling design for both water and sediment. The bivalve sampling sites remain at fixed locations. All sites, whether random or fixed, are associated with an Estuary region.

Are results expressed in wet weight or dry weight?

Information on PCB Sums

Beginning in 2009, the following three PCB Sums are reported:

Information on co-eluting PCB congeners

During the analytical process, some PCB congeners (co-eluting PCBs) cannot be distinguished as separate congeners and thus are quantified as a complex of one or more congeners. When a reportable congener is co-eluting with another congener, we flag this result according to the following rules:

  1. If a reportable congener co-elutes with another reportable congener, then the dominant congener (established from the literature) contains a qualifier "DO" and the quantitative result. For example PCB 056 often co-elutes with PCB 060. The dominant congener, PCB 060, will have "DO" in the qualifier field and the concentration measured in the result field. PCB 056, the nondominant congener, will have "DO060" in the qualifier field referring the user to look for the quantitative result in congener PCB 060. The qualifier alerts the user that the result is a mixture of more than 1 congener, and identifying the dominant congener that makes up the highest percent of the mixture.
  2. If a reportable congener co-elutes with a non-reportable congener, then the reportable congener has the qualifier "DO" and the quantitative result.

Back to CD3

Related Data Access Tools

 

California Avian Data Center (CADC)

CADC, a regional node of the Avian Knowledge Network (AKN) hosted by PRBO Conservation Science, integrates data on birds and ecosystems to improve conservation outcomes today and in the future.

California Environmental Resources Evaluation System (CERES)

CERES is an information system developed by the California Natural Resources Agency to facilitate access to a variety of electronic data describing California's rich and diverse environments.

California Data Exchange Center (CDEC)

CDEC provides a centralized location to store and process real-time hydrologic information gathered by various cooperators throughout the State, including snow reporting gages and precipitation and river stage sensors.

California Irrigation Management Information System (CIMIS)

CIMIS is a program in the California Department of Water Resources that manages a network of over 120 automated weather stations in the state of California and calculates evapotranspiration estimates.

California Protected Areas Database (CPAD)

CPAD is a GIS inventory developed by GreenInfo Network and contains all protected open space lands in the State of California.

Central and Northern California Ocean Observing System (CeNCOOS)

CeNCOOS integrates marine observations, including real time conditions, surface currents, and water quality shore stations, to inform decision makers and the general public.

Environmental Monitoring & Assessment Program (EMAP)

EMAP is a research program of the U.S. EPA that develops tools necessary to monitor and assess the status and trends of national ecological resources.

Natural Resource Projects Inventory (NRPI)

NRPI is the most comprehensive statewide database of its kind in California with over 8,000 natural resource projects.

San Francisco Bay Subtidal Habitat Goals Project

The Subtidal Habitat Goals Project is a collaborative regional planning effort that has compiled interactive maps portraying habitat distribution, environmental stressors, proposed restoration sites, and land ownership.

Southern California Coastal Ocean Observing System (SCCOOS)

SCCOOS focuses on coastal observations in the Southern California Bight, but also provides bathymetry data for San Francisco Bay.

USGS National Water Quality Assessment (NAWQA) Data Warehouse

The NAWQA Data Warehouse provides access to water quality data from 42 different study areas across the United States, dating back to 1991.

USGS Water Quality of San Francisco Bay

The USGS provides access to its collection of water quality data in San Francisco Bay, dating back to 1969.

Western Center for Monitoring & Assessment of Freshwater Ecosystems

The Center is housed within the College of Natural Resources at Utah State University and provides web-based resources (bioassessment, predictive models, and data modules) to the ecological assessment community.

 

Reports and Presentations

 

Featured Reports

Quality Assurance Project Plan for the Regional Monitoring Program. 1999 RMP Technical Report.

Science Support for the Surface Water Ambient Monitoring Program. 2008 SFEI Technical Report #546.

 

Featured Presentations

Cool New Tools for Accessing RMP Data. 2008 RMP Annual Meeting.

Environmental Data Upload and Visualization Tools. 2009 SOE Conference Poster.

Environmental Data Upload and Visualization Tools. 2010 NWQMC National Monitoring Conference, Denver, CO.

 

Revised RDC Page [DEV]

Introduction

SFEI is the regional data center for the San Francisco Estuary and its watersheds. The Institute manages water quality, tissue, wetlands, historical, and spatial data, and develops tools for uploading, accessing, and visualizing data. Data are integrated and displayed in meaningful ways to inform different audiences.

  • Bay Area Aquatic Resources Inventory
  • Central Valley Monitoring Directory
  • U.S. Coast Survey Maps of California (South Coast)
  • Web Query Tool
Web Query Tool

Tools by CategoryView All »

Clean Water

 
  • Bay Area Trash Tracker

    Tool for Bay Area municipal staff to research available trash capture devices and add maintenance event information

  • CEDEN

    Download statewide water quality and tissue data using user-defined query interface

  • Central Valley Monitoring Directory

    Upload, view, and download program and metadata information on current water quality monitoring efforts

  • Data Checker

    Upload SWAMP comparable data to SFEI's Regional Data Center

  • My Water Quality Portals

    Access California water quality monitoring data and assessment information from question-driven theme-based portals

  • Web Query Tool

    Map and download water quality and tissue data from several projects, including the Regional Monitoring Program

 

Wetlands

 
  • Aquatic Resources Inventory

    No description provided.

  • Bay Area Aquatic Resources Inventory

    No description provided.

  • California Rapid Assessment Method (CRAM)

    Upload and view data on the health of wetlands and riparian habitats

  • California Wetlands Portal

    Access statewide information on the quantity and quality of wetlands and upload documents to the project’s file library

  • Geoportal

    Search metadata on base layers. This password-protected tool will be accessible to external users in the future

  • NHD Stewardship

    No description provided.

  • Online 401

    Apply for 401 Water Quality Certification or file a Report of Waste Discharge for projects impacting waters of the United States or California

  • Riparian Model

    No description provided.

  • South Bay Salt Ponds Restoration Project

    Search the metadata server for information on the largest tidal restoration project on the West Coast

  • Transitional Ecotone Vegetation Data Management System

    Upload and access data from vegetation surveys of intertidal-upland ecotones

 

Historical Ecology

 
  • Historical Ecology Coast Survey Maps

    Download historical maps of the San Francisco Bay

  • U.S. Coast Survey Maps of California (South Coast)

    Download T-sheets for parts of Southern California and San Francisco Bay, GIS layers, and related tools

 

Early Projects

 
  • Central Coast Wetlands Group

    No description provided.

  • EcoAtlas

    View historical and modern habitats of the San Francisco Bay Baylands

  • Morro Bay Watershed Pilot Interactive Mapping

    No description provided.