AB 1755: Open and Transparent Water Data Platform for California

What is the Open and Transparent Data Act?

The Open and Transparent Water Data Act (AB 1755, Dodd) requires the Department of Water Resources, in consultation with the California Water Quality Monitoring Council, the State Water Resources Control Board, and the California Department of Fish and Wildlife, to create, operate, and maintain a statewide integrated water data platform; and to develop protocols for data sharing, documentation, quality control, public access, and promotion of open-source platforms and decision support tools related to water data.

A team of partner agencies is collaborating with and learning from others  including State and federal agencies, data experts, data providers, and data consumers to chart a successful path forward.

Why is an open data platform important?

  • Integration of existing water and ecological/fisheries data will: support analysis across datasets and disciplines; help water managers operate more efficiently; and help water users make informed decisions based on water availability and allocation
  • State agencies should promote openness and interoperability of water data
  • Increased transparency of public data is good government
  • Water data and information technology tools and applications developed and gathered using state funds should be made publicly accessible and open-source, whenever possible
  • Increased access to data will support better-informed decisions and cost-effective investments
  • AB 1755 will support greater use of data collected and increase awareness of the importance of data in water management
  • Making information accessible, discoverable, and usable by the public can foster entrepreneurship, innovation, and scientific discovery
  • More comprehensive and interoperable datasets will provide unique opportunities to develop data-search and data-packaging products and services

Strategic Vision

Useful data for sound, sustainable water resource management.

Goals

In support of the vision, four goals have been articulated, as follows:

  • Data are sufficient: Data are sufficient to support water resources management and answer water resource-related questions.
  • Data are accessible: Data are available for use and discoverable.
  • Data are useful: Data are available in a form that facilitates use in various models, visualizations, and reports.
  • Data are used: Data are put to work in decision-making and innovation.

Cover of Strategic PlanStrategic Plan

The implementing agencies developed a Strategic Plan for Assembly Bill 1755, the Open and Transparent Water Data Act. This Strategic plan will help to guide implementation of the program to achieve the Vision, Goal, Objectives, and Strategic Actions as described in the plan.


Implementation Plan pages of April Progress ReportImplementation Plan

An interagency implementation plan was developed to identify specific actions required to achieve strategic plan goals. The details of the implementation plan can be found in the April 2018 Progress Report.


Protocols


Initial Protocols page of the Protocols ReportPreliminary Protocols for AB 1755

To support the initial implementation of AB 1755, the partner agencies have outlined three initial minimum protocols, consistent with available open data platforms, to guide early implementation of the program. The intent is to develop only what is necessary to facilitate early implementation to avoid creating barriers to sharing of data through an open data portal. These protocols will necessarily adapt over time in response to both changing software capabilities and the needs of the users of the open data portals to support a more efficient and transparent use of data.


Cover of the OWIA ReportOpen Water Information Architecture

Additional protocols and data standards will be developed in the future, informed by the Open Water Information Architecture (OWIA) and developed use cases, with a goal of increasing the interoperability of systems and datasets. 

The OWIA document addresses the intended outcomes (functional requirements) and system details (technical requirements) to ensure that both executives and engineers remain aligned in common purpose. The OWIA outlines protocols, procedures, resources, governance, and minimum standard of technology required to meet the needs of California’s water community, while also promoting greater levels of openness, transparency, and comparability for the information needed to manage water-related resources more effectively.


Who needs what data in what form to make what decisions?

A use case is a tool for assessing stakeholder data needs in specific decision contexts, and communicating those needs to technical developers. Additionally, the development of use cases helps clarify the questions that water resource decision-makers must answer and identifies the data necessary to answer those questions. Cooperative development of use cases allows water resource managers to examine a decision from multiple perspectives; it yields transparent documentation that water resource managers can use to communicate their decision-making process with stakeholders, to solicit improvements, and to foster trust in decisions; and it can help decision-makers articulate expectations of a data system in such a way that technical experts can analyze and address those expectations.


Cover of Data for Water Decision Making ReportData for Water Decision Making

A lack of data and information has limited our ability to understand, let alone better manage, all aspects of our water resources. This report supports California’s efforts to develop modern water data systems. It argues that simply providing more data is not enough, and that generating useful and useable information hinges on the development of data systems based on end users’ needs. The report describes lessons learned from a process of stakeholder engagement focused on defining and clarifying uses of water data, and how knowledge of these uses can inform the development of water data systems.


Initial Draft Use Cases

Diagram of distribution of Use Cases in various decision spaces

As an example of the type of content needed to inform a decision-driven water-data system, researchers and water management professionals engaged in the interactive development of 20 draft use cases. The 20 use cases are not intended to span the entire decision space of water and environmental management, nor are they designed to be a comprehensive library of possible water management decisions. Rather, they serve as a proof-of-concept to demonstrate that developing use cases is an effective means of focusing decision-making and prioritizing data collection and publication. The draft use cases are a starting point for the kinds of decisions to which the evolving federated, interoperable open data portals of AB 1755 must respond. Though the initial effort to develop the 20 use cases is complete, the partner agencies invite anyone involved in water management decision-making to contribute additional use cases, share available datasets for publication, and federate additional existing data portals.

Federated Interoperable Open Data Portals

In a federated open data system, participating open data nodes will be discoverable and accessible through a federated data catalog. This is analogous to an inter-library loan system, in which the ability of a user to discover holdings is key. The partner agencies are working to populate and federate two State-hosted portals, specifically the California Open Data Portal and the CNRA Open Data Platform, to allow users improved access to available water and ecological datasets. State agencies have made over 1,000 datasets and numerous data visualizations available on these two portals. Both portals will offer additional functionality, as well as new and updated data on a continuous basis, based on availability, technology developments, and user feedback.


Screen Capture of the CNRA Open Data PortalCalifornia Natural Resources Agency Open Data Platform

The CNRA Open Data Platform has been developed to provide data to State of California citizens, agencies, and interested stakeholders in a transparent and useful manner. The Open Data Platform supports the missions of CNRA organizations and programs by providing an environment to publish and share useful data that can be effectively utilized by all.


Screen Capture of the California Open Data PortalCalifornia Open Data Portal

The California Open Data Portal, hosted by GovOps and the California Department of Technology, features data from many different State agencies on a wide variety of topics. The California Open Data Portal will bring government closer to citizens and start a new shared conversation for growth and progress in our great state.


Implementation of AB 1755 must include thoughtful choices about long-term governance and funding for the open data platform. In the absence of a resilient governance structure and stable funding model, the open data platform is not sustainable. In creating, operating, and maintaining the platform, numerous actions and decisions will have to be coordinated— from system architecture to protocols adoption to platform development and use. A governance structure is the body of established rules and expectations about how these things will be decided and coordinated.

When it comes to funding the operation and maintenance of the open data system, the Open and Transparent Water Data Act established the Water Data Administration Fund, which can receive voluntary contributions, but the legislation did not include a funding appropriation. This highlights one of the biggest challenges the AB 1755 open data platform will face, the need for dedicated resources to keep it running.