ODI DATA CERTIFICATES ARE A BIG DEAL

-

ODI Data Certificates

This morning something happened that will gradually impact the way we interact with data. This morning OpenDataSoft (ODS) embedded the Open Data Institute's Data Set Certificates into each and every data set page.

Will other open data platforms follow? Maybe. Embedding certificates is something I have been advocating since the idea was just an idea at the Open Data Institute (ODI). No one until ODS ever took me up on my offer.

These data certificates show a willingness on the part of the data steward to consider the following:

  1. The impact on individual privacy
  2. API and format documentation to ensure a greater chance of data re-use
  3. Metadata on where the data originates and how often it is refreshed
  4. RDF description tags and identifiers that allow for SPARQL queries
  5. Contact information for everything from privacy concerns, error corrections and the rest of the kitchen sink

A look at metadata pages for other platforms are not as rich natively. These data certificates are the foundation blocks on which we can build other certification processes. +Paul Baker from Webitects and this author have each come up with further certifications to be built on top of the work done by the ODI.

Paul Baker developed a personal digital certificate process Here a consumer of data would generate a certificate to notify the data steward of the data's re-use. Both sides benefit. The data consumer can be notified of service changes or interruptions. The data steward can now demonstrate value through the data consumer's re-use.

The open data program certification scheme is what I am working. It is based on the ODI's certificates and adds some additional requirements.

So in developing a plan for evaluating programs as well as data sets I took the following factors in mind to assign a maturity level to the program. Look at each level’s requirements. Note that Standard needs to include all Pilots and Standard requirements.

Expert level requires everything here including metadata that contains the following tags (Standard):

  1. An Open Data Policy (Expert)
  2. A Data Classification Policy (Pilot)
  3. A Privacy Policy regarding use of the site (Pilot)
  4. Primary Contact for the data portal (Pilot)
  5. Agency responsible for publishing and maintaining the data catalog (Pilot)
  6. More than half of the sites data sets meet “Pilot” level or above in terms of open data certificates from the ODI and evaluated by ODI Member companies.
  7. Data certificates are reviewed monthly (Expert), quarterly (Standard), annually (at a minimum for Pilot)

Hopefully this will be a call to the data stewards as well as the platform providers that the Open Data Institute will be carrying the standard for data re-use certification. This is the start toward a more interoperable set of standards in data.

Given the negative press around the release of CSV formatted data in multiple encoding schemas it is likely the encoding type variable will make its way to the ODI certification program.

It is exciting to see these ideas come to fruition. ODS is to be commended for being the first to step up. Now we just have to make sure our CSV's are all encoded properly.

Original article: https://www.linkedin.com/pulse/20140917132706-988234-odi-data-certificates-are-a-big-deal?trk=mp-reader-card

Comments

Post a Comment

Popular posts from this blog

Podcast: Open Data Discussions with Anthony Fung

-
Image
A look back at Virginia’s 4 years of data innovation with Anthony Fung, Deputy Secretary of Technology for the Commonwealth of Virginia  Welcome to the OpenDataSoft Leadership Podcast Series, “Open Data Discussions”. Each month, Jason Hare, our Open Data Evangelist, features a different open data program around the country to discuss what has made it successful. These examples will provide insights and strategies that you can implement in your own city. We had the pleasure of welcoming Anthony Fung, Deputy Secretary of Technology for the Commonwealth of Virginia for the fifth podcast in our series. Anthony discussed various subjects, including: What role does open data play in policymaking at the state level in Virginia? Does his department work on ensuring open data quality? What are some of the steps he makes in ensuring sound data governance? How did Virginia come up with this technology and engagement solutions?  How, for example, did yo
Read more

Open Data Licensing

-
Image
Everything you wanted to know but you were afraid to ask. Making data open and available is not just about choosing a format or having an API. A poor choice in your license can prevent people from using them. A traditional open license reassures potential users that their work on the data will be useful in the long run. So, what license should you pick for your data to be broadly used? There are a few things to consider. Choosing a license for your open data can usually be one of the biggest challenges for an open data project. There are plenty of licenses available for your data. Choosing one mostly depends on the usage and reach you want to give to your project. CHOOSE A LICENSE: BASED ON NATIONAL, INTERNATIONAL AND LOCAL STATUTES IN ADDITION TO REUSE It should be noted that different parts of the world use data licensing terms differently. In the US, works in the “public domain” are works are not covered by intellectual property rights, such as copyright. The copyright mig
Read more

AN OPEN DATA POLICY FOR NORTH CAROLINA: COMING SOON?

-
Image
All parts of North Carolina will benefit from open data legislation. FOR THE BETTER PART OF TWO DECADES, I’VE WORKED TO OPEN UP NORTH CAROLINA’S DATA. I’ve been a public servant at Durham Public Schools and the Department of Energy. I have been an onsite consultant for the Cities of Raleigh, Durham as well as the Towns of Cary and Chapel Hill. I’ve been on teams serving state agencies and local governments. I’ve witnessed dozens of open data projects both locally and abroad. All of these projects share crucial steps and goals in common. First, by transforming public documents from disconnected PDFs into machine-readable data, by applying the right open formats, we can liberate public information from the repositories where it used to require manual review. Insights become instant. Second, by publishing machine-readable data compilations online, for everyone to use, we can crowdsource those insights. Citizens and companies and the media can scrutinize. Even better, when a government age
Read more