Open data and all that

Opening up government finances

with one comment

[Cross-posted from]

It’s an exciting time with open data in the UK, and especially in the area of local data. When I first played around with the idea of opening up the basics of local government data (which turned into OpenlyLocal), I never imagined I was entering an area that  little more than a year later would become such an exciting area, combining two of the hottest online trends, open government data and local data.

But still, there’s a hell of a long way to go, and one of the areas where there’s furthest to travel, and most to do is finance, specifically where the money’s being spent, who it’s being spent with, and also where it comes from. As the old journo saw goes: follow the money.

I had my first taste of the problems when I took a pretty much unused (and locked) spreadsheet, the 2006-07 Local Spending Report, and over the course of a weekend, unlocked it cleaned it up, imported it into a database and allowed people to do what the spreadsheet didn’t — make comparisons on local spending across councils and in areas.

However, the information was fairly heavily aggregated, was for just one period, and didn’t allow comparison with other financial reports.

So at the last OKCON a month or so ago, I sat down with some of the good people from Where Does My Money Go to discuss in some general principles for presenting government finances as data, to allow it to be properly analysed, combined with other data, and follow the flow of money to and from all branches of government, central and local. Now, the first draft has now been published.

The hope was that we could establish some general principles that would be applicable not just to government finances in the UK, but also for other countries too. Some of the key points are:

  • Machine-readable — we need the information as data that we can do things with.
  • Fine enough granularity so we can understand what’s going on, both in terms of categories, time periods, and transactions of any sort of size.
  • Using standard IDs to allow definitive identification and matching of bodies, areas and categories.

Obviously we’d welcome comments from both the UK and other countries. It’s also worth noting that there are two overlapping but slightly different areas: the accounts, and the transactions. Ultimately if you have access to the transactions you can work out the accounts, but it may be worth teasing out the distinctions, particularly in light of the UK moves (see below).

At the same time as doing this, in the UK things have been moving on apace, with the new coalition government announcing that by January 2011 all spending by local government over £500 must be published, which in government terms is a blink of an eye.

In addition, Will Perrin and I, who both sit on the Local Public Data Panel, were also asked for advice by Camden Council, who in the best traditions of open data wanted to get on and release their data a lot earlier than this.

Within literally a few days, and with much helpful advice from many of the other Local Public Data Panel members, a first draft was done, and has today been published on This clearly is very much a UK document, is concerned with local spending, and is framed by the goal of publishing spending over £500.

However, like the Open Knowledge Foundation document, it’s meant as a first draft, and a focal point for discussion and I’d encourage all, whether open data and transparency advocates, or those working in local government (including police, health authorities etc) to add their comments to this document too.

Written by countculture

June 3, 2010 at 10:25 pm

One Response

Subscribe to comments with RSS.

  1. […] via Opening up government finances « countculture. […]

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: